-- Logs begin at Wed 2022-08-24 04:04:50 UTC, end at Wed 2022-08-24 05:09:10 UTC. -- Aug 24 04:35:10.189785 dv-cinder-854265-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 04:35:10.198467 dv-cinder-854265-1-smb devstack@keystone.service[93135]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 04:35:10.200694 dv-cinder-854265-1-smb devstack@keystone.service[93135]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 04:35:10 2022] *** Aug 24 04:35:10.200694 dv-cinder-854265-1-smb devstack@keystone.service[93135]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 04:35:10.200694 dv-cinder-854265-1-smb devstack@keystone.service[93135]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 04:35:10.200694 dv-cinder-854265-1-smb devstack@keystone.service[93135]: nodename: dv-cinder-854265-1-smb Aug 24 04:35:10.200694 dv-cinder-854265-1-smb devstack@keystone.service[93135]: machine: x86_64 Aug 24 04:35:10.200694 dv-cinder-854265-1-smb devstack@keystone.service[93135]: clock source: unix Aug 24 04:35:10.200694 dv-cinder-854265-1-smb devstack@keystone.service[93135]: pcre jit disabled Aug 24 04:35:10.200694 dv-cinder-854265-1-smb devstack@keystone.service[93135]: detected number of CPU cores: 4 Aug 24 04:35:10.200694 dv-cinder-854265-1-smb devstack@keystone.service[93135]: current working directory: / Aug 24 04:35:10.200694 dv-cinder-854265-1-smb devstack@keystone.service[93135]: detected binary path: /usr/bin/uwsgi-core Aug 24 04:35:10.200694 dv-cinder-854265-1-smb devstack@keystone.service[93135]: your processes number limit is 47680 Aug 24 04:35:10.201379 dv-cinder-854265-1-smb devstack@keystone.service[93135]: your memory page size is 4096 bytes Aug 24 04:35:10.201379 dv-cinder-854265-1-smb devstack@keystone.service[93135]: detected max file descriptor number: 2048 Aug 24 04:35:10.201379 dv-cinder-854265-1-smb devstack@keystone.service[93135]: lock engine: pthread robust mutexes Aug 24 04:35:10.201379 dv-cinder-854265-1-smb devstack@keystone.service[93135]: thunder lock: enabled Aug 24 04:35:10.201379 dv-cinder-854265-1-smb devstack@keystone.service[93135]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 04:35:10.201379 dv-cinder-854265-1-smb devstack@keystone.service[93135]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 04:35:10.241992 dv-cinder-854265-1-smb devstack@keystone.service[93135]: Python main interpreter initialized at 0x5636dff3b9c0 Aug 24 04:35:10.241992 dv-cinder-854265-1-smb devstack@keystone.service[93135]: python threads support enabled Aug 24 04:35:10.241992 dv-cinder-854265-1-smb devstack@keystone.service[93135]: your server socket listen backlog is limited to 100 connections Aug 24 04:35:10.241992 dv-cinder-854265-1-smb devstack@keystone.service[93135]: your mercy for graceful operations on workers is 90 seconds Aug 24 04:35:10.242445 dv-cinder-854265-1-smb devstack@keystone.service[93135]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 04:35:10.242445 dv-cinder-854265-1-smb devstack@keystone.service[93135]: *** Operational MODE: preforking *** Aug 24 04:35:10.242741 dv-cinder-854265-1-smb devstack@keystone.service[93135]: *** uWSGI is running in multiple interpreter mode *** Aug 24 04:35:10.242741 dv-cinder-854265-1-smb devstack@keystone.service[93135]: spawned uWSGI master process (pid: 93135) Aug 24 04:35:10.242941 dv-cinder-854265-1-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 24 04:35:10.243847 dv-cinder-854265-1-smb devstack@keystone.service[93135]: spawned uWSGI worker 1 (pid: 93147, cores: 1) Aug 24 04:35:10.244141 dv-cinder-854265-1-smb devstack@keystone.service[93135]: spawned uWSGI worker 2 (pid: 93148, cores: 1) Aug 24 04:35:10.244299 dv-cinder-854265-1-smb devstack@keystone.service[93135]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 04:35:14.503866 dv-cinder-854265-1-smb devstack@keystone.service[93147]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:35:14.503866 dv-cinder-854265-1-smb devstack@keystone.service[93147]: from cryptography.utils import int_from_bytes Aug 24 04:35:14.504662 dv-cinder-854265-1-smb devstack@keystone.service[93147]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:35:14.504662 dv-cinder-854265-1-smb devstack@keystone.service[93147]: from cryptography.utils import int_from_bytes Aug 24 04:35:14.504810 dv-cinder-854265-1-smb devstack@keystone.service[93148]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:35:14.504810 dv-cinder-854265-1-smb devstack@keystone.service[93148]: from cryptography.utils import int_from_bytes Aug 24 04:35:14.504810 dv-cinder-854265-1-smb devstack@keystone.service[93148]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:35:14.504810 dv-cinder-854265-1-smb devstack@keystone.service[93148]: from cryptography.utils import int_from_bytes Aug 24 04:35:14.553913 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 04:35:14.554130 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 04:35:14.554218 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 04:35:14.554293 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] command line args: [] {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 04:35:14.554353 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 04:35:14.554482 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] command line args: [] {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 04:35:14.554569 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 04:35:14.554708 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ================================================================================ {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 04:35:14.554846 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 04:35:14.554926 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ================================================================================ {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 04:35:14.555006 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] admin_token = **** {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.555186 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] admin_token = **** {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.555320 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] config_dir = [] {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.555320 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.555446 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] config_dir = [] {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.555509 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] config_source = [] {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.555573 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.555642 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] debug = True {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.555773 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] config_source = [] {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.555914 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.556177 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] debug = True {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.556177 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.556336 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.556403 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.556466 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.556528 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.556590 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.556824 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.556913 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.556981 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.557039 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] list_limit = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.557188 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] list_limit = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.557266 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] log_config_append = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.557366 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.557442 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] log_config_append = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.557612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] log_dir = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.557698 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.557759 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] log_file = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.557814 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] log_dir = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.557876 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] log_file = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.557938 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.558136 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.558251 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.558434 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.558578 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.558656 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.558717 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.558832 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.558972 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.559050 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.559123 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.559188 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.559246 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.559447 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.559543 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.559736 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.559872 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.559872 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.560018 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.560089 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.560159 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.560313 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.560413 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.560559 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.560647 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.560833 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.560953 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.561032 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.561116 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.561315 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.561619 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.561792 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] publish_errors = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.561899 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.561977 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] publish_errors = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.562046 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.562230 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.562329 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.562408 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.562480 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.562609 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.562734 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.562829 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.562901 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.563053 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] standard_threads = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.563140 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.563284 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.563382 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] standard_threads = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.563516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.563594 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.563686 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.563761 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.563863 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] use_journal = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.564026 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.564105 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] use_json = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.564176 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] use_journal = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.564254 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] use_stderr = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.564334 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] use_json = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.564408 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] use_syslog = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.564517 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] use_stderr = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.564597 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] use_syslog = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.564668 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.564787 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:35:14.564870 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.565058 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.565153 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.565297 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.565396 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.565563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.565640 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.565811 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.565942 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.566045 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.566122 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.566285 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.566367 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.566516 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.566601 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.566759 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.566841 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.567003 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.567121 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.567248 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.567332 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.567479 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.567556 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.567724 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.567807 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.567956 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.568052 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.568192 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.568279 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.568435 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.568544 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.568675 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.568758 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.568913 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.568995 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.569162 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.569246 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.569439 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.569608 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.569688 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.569759 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.569900 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.569975 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.570152 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.570240 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.570400 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.570476 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.570648 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.570727 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.570883 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.570974 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.571112 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.571187 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.571338 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.571413 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.571565 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.571642 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.571799 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.571884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.572045 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.572120 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.572275 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.572351 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.572508 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.572582 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.572737 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.572813 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.572982 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.573071 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.573219 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.573295 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.573478 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.573554 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.573710 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.573788 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.573943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.574019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.574176 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.574257 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.574403 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.574481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.574630 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.574711 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.574856 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.574931 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.575080 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.575153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.575303 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.575381 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.575537 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.575615 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.575764 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.575841 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.575998 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.576119 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.576228 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.576304 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.576457 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.576533 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.576687 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.576769 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.576919 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.576994 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.577149 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.577258 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.577412 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.577513 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.577650 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.577751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.577885 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.577987 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.578118 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.578267 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.578355 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.578476 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.578559 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.578640 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.578792 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.578869 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.579031 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.579118 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.579265 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.579351 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.579494 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.579583 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.579723 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.579808 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.579975 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.580068 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.580204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.580284 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.580439 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.580523 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.580730 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.580831 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.580966 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.581043 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.581225 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.581303 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.581491 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.581584 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.581725 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.581801 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.581961 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.582042 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.582194 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.582284 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.582429 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.582509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.582664 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.582739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.582897 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.582982 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.583131 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.583209 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.583365 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.583441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.583601 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.583686 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.583838 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.583924 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.584068 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.584145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.584298 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.584384 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.584530 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.584608 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.584763 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.584846 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.585011 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.585095 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.585246 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.585348 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.585508 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.585596 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.585747 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.585833 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.585981 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.586057 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.586215 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.586302 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.586447 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.586605 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.586679 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.586748 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.586889 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.586966 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.587115 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.587200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.587344 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.587422 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.587571 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.587649 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.587799 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.587874 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.588029 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.588106 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.588263 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.588339 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.588503 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.588579 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.588741 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.588826 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.589000 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.589084 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.589238 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.589320 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.589496 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] auth.external = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.589579 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.589725 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.589809 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] auth.external = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.589969 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.590046 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.590233 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.590319 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.590462 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] auth.password = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.590541 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.590686 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] auth.token = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.590775 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] auth.password = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.590920 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.590999 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] auth.token = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.591152 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.591232 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.591389 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.591473 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.591616 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.591699 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.591860 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.591940 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.592101 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.592188 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.592332 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.592411 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.592563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] credential.caching = True {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.592648 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.592800 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] credential.caching = True {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.592896 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.593042 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.593120 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.593287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.593414 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.593550 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.593639 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.593790 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.593869 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.594022 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.594103 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.594259 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.594336 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.594508 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.594584 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.594742 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.594822 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.594987 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.595065 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.595242 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.595328 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.595504 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.595582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.595767 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.595850 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.596002 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.596079 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.596280 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.596359 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.596515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] federation.caching = True {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.596592 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.596750 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.596827 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] federation.caching = True {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.596985 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.597063 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.597226 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.597303 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.597480 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.597560 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.597726 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.597806 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.597959 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.598037 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.598196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.598281 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.598439 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.598517 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.598676 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.598753 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.598909 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.598995 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.599158 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.599237 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.599393 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] identity.caching = True {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.599471 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.599629 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] identity.caching = True {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.599713 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.599873 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.599955 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.600109 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.600197 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.600342 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.600510 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.600585 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.600655 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.600805 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.600883 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.601036 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.601122 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.601276 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.601375 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.601551 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.601630 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.601780 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.601868 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.602009 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.602088 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.602248 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.602337 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.602482 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.602567 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.602729 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.602806 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.602972 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.603050 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.603221 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.603306 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.603463 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.603540 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.603715 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.603792 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.603953 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.604044 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.604185 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.604264 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.604412 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.604490 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.604644 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.604730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.604870 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.604967 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.605103 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.605182 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.605372 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.605528 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.605608 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.605726 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.605827 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.605904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.606054 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.606139 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.606298 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.606383 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.606541 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.606620 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.607089 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.607179 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.607324 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.607401 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.607565 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.607643 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.607793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.607882 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.608026 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.608104 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.608252 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.608331 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.608480 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.608568 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.608713 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.608791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.608950 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.609079 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.609191 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.609319 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.609454 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.609578 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.609693 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.609827 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.609948 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.610074 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.610198 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.610305 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.610438 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.610570 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.610666 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.610782 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.610900 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.611029 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.611149 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.611262 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.611386 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.611496 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.611627 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.611729 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.611886 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.612026 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.user = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.612152 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.user = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.612266 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.612397 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.612522 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.612756 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.612835 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.613006 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.613085 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.613255 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.613437 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.613517 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.613589 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.613748 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.613828 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.613976 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.614056 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.614212 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.614290 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.614444 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.614523 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.614678 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.614755 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.614905 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.614982 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.615138 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.615216 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.615383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.615459 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.615625 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.615702 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.615867 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.615945 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.616109 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.616187 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.616335 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.616413 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.616588 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.616673 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.616813 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.616939 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.617045 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.617183 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.617270 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.617449 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.617530 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.617693 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.617772 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.617929 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.618019 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.618183 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.618261 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.618450 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.618590 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.618668 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.618750 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.618926 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.619006 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.619158 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.619236 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.619404 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.619491 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.619636 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.619713 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.619870 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.619952 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.620105 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.620192 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.620333 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.620412 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.620563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.620642 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.620799 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] resource.caching = True {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.620887 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.621033 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.621110 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.621274 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] resource.caching = True {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.621371 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.621543 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.621633 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.621788 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.621866 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.622025 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.622102 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.622258 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.622344 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.622501 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.622580 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.622734 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.622812 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.622975 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.623064 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.623200 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.623277 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] role.caching = True {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.623439 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.623517 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] role.driver = sql {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.623665 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.623816 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] role.caching = True {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.623891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] role.driver = sql {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.623981 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.624128 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.624212 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.624377 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.624456 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.624620 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.624699 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.624865 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.624944 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.625108 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.625195 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.625394 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.625479 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.625619 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.625698 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.625851 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.625931 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.626096 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.626174 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.626328 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.626405 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.626573 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.626651 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.626817 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.626896 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.627062 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.627211 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.627299 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.627449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.627719 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.627797 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.627955 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.628032 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.628199 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.628277 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.628447 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.628525 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.628682 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.628759 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.628933 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.629012 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.629165 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.629242 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.629431 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.629527 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.629661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.629739 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.629889 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.629967 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.630121 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.630210 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.630355 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.630432 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.630588 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.630666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.630839 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.630923 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.631072 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.631151 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.631306 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.631383 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.631533 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.631618 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.631766 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] token.caching = True {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.631844 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.631994 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.632070 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.632232 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] token.caching = True {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.632318 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.632464 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.632541 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.632712 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.632789 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.632951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.633037 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.633182 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.633258 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.633450 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.633533 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.633691 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.633784 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.633931 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.634009 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.634164 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.634242 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.634398 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.634484 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.634630 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.634709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.634866 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.634943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.635101 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.635188 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.635325 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.635402 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.635563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.635644 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.635797 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.635882 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.636040 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.636118 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] database.connection = **** {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.636323 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.636409 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.636567 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.636705 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] database.connection = **** {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.636843 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.636977 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.637109 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.637235 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.637377 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.637498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.637619 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.637739 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.637880 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.638010 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.638131 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.638251 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.638397 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.638514 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.638643 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.638764 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.638884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.639003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.639124 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.639244 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.639378 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.639500 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.639631 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.639751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.639871 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.639990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.640119 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.640273 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.640350 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.640421 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.640492 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.640562 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.640642 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 04:35:14.640715 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.640715 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:35:14.640863 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 04:35:14.670037 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.670265 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.670475 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.670566 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.670717 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.670947 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.678956 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.679552 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.707557 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.707705 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.707938 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.708024 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.760937 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.761370 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.809283 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.809560 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.810318 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.810522 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.969301 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.969632 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.969770 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.969912 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.970016 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.970082 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.970142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.970201 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.970259 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.970331 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.970401 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.970615 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.994161 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.994300 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.994383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.994479 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.994558 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.994669 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.994755 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.994933 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.995075 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.995148 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.995223 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.995327 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.995414 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:14.995589 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:15.006542 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:15.007001 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:15.019474 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:15.019605 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:15.019751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:15.019897 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:15.019968 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:15.020043 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:15.020205 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:15.020331 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:15.020414 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:15.020479 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:15.020626 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93147) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:15.020751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:15.020952 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:15.021174 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93148) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:35:15.037642 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.037833 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 04:35:15.037958 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.038164 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 04:35:15.038288 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.038382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 04:35:15.038460 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.038652 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.038784 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 04:35:15.038887 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.038995 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.039206 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.039425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.039659 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.039756 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.039994 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.048934 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.049210 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.049373 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.049462 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.049636 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.049782 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.049888 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.050211 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.056674 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=93147) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:35:15.057133 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=93148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:35:15.059563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=93147) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:35:15.059848 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.060040 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=93148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:35:15.060138 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.060335 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.060428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.060574 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.060656 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.060883 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.061008 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.061160 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.061310 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.061459 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.061585 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.061704 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.061827 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.061963 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.062088 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.062319 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.062499 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.062651 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.062855 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.084663 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.085318 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.086126 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93147) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:35:15.086411 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.086802 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:35:15.087094 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.091035 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=93147) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:35:15.091312 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.091591 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.091715 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=93148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:35:15.092029 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.092317 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.097918 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=93147) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:35:15.098201 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.098697 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=93148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:35:15.098989 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.102229 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93147) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:35:15.102520 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.102800 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.103069 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:35:15.103195 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.103368 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.103501 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.103626 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.103707 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.103827 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.103919 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.104081 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.104171 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.104430 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.104700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.104980 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.121462 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.121759 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.122709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.122996 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.125564 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93147) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:35:15.126842 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:35:15.128819 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.129107 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.130155 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.130467 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.133272 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93147) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:35:15.134647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:35:15.136375 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93147) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:35:15.137782 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:35:15.139576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.139872 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.140158 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.140440 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.140722 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.140985 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.141163 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.141284 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.141619 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.141904 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.142184 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.142473 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.156620 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93147) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:35:15.156912 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.157183 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.157469 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.158230 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:35:15.158523 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.158792 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.159150 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.164292 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.165815 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.165939 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.166076 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.167450 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.167723 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.168682 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=93147) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:35:15.168952 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.169264 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.169577 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.169856 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.170383 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=93148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:35:15.170677 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.170974 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.171271 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.171554 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.182815 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=93148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:35:15.182941 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=93147) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:35:15.183095 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.183222 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.183344 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.183526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.183613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.183748 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.183901 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.184056 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.184249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.184375 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.184513 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.184592 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.199821 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=93148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:35:15.200617 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=93147) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:35:15.202846 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:35:15.203643 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93147) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:35:15.205748 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.206569 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.207260 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.207999 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.208727 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=93148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:35:15.209014 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.209361 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.209506 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=93147) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:35:15.209780 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.210070 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.215821 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.216437 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.217274 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=93148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:35:15.217895 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=93147) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:35:15.220219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.220511 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.220812 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.220936 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.221093 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.221226 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.221466 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.221767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.229086 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:35:15.229382 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.229600 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93147) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:35:15.229725 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.229878 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.230115 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.236835 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=93148) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:35:15.237180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.237301 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=93147) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:35:15.237535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.237661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.237858 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.238047 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.238142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.238267 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.238402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.238524 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.238646 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.238776 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.238926 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.239089 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.239217 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.239345 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.239482 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.239610 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.239748 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.239887 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.240062 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.240198 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.240326 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.240454 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.240582 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.240717 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93148) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.240845 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93147) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:35:15.274154 dv-cinder-854265-1-smb devstack@keystone.service[93147]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5636dff3b9c0 pid: 93147 (default app) Aug 24 04:35:15.274278 dv-cinder-854265-1-smb devstack@keystone.service[93148]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5636dff3b9c0 pid: 93148 (default app) Aug 24 04:35:15.277646 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2247b-1d4f-4987-a5e2-f0f3f949b552 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:15.277930 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2247b-1d4f-4987-a5e2-f0f3f949b552 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:15.278200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2247b-1d4f-4987-a5e2-f0f3f949b552 None None] PATH_INFO: `/v3` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:15.282489 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 791 bytes} [Wed Aug 24 04:35:15 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:21.906379 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a26b1-5c56-42fa-8c1e-ed37cb9daefa None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:21.907217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a26b1-5c56-42fa-8c1e-ed37cb9daefa None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:21.907217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a26b1-5c56-42fa-8c1e-ed37cb9daefa None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:21.913216 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1/2] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:35:21 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:35:21.923286 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a571b-5578-476c-802a-484a6611bd14 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:21.923723 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a571b-5578-476c-802a-484a6611bd14 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:21.923805 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a571b-5578-476c-802a-484a6611bd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:21.993858 dv-cinder-854265-1-smb devstack@keystone.service[93147]: INFO dbcounter [None req-ec5a571b-5578-476c-802a-484a6611bd14 None None] Registered counter for database keystone Aug 24 04:35:22.015984 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG oslo_db.sqlalchemy.engines [None req-ec5a571b-5578-476c-802a-484a6611bd14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93147) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:35:22.023988 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writer thread running {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:35:22.206188 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG passlib.handlers.bcrypt [None req-ec5a571b-5578-476c-802a-484a6611bd14 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=93147) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 04:35:22.206539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG passlib.handlers.bcrypt [None req-ec5a571b-5578-476c-802a-484a6611bd14 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93147) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 04:35:22.267077 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-ec5a571b-5578-476c-802a-484a6611bd14 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:22.269766 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-ec5a571b-5578-476c-802a-484a6611bd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:22.421887 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 2/3] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 500 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 04:35:22.886071 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a26b1-5c56-42fa-8c1e-ed37cb9daefa None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:22.963336 dv-cinder-854265-1-smb devstack@keystone.service[93148]: INFO dbcounter [None req-a99a26b1-5c56-42fa-8c1e-ed37cb9daefa None None] Registered counter for database keystone Aug 24 04:35:22.988555 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG oslo_db.sqlalchemy.engines [None req-a99a26b1-5c56-42fa-8c1e-ed37cb9daefa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:35:22.999841 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writer thread running {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:35:23.127362 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a26b1-5c56-42fa-8c1e-ed37cb9daefa None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:23.132938 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46137ea9-b2bf-4fe2-966d-ae2e54e3af20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:23.133594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46137ea9-b2bf-4fe2-966d-ae2e54e3af20 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:23.133877 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46137ea9-b2bf-4fe2-966d-ae2e54e3af20 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:23.134147 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46137ea9-b2bf-4fe2-966d-ae2e54e3af20 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:23.143590 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46137ea9-b2bf-4fe2-966d-ae2e54e3af20 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:23.194500 dv-cinder-854265-1-smb devstack@keystone.service[93148]: WARNING keystone.common.rbac_enforcer.enforcer [None req-46137ea9-b2bf-4fe2-966d-ae2e54e3af20 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 04:35:23.194848 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46137ea9-b2bf-4fe2-966d-ae2e54e3af20 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:23.205630 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 2/4] 10.222.0.49 () {58 vars in 1324 bytes} [Wed Aug 24 04:35:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:35:23.212702 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a571b-5578-476c-802a-484a6611bd14 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:23.231910 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a571b-5578-476c-802a-484a6611bd14 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:23.238508 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc6b36-a3e8-4d44-a37f-9337347b8aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:23.239673 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc6b36-a3e8-4d44-a37f-9337347b8aba admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:23.239973 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc6b36-a3e8-4d44-a37f-9337347b8aba admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:23.240324 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc6b36-a3e8-4d44-a37f-9337347b8aba admin admin] PATH_INFO: `/v3/projects/68ea81c5f7c24dfdae5a0b686d31ba39` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:23.242072 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc6b36-a3e8-4d44-a37f-9337347b8aba admin admin] RBAC: Authorizing `identity:get_project(project_id=68ea81c5f7c24dfdae5a0b686d31ba39)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:23.294976 dv-cinder-854265-1-smb devstack@keystone.service[93147]: WARNING keystone.common.rbac_enforcer.enforcer [None req-87cc6b36-a3e8-4d44-a37f-9337347b8aba admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 04:35:23.295320 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc6b36-a3e8-4d44-a37f-9337347b8aba admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:23.300152 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 3/5] 10.222.0.49 () {56 vars in 1207 bytes} [Wed Aug 24 04:35:23 2022] GET /identity/v3/projects/68ea81c5f7c24dfdae5a0b686d31ba39 => generated 344 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:25.156929 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e92a69-c07a-40f2-a9ea-def0d4076236 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:25.157281 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e92a69-c07a-40f2-a9ea-def0d4076236 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:25.157281 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e92a69-c07a-40f2-a9ea-def0d4076236 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:25.164182 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 3/6] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:35:25 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:25.172664 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801cb72-ebb4-432c-a4fb-05b529ddd783 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:25.173119 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801cb72-ebb4-432c-a4fb-05b529ddd783 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:25.173213 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801cb72-ebb4-432c-a4fb-05b529ddd783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:25.195004 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-8801cb72-ebb4-432c-a4fb-05b529ddd783 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:25.196541 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-8801cb72-ebb4-432c-a4fb-05b529ddd783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:25.205637 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 4/7] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 24 04:35:25.467896 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e92a69-c07a-40f2-a9ea-def0d4076236 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:25.482592 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e92a69-c07a-40f2-a9ea-def0d4076236 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:25.488288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed5994-cbb3-493e-b3e6-6b2b0ee453ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:25.488887 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed5994-cbb3-493e-b3e6-6b2b0ee453ae admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:25.489164 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed5994-cbb3-493e-b3e6-6b2b0ee453ae admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:25.489540 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed5994-cbb3-493e-b3e6-6b2b0ee453ae admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:25.498231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed5994-cbb3-493e-b3e6-6b2b0ee453ae admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:25.500039 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed5994-cbb3-493e-b3e6-6b2b0ee453ae admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:25.509507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 4/8] 10.222.0.49 () {58 vars in 1324 bytes} [Wed Aug 24 04:35:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:35:25.515528 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801cb72-ebb4-432c-a4fb-05b529ddd783 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:25.525263 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801cb72-ebb4-432c-a4fb-05b529ddd783 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:25.530617 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431585f-e89d-4819-808d-29d52bde2a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:25.531250 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431585f-e89d-4819-808d-29d52bde2a30 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:25.531602 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431585f-e89d-4819-808d-29d52bde2a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:25.531874 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431585f-e89d-4819-808d-29d52bde2a30 admin admin] PATH_INFO: `/v3/users/e55eed92c6aa44dcbffd3cac5e4faad7` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:25.533244 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431585f-e89d-4819-808d-29d52bde2a30 admin admin] RBAC: Authorizing `identity:get_user(user_id=e55eed92c6aa44dcbffd3cac5e4faad7)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:25.535148 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431585f-e89d-4819-808d-29d52bde2a30 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:25.536685 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 5/9] 10.222.0.49 () {56 vars in 1198 bytes} [Wed Aug 24 04:35:25 2022] GET /identity/v3/users/e55eed92c6aa44dcbffd3cac5e4faad7 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:27.471902 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e24c6-2d16-4353-b98a-9719e8ad0c5e None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:27.472412 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e24c6-2d16-4353-b98a-9719e8ad0c5e None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:27.472412 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74e24c6-2d16-4353-b98a-9719e8ad0c5e None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:27.473765 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 5/10] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:27.479101 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d2371-3135-4eba-9b6b-e6acd9de593e None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:27.479527 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d2371-3135-4eba-9b6b-e6acd9de593e None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:27.479620 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d2371-3135-4eba-9b6b-e6acd9de593e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:27.498731 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-b84d2371-3135-4eba-9b6b-e6acd9de593e None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:27.499895 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-b84d2371-3135-4eba-9b6b-e6acd9de593e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:27.508673 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d05640-3db2-4051-893f-5dbf01c41e08 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:27.508958 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d05640-3db2-4051-893f-5dbf01c41e08 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:27.509240 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d05640-3db2-4051-893f-5dbf01c41e08 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:27.510651 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 6/11] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:27.515677 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573e357-5c00-44c5-be75-2cea4b6aeace None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:27.515969 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573e357-5c00-44c5-be75-2cea4b6aeace None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:27.516247 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3573e357-5c00-44c5-be75-2cea4b6aeace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:27.559863 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG passlib.handlers.bcrypt [None req-3573e357-5c00-44c5-be75-2cea4b6aeace None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=93148) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 04:35:27.560298 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG passlib.handlers.bcrypt [None req-3573e357-5c00-44c5-be75-2cea4b6aeace None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93148) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 04:35:27.583080 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 6/12] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:27.605428 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-3573e357-5c00-44c5-be75-2cea4b6aeace None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:27.607108 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-3573e357-5c00-44c5-be75-2cea4b6aeace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:27.709801 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 7/13] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:27.849459 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d2371-3135-4eba-9b6b-e6acd9de593e None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:27.874265 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:27.959327 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d2371-3135-4eba-9b6b-e6acd9de593e None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:27.969577 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573e357-5c00-44c5-be75-2cea4b6aeace None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:27.994956 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07578668-67e6-4700-aad2-6e1e776e992d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:27.995600 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07578668-67e6-4700-aad2-6e1e776e992d None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:27.995882 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07578668-67e6-4700-aad2-6e1e776e992d None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:27.996133 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07578668-67e6-4700-aad2-6e1e776e992d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:28.007976 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07578668-67e6-4700-aad2-6e1e776e992d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:28.016455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-07578668-67e6-4700-aad2-6e1e776e992d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:35:28.016455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:28.016455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:28.016455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:28.016455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:28.016455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:28.016455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:28.016455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:28.016455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:28.016455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:28.016455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:28.016455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:28.016455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:28.016455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:28.016455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:28.016455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:28.017425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:28.017425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:28.017425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:28.017425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:28.017425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:28.017425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:28.017425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:28.017425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:28.017425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:28.017425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:28.017425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:28.017425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:28.017425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:28.017425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:28.017425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:28.017425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:28.018282 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:28.018282 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:28.018282 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:28.018282 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:28.018282 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:28.018282 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:28.018282 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:28.018282 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:28.018282 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:28.018282 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:28.018282 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:35:28.018282 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:35:28.018282 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 7/14] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 24 04:35:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:28.023766 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07578668-67e6-4700-aad2-6e1e776e992d None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:28.077007 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3573e357-5c00-44c5-be75-2cea4b6aeace None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:28.079330 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:28.103531 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:28.114179 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217bca0-baf2-4ed0-a7dd-539cc34545e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:28.115053 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217bca0-baf2-4ed0-a7dd-539cc34545e4 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:28.115337 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217bca0-baf2-4ed0-a7dd-539cc34545e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:28.115635 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d217bca0-baf2-4ed0-a7dd-539cc34545e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:28.122085 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07578668-67e6-4700-aad2-6e1e776e992d None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:28.158409 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be94f6a-fbf4-4fb8-8c65-872f6419bd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:28.159030 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be94f6a-fbf4-4fb8-8c65-872f6419bd5d None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:28.159310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be94f6a-fbf4-4fb8-8c65-872f6419bd5d None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:28.159589 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be94f6a-fbf4-4fb8-8c65-872f6419bd5d None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:28.160282 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be94f6a-fbf4-4fb8-8c65-872f6419bd5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:28.160581 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be94f6a-fbf4-4fb8-8c65-872f6419bd5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:28.162044 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be94f6a-fbf4-4fb8-8c65-872f6419bd5d None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:28.173964 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 8/15] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:35:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:35:28.179761 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be94f6a-fbf4-4fb8-8c65-872f6419bd5d None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:28.186172 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217bca0-baf2-4ed0-a7dd-539cc34545e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:28.187718 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d217bca0-baf2-4ed0-a7dd-539cc34545e4 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:28.280981 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be94f6a-fbf4-4fb8-8c65-872f6419bd5d None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:28.286470 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 8/16] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:35:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 04:35:28.292135 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217bca0-baf2-4ed0-a7dd-539cc34545e4 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:28.295331 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:28.315570 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c0fb4-f7d1-49cd-96a2-76da4cade47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:28.316213 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c0fb4-f7d1-49cd-96a2-76da4cade47b None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:28.316488 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c0fb4-f7d1-49cd-96a2-76da4cade47b None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:28.316766 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c0fb4-f7d1-49cd-96a2-76da4cade47b None admin] PATH_INFO: `/v3/users/e55eed92c6aa44dcbffd3cac5e4faad7` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:28.317964 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c0fb4-f7d1-49cd-96a2-76da4cade47b None admin] RBAC: Authorizing `identity:get_user(user_id=e55eed92c6aa44dcbffd3cac5e4faad7)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:28.319526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c0fb4-f7d1-49cd-96a2-76da4cade47b None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:28.321147 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 9/17] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:35:28 2022] GET /identity/v3/users/e55eed92c6aa44dcbffd3cac5e4faad7 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:35:28.326694 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c0fb4-f7d1-49cd-96a2-76da4cade47b None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:28.341003 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:28.399230 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d217bca0-baf2-4ed0-a7dd-539cc34545e4 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:28.432288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba3400-e871-4ded-96f7-e7d23e910a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:28.432933 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c0fb4-f7d1-49cd-96a2-76da4cade47b None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:28.433193 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba3400-e871-4ded-96f7-e7d23e910a47 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:28.433508 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba3400-e871-4ded-96f7-e7d23e910a47 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:28.433777 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba3400-e871-4ded-96f7-e7d23e910a47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:28.452938 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba3400-e871-4ded-96f7-e7d23e910a47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:28.454582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba3400-e871-4ded-96f7-e7d23e910a47 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:28.468266 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cdbb37-cea4-4549-a46a-e2f41b531051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:28.468906 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdbb37-cea4-4549-a46a-e2f41b531051 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:28.469190 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdbb37-cea4-4549-a46a-e2f41b531051 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:28.469500 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdbb37-cea4-4549-a46a-e2f41b531051 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:28.470715 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cdbb37-cea4-4549-a46a-e2f41b531051 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:28.472187 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cdbb37-cea4-4549-a46a-e2f41b531051 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:28.473221 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-f1ba3400-e871-4ded-96f7-e7d23e910a47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:28.473221 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:28.473221 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:28.473221 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:28.473221 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:28.473221 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:28.473221 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:28.473221 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:28.473221 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:28.473221 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:28.473221 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:28.473221 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:28.473221 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:28.473221 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:28.473221 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:28.473221 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:28.474635 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:28.474635 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:28.474635 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:28.474635 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:28.474635 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:28.474635 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:28.474635 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:28.474635 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:28.474635 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:28.474635 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:28.474635 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:28.474635 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:28.474635 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:28.474635 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:28.474635 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:28.474635 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:28.474635 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:28.475829 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:28.475829 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:28.475829 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:35:28.475981 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 10/18] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:35:28.476050 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 9/19] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:35:28.479680 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cdbb37-cea4-4549-a46a-e2f41b531051 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:28.480105 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba3400-e871-4ded-96f7-e7d23e910a47 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:28.539136 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:28.561708 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:28.583886 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cdbb37-cea4-4549-a46a-e2f41b531051 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:28.589207 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba3400-e871-4ded-96f7-e7d23e910a47 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:28.625162 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320399ab-2bdf-40ff-b5ca-8fce0051ac89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:28.625830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320399ab-2bdf-40ff-b5ca-8fce0051ac89 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:28.626108 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320399ab-2bdf-40ff-b5ca-8fce0051ac89 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:28.626378 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320399ab-2bdf-40ff-b5ca-8fce0051ac89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:28.627101 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320399ab-2bdf-40ff-b5ca-8fce0051ac89 None admin] RBAC: Adding query filter params (role.id=74ce7b72bcc94a8a8ad65c3db928e6ac, scope.domain.id=default, user.id=e55eed92c6aa44dcbffd3cac5e4faad7) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:28.627407 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320399ab-2bdf-40ff-b5ca-8fce0051ac89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:28.628145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2190be-3b8a-4534-b30f-f2a1a4f7a4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:28.628796 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2190be-3b8a-4534-b30f-f2a1a4f7a4c6 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:28.628892 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320399ab-2bdf-40ff-b5ca-8fce0051ac89 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:28.629076 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2190be-3b8a-4534-b30f-f2a1a4f7a4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:28.629360 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2190be-3b8a-4534-b30f-f2a1a4f7a4c6 None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:28.630024 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2190be-3b8a-4534-b30f-f2a1a4f7a4c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:28.630325 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2190be-3b8a-4534-b30f-f2a1a4f7a4c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:28.631778 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2190be-3b8a-4534-b30f-f2a1a4f7a4c6 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:28.635735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 11/20] 10.222.0.49 () {56 vars in 1322 bytes} [Wed Aug 24 04:35:28 2022] GET /identity/v3/role_assignments?user.id=e55eed92c6aa44dcbffd3cac5e4faad7&scope.domain.id=default&role.id=74ce7b72bcc94a8a8ad65c3db928e6ac => generated 233 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:28.651794 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 10/21] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:30.573518 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017908b-2871-4c1e-a219-0fab61bb806c None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:30.574002 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017908b-2871-4c1e-a219-0fab61bb806c None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:30.574002 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017908b-2871-4c1e-a219-0fab61bb806c None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:30.575328 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 12/22] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:30.580538 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7e128-c401-440b-a65c-429d749fcaf1 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:30.580936 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7e128-c401-440b-a65c-429d749fcaf1 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:30.581096 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7e128-c401-440b-a65c-429d749fcaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:30.605700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-f7d7e128-c401-440b-a65c-429d749fcaf1 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:30.606930 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-f7d7e128-c401-440b-a65c-429d749fcaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:30.695832 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 11/23] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:31.030201 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572f189-5462-412f-9861-bc77d196bb5c None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:31.030591 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572f189-5462-412f-9861-bc77d196bb5c None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:31.030779 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572f189-5462-412f-9861-bc77d196bb5c None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:31.032102 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 13/24] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:31.037631 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796177f9-4492-4b8c-a004-ee8bed997d63 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:31.037924 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796177f9-4492-4b8c-a004-ee8bed997d63 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:31.038207 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796177f9-4492-4b8c-a004-ee8bed997d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:31.040354 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572f189-5462-412f-9861-bc77d196bb5c None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:31.066440 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-796177f9-4492-4b8c-a004-ee8bed997d63 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:31.067674 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-796177f9-4492-4b8c-a004-ee8bed997d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:31.129009 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:31.198348 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 12/25] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:35:31.202014 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e2619-8474-4c99-93bd-514e7acf6e09 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:31.202310 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e2619-8474-4c99-93bd-514e7acf6e09 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:31.202586 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e2619-8474-4c99-93bd-514e7acf6e09 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:31.205791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 13/26] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:31.212650 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d0cf0-1555-4a43-a069-548f27ba6b4e None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:31.212933 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d0cf0-1555-4a43-a069-548f27ba6b4e None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:31.213207 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d0cf0-1555-4a43-a069-548f27ba6b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:31.247690 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-c15d0cf0-1555-4a43-a069-548f27ba6b4e None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:31.248952 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-c15d0cf0-1555-4a43-a069-548f27ba6b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:31.258111 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572f189-5462-412f-9861-bc77d196bb5c None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:31.319095 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d304605-8c91-4a2e-b55f-4c96f7aa57ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:31.320151 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d304605-8c91-4a2e-b55f-4c96f7aa57ba None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:31.320616 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d304605-8c91-4a2e-b55f-4c96f7aa57ba None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:31.321065 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d304605-8c91-4a2e-b55f-4c96f7aa57ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:31.334911 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d304605-8c91-4a2e-b55f-4c96f7aa57ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:31.340687 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-0d304605-8c91-4a2e-b55f-4c96f7aa57ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:35:31.340687 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:31.340687 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:31.340687 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:31.340687 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:31.340687 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:31.340687 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:31.340687 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:31.340687 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:31.340687 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:31.340687 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:31.340687 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:31.340687 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:31.340687 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:31.340687 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:31.340687 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:31.341521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:31.341521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:31.341521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:31.341521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:31.341521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:31.341521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:31.341521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:31.341521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:31.341521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:31.341521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:31.341521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:31.341521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:31.341521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:31.341521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:31.341521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:31.341521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:31.342260 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:31.342260 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:31.342260 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:31.342260 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:31.342260 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:31.342260 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:31.342260 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:31.342260 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:31.342260 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:31.342260 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:31.342260 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:35:31.342260 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:35:31.347442 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 14/27] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 24 04:35:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:35:31.355135 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d304605-8c91-4a2e-b55f-4c96f7aa57ba None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:31.359443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:31.378343 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 14/28] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:31.457586 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ad1d7-a02c-4b92-8afb-645d0e32fca9 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:31.458207 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ad1d7-a02c-4b92-8afb-645d0e32fca9 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:31.458683 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ad1d7-a02c-4b92-8afb-645d0e32fca9 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:31.460257 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 15/29] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:35:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:35:31.466743 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed5c88-6625-4310-a068-f697f912ce68 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:31.467311 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed5c88-6625-4310-a068-f697f912ce68 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:31.467775 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed5c88-6625-4310-a068-f697f912ce68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:31.502030 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d304605-8c91-4a2e-b55f-4c96f7aa57ba None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:31.508314 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-33ed5c88-6625-4310-a068-f697f912ce68 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:31.510856 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-33ed5c88-6625-4310-a068-f697f912ce68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:31.584605 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4f2e5-eabc-4462-bbae-d55bff8e7384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:31.586776 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4f2e5-eabc-4462-bbae-d55bff8e7384 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:31.587879 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4f2e5-eabc-4462-bbae-d55bff8e7384 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:31.588512 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4f2e5-eabc-4462-bbae-d55bff8e7384 None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:31.590379 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe4f2e5-eabc-4462-bbae-d55bff8e7384 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:31.591097 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe4f2e5-eabc-4462-bbae-d55bff8e7384 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:31.593467 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe4f2e5-eabc-4462-bbae-d55bff8e7384 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:31.617461 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 15/30] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:35:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:35:31.624661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4f2e5-eabc-4462-bbae-d55bff8e7384 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:31.677130 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 16/31] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:31.679620 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed5c88-6625-4310-a068-f697f912ce68 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:31.743695 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:31.769878 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:31.837545 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed5c88-6625-4310-a068-f697f912ce68 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:31.863868 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4f2e5-eabc-4462-bbae-d55bff8e7384 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:31.875219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48735b8c-afea-448c-a9ed-2bd4c5740008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:31.876095 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48735b8c-afea-448c-a9ed-2bd4c5740008 None admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:31.876660 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48735b8c-afea-448c-a9ed-2bd4c5740008 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:31.877061 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48735b8c-afea-448c-a9ed-2bd4c5740008 None admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:31.877909 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48735b8c-afea-448c-a9ed-2bd4c5740008 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:31.879964 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48735b8c-afea-448c-a9ed-2bd4c5740008 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:31.962087 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a90e64-7a6c-424d-a542-5d99b0f0130b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:31.962764 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a90e64-7a6c-424d-a542-5d99b0f0130b None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:31.963049 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a90e64-7a6c-424d-a542-5d99b0f0130b None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:31.963326 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a90e64-7a6c-424d-a542-5d99b0f0130b None admin] PATH_INFO: `/v3/users/e55eed92c6aa44dcbffd3cac5e4faad7` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:31.964536 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a90e64-7a6c-424d-a542-5d99b0f0130b None admin] RBAC: Authorizing `identity:get_user(user_id=e55eed92c6aa44dcbffd3cac5e4faad7)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:31.966075 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a90e64-7a6c-424d-a542-5d99b0f0130b None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:31.967722 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 16/32] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:35:31 2022] GET /identity/v3/users/e55eed92c6aa44dcbffd3cac5e4faad7 => generated 247 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:35:31.968497 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a90e64-7a6c-424d-a542-5d99b0f0130b None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:32.052539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 17/33] 10.222.0.49 () {60 vars in 1131 bytes} [Wed Aug 24 04:35:31 2022] POST /identity/v3/roles => generated 219 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:35:32.053326 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48735b8c-afea-448c-a9ed-2bd4c5740008 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:32.149504 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a90e64-7a6c-424d-a542-5d99b0f0130b None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:32.221852 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fcf70a-a6f9-4bc0-94a6-6d060c7e8165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:32.222502 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcf70a-a6f9-4bc0-94a6-6d060c7e8165 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:32.222786 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcf70a-a6f9-4bc0-94a6-6d060c7e8165 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:32.223062 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcf70a-a6f9-4bc0-94a6-6d060c7e8165 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:32.230627 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48735b8c-afea-448c-a9ed-2bd4c5740008 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:32.237854 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:32.241059 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:32.246388 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fcf70a-a6f9-4bc0-94a6-6d060c7e8165 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:32.253778 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fcf70a-a6f9-4bc0-94a6-6d060c7e8165 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:32.274142 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-83fcf70a-a6f9-4bc0-94a6-6d060c7e8165 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:32.274142 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:32.274142 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:32.274142 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:32.274142 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:32.274142 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:32.274142 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:32.274142 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:32.274142 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:32.274142 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:32.274142 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:32.274142 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:32.274142 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:35:32.274142 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:35:32.274142 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:35:32.274142 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:35:32.275983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:32.275983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:32.275983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:32.275983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:32.275983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:32.275983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:32.275983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:32.275983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:32.275983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:32.275983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:32.275983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:32.275983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:32.275983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:32.275983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:32.275983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:32.275983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:32.275983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:35:32.276735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:35:32.276735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:35:32.276735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:35:32.276735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 17/34] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:32.276735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fcf70a-a6f9-4bc0-94a6-6d060c7e8165 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:32.302403 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9afdd-7fa6-41ca-9a5b-b90880069294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:32.303690 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9afdd-7fa6-41ca-9a5b-b90880069294 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:32.304159 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9afdd-7fa6-41ca-9a5b-b90880069294 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:32.304830 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9afdd-7fa6-41ca-9a5b-b90880069294 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:32.306883 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9afdd-7fa6-41ca-9a5b-b90880069294 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:32.309152 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9afdd-7fa6-41ca-9a5b-b90880069294 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:32.311441 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 18/35] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:32.312597 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9afdd-7fa6-41ca-9a5b-b90880069294 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:32.422201 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fcf70a-a6f9-4bc0-94a6-6d060c7e8165 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:32.447589 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9afdd-7fa6-41ca-9a5b-b90880069294 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:32.464623 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68687d62-cf60-4e0e-9a86-2b715a09359c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:32.465363 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68687d62-cf60-4e0e-9a86-2b715a09359c None admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:32.465653 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68687d62-cf60-4e0e-9a86-2b715a09359c None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:32.465931 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68687d62-cf60-4e0e-9a86-2b715a09359c None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:32.466621 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68687d62-cf60-4e0e-9a86-2b715a09359c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:32.468051 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68687d62-cf60-4e0e-9a86-2b715a09359c None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:32.489071 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646840e-2e5e-4d52-8032-8dd566bdca2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:32.489738 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646840e-2e5e-4d52-8032-8dd566bdca2a None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:32.490021 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646840e-2e5e-4d52-8032-8dd566bdca2a None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:32.490295 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b646840e-2e5e-4d52-8032-8dd566bdca2a None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:32.490978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646840e-2e5e-4d52-8032-8dd566bdca2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:32.491283 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646840e-2e5e-4d52-8032-8dd566bdca2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:32.492768 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b646840e-2e5e-4d52-8032-8dd566bdca2a None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:32.504635 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 19/36] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:32.505463 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646840e-2e5e-4d52-8032-8dd566bdca2a None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:32.535320 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:32.601884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 18/37] 10.222.0.49 () {60 vars in 1131 bytes} [Wed Aug 24 04:35:32 2022] POST /identity/v3/roles => generated 225 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:35:32.607127 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bc379-4b36-4b6a-a2e3-4bec0c0b8547 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:32.607485 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bc379-4b36-4b6a-a2e3-4bec0c0b8547 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:32.607744 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bc379-4b36-4b6a-a2e3-4bec0c0b8547 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:32.609079 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 19/38] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:32.609867 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6bc379-4b36-4b6a-a2e3-4bec0c0b8547 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:32.622279 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b646840e-2e5e-4d52-8032-8dd566bdca2a None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:32.664596 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49802f16-aff6-463a-b630-72d6970e15b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:32.665284 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49802f16-aff6-463a-b630-72d6970e15b7 None admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:32.665629 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49802f16-aff6-463a-b630-72d6970e15b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:32.665910 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49802f16-aff6-463a-b630-72d6970e15b7 None admin] PATH_INFO: `/v3/domains/default/users/e55eed92c6aa44dcbffd3cac5e4faad7/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:32.668300 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49802f16-aff6-463a-b630-72d6970e15b7 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=e55eed92c6aa44dcbffd3cac5e4faad7, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:32.669882 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49802f16-aff6-463a-b630-72d6970e15b7 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:32.672782 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:32.711916 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 20/39] 10.222.0.49 () {58 vars in 1361 bytes} [Wed Aug 24 04:35:32 2022] PUT /identity/v3/domains/default/users/e55eed92c6aa44dcbffd3cac5e4faad7/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:35:32.711916 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874df159-6f60-4d03-8828-a284abf02921 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:32.711916 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874df159-6f60-4d03-8828-a284abf02921 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:32.711916 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874df159-6f60-4d03-8828-a284abf02921 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:32.711916 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 21/40] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:35:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:32.711916 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1997721-1324-48a9-80a4-72fada36417d None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:32.712772 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1997721-1324-48a9-80a4-72fada36417d None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:32.712772 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1997721-1324-48a9-80a4-72fada36417d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:32.734913 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-c1997721-1324-48a9-80a4-72fada36417d None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:32.737814 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-c1997721-1324-48a9-80a4-72fada36417d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:32.770204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6bc379-4b36-4b6a-a2e3-4bec0c0b8547 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:32.821598 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78bcf45-e75d-4c69-bce3-e81c5d7cc834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:32.822537 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bcf45-e75d-4c69-bce3-e81c5d7cc834 None admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:32.822817 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bcf45-e75d-4c69-bce3-e81c5d7cc834 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:32.823089 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bcf45-e75d-4c69-bce3-e81c5d7cc834 None admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:32.823761 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78bcf45-e75d-4c69-bce3-e81c5d7cc834 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:32.825499 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78bcf45-e75d-4c69-bce3-e81c5d7cc834 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:32.838903 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 22/41] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:32.840052 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293e560-627a-41c2-a69c-8ad6b09b151b None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:32.840320 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293e560-627a-41c2-a69c-8ad6b09b151b None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:32.840595 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d293e560-627a-41c2-a69c-8ad6b09b151b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:32.860993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-d293e560-627a-41c2-a69c-8ad6b09b151b None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:32.862737 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-d293e560-627a-41c2-a69c-8ad6b09b151b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:32.873879 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:32.874500 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 20/42] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 24 04:35:32 2022] POST /identity/v3/projects => generated 301 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:35:32.950996 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 23/43] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:33.122870 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78bcf45-e75d-4c69-bce3-e81c5d7cc834 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:33.212580 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293e560-627a-41c2-a69c-8ad6b09b151b None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:33.233741 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:33.238512 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78bcf45-e75d-4c69-bce3-e81c5d7cc834 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:33.278375 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956abee-cac3-4fdb-824a-a9c1c1818aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:33.278993 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956abee-cac3-4fdb-824a-a9c1c1818aca None admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:33.279283 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956abee-cac3-4fdb-824a-a9c1c1818aca None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:33.279556 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956abee-cac3-4fdb-824a-a9c1c1818aca None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:33.280235 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956abee-cac3-4fdb-824a-a9c1c1818aca None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:33.281669 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956abee-cac3-4fdb-824a-a9c1c1818aca None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:33.296830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 21/44] 10.222.0.49 () {60 vars in 1131 bytes} [Wed Aug 24 04:35:33 2022] POST /identity/v3/roles => generated 223 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:35:33.324107 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d293e560-627a-41c2-a69c-8ad6b09b151b None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:33.361995 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17981e-dc64-489b-ac06-9d4953758de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:33.362975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17981e-dc64-489b-ac06-9d4953758de6 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:33.363253 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17981e-dc64-489b-ac06-9d4953758de6 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:33.363524 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17981e-dc64-489b-ac06-9d4953758de6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:33.364657 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17981e-dc64-489b-ac06-9d4953758de6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:33.366191 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17981e-dc64-489b-ac06-9d4953758de6 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:33.368110 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 24/45] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:35:33.374099 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956abee-cac3-4fdb-824a-a9c1c1818aca None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:33.483640 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956abee-cac3-4fdb-824a-a9c1c1818aca None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:33.520005 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c2209-2d75-4006-935b-ff5d6c8a1762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:33.520643 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c2209-2d75-4006-935b-ff5d6c8a1762 None admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:33.520927 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c2209-2d75-4006-935b-ff5d6c8a1762 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:33.521209 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c2209-2d75-4006-935b-ff5d6c8a1762 None admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:33.521912 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c2209-2d75-4006-935b-ff5d6c8a1762 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:33.523425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c2209-2d75-4006-935b-ff5d6c8a1762 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:33.551411 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 22/46] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 24 04:35:33 2022] POST /identity/v3/projects => generated 312 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:35:34.678592 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be5c13-15ad-4532-b158-d3f86ab19d18 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:34.679110 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be5c13-15ad-4532-b158-d3f86ab19d18 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:34.679193 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be5c13-15ad-4532-b158-d3f86ab19d18 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:34.680561 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 25/47] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:34.686210 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615a6f4-1a11-476b-86de-21496db91374 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:34.686582 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615a6f4-1a11-476b-86de-21496db91374 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:34.686764 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615a6f4-1a11-476b-86de-21496db91374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:34.706665 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-7615a6f4-1a11-476b-86de-21496db91374 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:34.708193 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-7615a6f4-1a11-476b-86de-21496db91374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:34.711403 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:34.896024 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 23/48] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:35.158367 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be5c13-15ad-4532-b158-d3f86ab19d18 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:35.174887 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:35.265418 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be5c13-15ad-4532-b158-d3f86ab19d18 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:35.301698 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59714d20-6eab-4bc8-9339-ba4d78a290a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:35.302350 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59714d20-6eab-4bc8-9339-ba4d78a290a9 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:35.302632 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59714d20-6eab-4bc8-9339-ba4d78a290a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:35.302908 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59714d20-6eab-4bc8-9339-ba4d78a290a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:35.314781 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59714d20-6eab-4bc8-9339-ba4d78a290a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:35.428483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-59714d20-6eab-4bc8-9339-ba4d78a290a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:35:35.428483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:35.428483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:35.428483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:35.428483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:35.428483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:35.428483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:35.428483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:35.428483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:35.428483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:35.428483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:35.428483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:35.428483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:35.428483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:35.428483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:35.428483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:35.429381 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:35.429381 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:35.429381 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:35.429381 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:35.429381 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:35.429381 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:35.429381 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:35.429381 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:35.429381 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:35.429381 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:35.429381 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:35.429381 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:35.429381 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:35.429381 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:35.429381 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:35.429381 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:35.430219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:35.430219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:35.430219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:35.430219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:35.430219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:35.430219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:35.430219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:35.430219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:35.430219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:35.430219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:35.430219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:35:35.430219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:35:35.430219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 26/49] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 24 04:35:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:35.431006 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc38f7-adf9-46f8-b808-0067fb1edc0a None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:35.431006 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc38f7-adf9-46f8-b808-0067fb1edc0a None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:35.431006 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc38f7-adf9-46f8-b808-0067fb1edc0a None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:35.432175 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 24/50] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:35.435646 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59714d20-6eab-4bc8-9339-ba4d78a290a9 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:35.437329 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7e7ff-b93d-42ad-9a1e-2165a38a066c None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:35.437646 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7e7ff-b93d-42ad-9a1e-2165a38a066c None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:35.438032 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7e7ff-b93d-42ad-9a1e-2165a38a066c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:35.457209 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-21c7e7ff-b93d-42ad-9a1e-2165a38a066c None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:35.458510 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-21c7e7ff-b93d-42ad-9a1e-2165a38a066c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:35.513234 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:35.527582 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 25/51] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:35:35.544124 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59714d20-6eab-4bc8-9339-ba4d78a290a9 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:35.576770 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c61303-1d2b-4b5a-98ec-31e812b1ed65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:35.577447 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c61303-1d2b-4b5a-98ec-31e812b1ed65 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:35.577771 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c61303-1d2b-4b5a-98ec-31e812b1ed65 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:35.578053 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c61303-1d2b-4b5a-98ec-31e812b1ed65 None admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:35.578723 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c61303-1d2b-4b5a-98ec-31e812b1ed65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:35.579028 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c61303-1d2b-4b5a-98ec-31e812b1ed65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:35.580429 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c61303-1d2b-4b5a-98ec-31e812b1ed65 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:35.594002 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 27/52] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:35:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:35.600816 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7e7ff-b93d-42ad-9a1e-2165a38a066c None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:35.672257 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:35.705174 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7e7ff-b93d-42ad-9a1e-2165a38a066c None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:35.740392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af0c3e-e823-4073-adf8-64ce10e13198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:35.741101 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af0c3e-e823-4073-adf8-64ce10e13198 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:35.741412 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af0c3e-e823-4073-adf8-64ce10e13198 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:35.741701 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af0c3e-e823-4073-adf8-64ce10e13198 None admin] PATH_INFO: `/v3/users/e55eed92c6aa44dcbffd3cac5e4faad7` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:35.742850 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af0c3e-e823-4073-adf8-64ce10e13198 None admin] RBAC: Authorizing `identity:get_user(user_id=e55eed92c6aa44dcbffd3cac5e4faad7)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:35.744354 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af0c3e-e823-4073-adf8-64ce10e13198 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:35.746008 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 26/53] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:35:35 2022] GET /identity/v3/users/e55eed92c6aa44dcbffd3cac5e4faad7 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:35.751897 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c61303-1d2b-4b5a-98ec-31e812b1ed65 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:35.791696 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af0c3e-e823-4073-adf8-64ce10e13198 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:35.851199 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c61303-1d2b-4b5a-98ec-31e812b1ed65 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:35.885090 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024c43b-b9ef-4151-8e0f-0571089d9c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:35.885741 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024c43b-b9ef-4151-8e0f-0571089d9c3b None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:35.886018 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024c43b-b9ef-4151-8e0f-0571089d9c3b None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:35.886291 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0024c43b-b9ef-4151-8e0f-0571089d9c3b None admin] PATH_INFO: `/v3/domains/default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:35.887394 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024c43b-b9ef-4151-8e0f-0571089d9c3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:35.888862 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0024c43b-b9ef-4151-8e0f-0571089d9c3b None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:35.890496 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 28/54] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:35.894955 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af0c3e-e823-4073-adf8-64ce10e13198 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:35.896252 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024c43b-b9ef-4151-8e0f-0571089d9c3b None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:35.898890 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:35.929110 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eaa408-2f32-422d-b34f-230d726413b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:35.929786 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eaa408-2f32-422d-b34f-230d726413b8 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:35.930072 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eaa408-2f32-422d-b34f-230d726413b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:35.930358 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eaa408-2f32-422d-b34f-230d726413b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:35.931528 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eaa408-2f32-422d-b34f-230d726413b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:35.933008 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eaa408-2f32-422d-b34f-230d726413b8 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:35.934664 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 27/55] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:35.940090 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eaa408-2f32-422d-b34f-230d726413b8 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:35.949110 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:35.998516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0024c43b-b9ef-4151-8e0f-0571089d9c3b None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:36.031364 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce903ec8-39a0-4b3f-95aa-6c785864fdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:36.031981 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce903ec8-39a0-4b3f-95aa-6c785864fdfc None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:36.032263 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce903ec8-39a0-4b3f-95aa-6c785864fdfc None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:36.032537 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce903ec8-39a0-4b3f-95aa-6c785864fdfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:36.033269 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce903ec8-39a0-4b3f-95aa-6c785864fdfc None admin] RBAC: Adding query filter params (role.id=74ce7b72bcc94a8a8ad65c3db928e6ac, scope.domain.id=default, user.id=e55eed92c6aa44dcbffd3cac5e4faad7) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:36.033610 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce903ec8-39a0-4b3f-95aa-6c785864fdfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:36.035073 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce903ec8-39a0-4b3f-95aa-6c785864fdfc None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:36.038484 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eaa408-2f32-422d-b34f-230d726413b8 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:36.042911 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 29/56] 10.222.0.49 () {56 vars in 1322 bytes} [Wed Aug 24 04:35:35 2022] GET /identity/v3/role_assignments?user.id=e55eed92c6aa44dcbffd3cac5e4faad7&scope.domain.id=default&role.id=74ce7b72bcc94a8a8ad65c3db928e6ac => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:35:36.076707 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38768a3d-054f-49cf-92ba-0aae33e94bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:36.077379 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38768a3d-054f-49cf-92ba-0aae33e94bda None admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:36.077671 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38768a3d-054f-49cf-92ba-0aae33e94bda None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:36.077948 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38768a3d-054f-49cf-92ba-0aae33e94bda None admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:36.078616 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38768a3d-054f-49cf-92ba-0aae33e94bda None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:36.080108 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38768a3d-054f-49cf-92ba-0aae33e94bda None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:36.111272 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 28/57] 10.222.0.49 () {60 vars in 1140 bytes} [Wed Aug 24 04:35:35 2022] POST /identity/v3/projects => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:35:38.007728 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2279c44-1237-4a60-81e8-a548baedac8c None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:38.008546 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2279c44-1237-4a60-81e8-a548baedac8c None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:38.008683 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2279c44-1237-4a60-81e8-a548baedac8c None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:38.010826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 30/58] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:35:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:38.017272 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224b753-0053-41e8-9fc1-edfbb8dcabfc None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:38.018056 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224b753-0053-41e8-9fc1-edfbb8dcabfc None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:38.018186 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a224b753-0053-41e8-9fc1-edfbb8dcabfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:38.039714 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-a224b753-0053-41e8-9fc1-edfbb8dcabfc None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:38.041080 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-a224b753-0053-41e8-9fc1-edfbb8dcabfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:38.101591 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:38.119213 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 29/59] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:38.388545 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2279c44-1237-4a60-81e8-a548baedac8c None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:38.459316 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:38.496944 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2279c44-1237-4a60-81e8-a548baedac8c None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:38.532916 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011110d0-4053-421b-b058-2b4ce76bfe62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:38.533603 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011110d0-4053-421b-b058-2b4ce76bfe62 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:38.533883 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011110d0-4053-421b-b058-2b4ce76bfe62 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:38.534151 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011110d0-4053-421b-b058-2b4ce76bfe62 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:38.535267 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011110d0-4053-421b-b058-2b4ce76bfe62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:38.537108 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011110d0-4053-421b-b058-2b4ce76bfe62 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:38.538768 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 31/60] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:38.544734 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224b753-0053-41e8-9fc1-edfbb8dcabfc None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:38.656610 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a224b753-0053-41e8-9fc1-edfbb8dcabfc None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:38.693790 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c47957-4dba-4917-9c09-12d365520f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:38.694447 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c47957-4dba-4917-9c09-12d365520f8b None admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:38.694732 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c47957-4dba-4917-9c09-12d365520f8b None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:38.695013 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c47957-4dba-4917-9c09-12d365520f8b None admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:38.695689 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c47957-4dba-4917-9c09-12d365520f8b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:38.697276 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c47957-4dba-4917-9c09-12d365520f8b None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:38.726323 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 30/61] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 24 04:35:38 2022] POST /identity/v3/users => generated 275 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:35:41.860246 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e069f-c007-4b18-af7b-24544d5c01f0 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:41.860764 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e069f-c007-4b18-af7b-24544d5c01f0 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:41.860837 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e069f-c007-4b18-af7b-24544d5c01f0 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:41.862341 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 32/62] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:41.875284 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b5725-8296-4fc6-9d5d-1d17838bf963 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:41.875728 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b5725-8296-4fc6-9d5d-1d17838bf963 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:41.876046 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b5725-8296-4fc6-9d5d-1d17838bf963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:41.906655 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-749b5725-8296-4fc6-9d5d-1d17838bf963 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:41.908125 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-749b5725-8296-4fc6-9d5d-1d17838bf963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:41.948330 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fa0eb-0392-41a3-add1-3ddc3ee23cfc None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:41.948629 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fa0eb-0392-41a3-add1-3ddc3ee23cfc None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:41.948877 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fa0eb-0392-41a3-add1-3ddc3ee23cfc None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:41.950250 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 33/63] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:35:41.959256 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:41.964124 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fd5b7-48a1-4a71-b5fb-f60a5804e1f4 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:41.964412 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fd5b7-48a1-4a71-b5fb-f60a5804e1f4 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:41.964803 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09fd5b7-48a1-4a71-b5fb-f60a5804e1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:41.988132 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-e09fd5b7-48a1-4a71-b5fb-f60a5804e1f4 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:41.989328 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-e09fd5b7-48a1-4a71-b5fb-f60a5804e1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:42.018494 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 31/64] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:42.100516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 34/65] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:35:42.125195 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420045ed-d4e6-4c57-9574-8bd7eb6ac2cd None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:42.125485 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420045ed-d4e6-4c57-9574-8bd7eb6ac2cd None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:42.125698 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420045ed-d4e6-4c57-9574-8bd7eb6ac2cd None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:42.127247 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 32/66] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:42.132553 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbe014-2ccd-4638-b3f7-ee4143fd2d63 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:42.132838 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbe014-2ccd-4638-b3f7-ee4143fd2d63 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:42.133115 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbe014-2ccd-4638-b3f7-ee4143fd2d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:42.153559 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af087f05-b81d-4df6-9626-7b8e66b11b18 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:42.153559 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af087f05-b81d-4df6-9626-7b8e66b11b18 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:42.153559 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af087f05-b81d-4df6-9626-7b8e66b11b18 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:42.153559 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 33/67] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:35:42.159766 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23553657-fede-473b-ac3b-336088916f41 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:42.160052 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23553657-fede-473b-ac3b-336088916f41 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:42.160330 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23553657-fede-473b-ac3b-336088916f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:42.176137 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-1ecbe014-2ccd-4638-b3f7-ee4143fd2d63 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:42.177367 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-1ecbe014-2ccd-4638-b3f7-ee4143fd2d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:42.183621 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-23553657-fede-473b-ac3b-336088916f41 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:42.184812 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-23553657-fede-473b-ac3b-336088916f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:42.288243 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:42.298160 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 35/68] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:42.299035 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecbe014-2ccd-4638-b3f7-ee4143fd2d63 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:42.299652 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 34/69] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:42.404172 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecbe014-2ccd-4638-b3f7-ee4143fd2d63 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:42.407768 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23553657-fede-473b-ac3b-336088916f41 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:42.448448 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36736a2a-9f51-4663-a38f-f932fa3e2952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:42.449094 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36736a2a-9f51-4663-a38f-f932fa3e2952 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:42.449399 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36736a2a-9f51-4663-a38f-f932fa3e2952 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:42.449677 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36736a2a-9f51-4663-a38f-f932fa3e2952 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:42.466630 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36736a2a-9f51-4663-a38f-f932fa3e2952 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:42.471515 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-36736a2a-9f51-4663-a38f-f932fa3e2952 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:35:42.471515 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:42.471515 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:42.471515 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:42.471515 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:42.471515 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:42.471515 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:42.471515 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:42.471515 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:42.471515 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:42.471515 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:42.471515 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:42.471515 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:42.471515 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:42.471515 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:42.471515 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:42.472363 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:42.472363 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:42.472363 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:42.472363 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:42.472363 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:42.472363 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:42.472363 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:42.472363 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:42.472363 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:42.472363 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:42.472363 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:42.472363 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:42.472363 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:42.472363 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:42.472363 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:42.472363 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:42.473107 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:42.473107 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:42.473107 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:42.473107 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:42.473107 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:42.473107 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:42.473107 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:42.473107 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:42.473107 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:42.473107 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:42.473107 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:35:42.473107 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:35:42.477812 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 36/70] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 24 04:35:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:42.483565 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36736a2a-9f51-4663-a38f-f932fa3e2952 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:42.521978 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23553657-fede-473b-ac3b-336088916f41 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:42.524394 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:42.558644 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda69a2-6ec9-4b43-a208-e88105710690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:42.559292 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda69a2-6ec9-4b43-a208-e88105710690 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:42.559574 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda69a2-6ec9-4b43-a208-e88105710690 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:42.559847 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda69a2-6ec9-4b43-a208-e88105710690 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:42.580266 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda69a2-6ec9-4b43-a208-e88105710690 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:42.585051 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-1fda69a2-6ec9-4b43-a208-e88105710690 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:35:42.585051 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:42.585051 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:42.585051 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:42.585051 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:42.585051 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:42.585051 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:42.585051 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:42.585051 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:42.585051 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:42.585051 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:42.585051 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:42.585051 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:42.585051 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:42.585051 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:42.585051 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:42.585966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:42.585966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:42.585966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:42.585966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:42.585966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:42.585966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:42.585966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:42.585966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:42.585966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:42.585966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:42.585966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:42.585966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:42.585966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:42.585966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:42.585966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:42.585966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:42.586695 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:42.586695 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:42.586695 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:42.586695 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:42.586695 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:42.586695 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:42.586695 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:42.586695 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:42.586695 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:42.586695 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:42.586695 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:35:42.586695 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:35:42.590114 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 35/71] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:35:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:42.590927 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda69a2-6ec9-4b43-a208-e88105710690 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:42.602758 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:42.654459 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36736a2a-9f51-4663-a38f-f932fa3e2952 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:42.688817 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f62bda-aae2-4658-9e8c-558061292204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:42.689457 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f62bda-aae2-4658-9e8c-558061292204 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:42.689735 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f62bda-aae2-4658-9e8c-558061292204 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:42.690004 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f62bda-aae2-4658-9e8c-558061292204 None admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:42.690686 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f62bda-aae2-4658-9e8c-558061292204 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:42.690987 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f62bda-aae2-4658-9e8c-558061292204 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:42.692540 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f62bda-aae2-4658-9e8c-558061292204 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:42.701133 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 37/72] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:35:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:35:42.701985 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f62bda-aae2-4658-9e8c-558061292204 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:42.722496 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda69a2-6ec9-4b43-a208-e88105710690 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:42.759265 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448fc2b-5011-4999-b522-d9a92293c708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:42.759911 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448fc2b-5011-4999-b522-d9a92293c708 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:42.760200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448fc2b-5011-4999-b522-d9a92293c708 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:42.760478 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448fc2b-5011-4999-b522-d9a92293c708 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:42.772368 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448fc2b-5011-4999-b522-d9a92293c708 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:42.777268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-8448fc2b-5011-4999-b522-d9a92293c708 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:35:42.777268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:42.777268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:42.777268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:42.777268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:42.777268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:42.777268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:42.777268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:42.777268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:42.777268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:42.777268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:42.777268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:42.777268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:42.777268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:42.777268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:42.777268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:42.778426 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:42.778426 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:42.778426 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:42.778426 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:42.778426 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:42.778426 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:42.778426 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:42.778426 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:42.778426 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:42.778426 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:42.778426 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:42.778426 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:42.778426 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:42.778426 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:42.778426 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:42.778426 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:42.779806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:42.779806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:42.779806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:42.779806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:42.779806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:42.779806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:42.779806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:42.779806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:42.779806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:42.779806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:42.779806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:35:42.779806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:35:42.779806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 36/73] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:35:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:42.779806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448fc2b-5011-4999-b522-d9a92293c708 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:42.809254 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:42.819557 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f62bda-aae2-4658-9e8c-558061292204 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:42.836935 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:42.858486 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d0e99-9ad9-4c00-a49b-e8f8b5e08056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:42.859101 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d0e99-9ad9-4c00-a49b-e8f8b5e08056 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:42.859357 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d0e99-9ad9-4c00-a49b-e8f8b5e08056 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:42.859625 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d0e99-9ad9-4c00-a49b-e8f8b5e08056 None admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:42.860337 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d0e99-9ad9-4c00-a49b-e8f8b5e08056 None admin] RBAC: Adding query filter params (name=member) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:42.860890 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d0e99-9ad9-4c00-a49b-e8f8b5e08056 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:42.862179 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d0e99-9ad9-4c00-a49b-e8f8b5e08056 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:42.871669 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 38/74] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 24 04:35:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:42.872582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d0e99-9ad9-4c00-a49b-e8f8b5e08056 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:42.897214 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448fc2b-5011-4999-b522-d9a92293c708 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:42.946935 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c11cc-5b09-4d44-b462-47cd73339a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:42.947666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c11cc-5b09-4d44-b462-47cd73339a38 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:42.947850 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c11cc-5b09-4d44-b462-47cd73339a38 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:42.948206 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c11cc-5b09-4d44-b462-47cd73339a38 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:42.959539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c11cc-5b09-4d44-b462-47cd73339a38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:42.964706 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-4b6c11cc-5b09-4d44-b462-47cd73339a38 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:35:42.964706 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:42.964706 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:42.964706 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:42.964706 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:42.964706 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:42.964706 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:42.964706 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:42.964706 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:42.964706 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:42.964706 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:42.964706 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:42.964706 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:42.964706 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:42.964706 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:42.964706 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:42.965570 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:42.965570 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:42.965570 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:42.965570 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:42.965570 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:42.965570 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:42.965570 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:42.965570 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:42.965570 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:42.965570 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:42.965570 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:42.965570 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:42.965570 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:42.965570 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:42.965570 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:42.965570 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:42.966517 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:42.966517 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:42.966517 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:42.966517 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:42.966517 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:42.966517 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:42.966517 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:42.966517 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:42.966517 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:42.966517 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:42.966517 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:35:42.966517 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:35:42.966517 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 37/75] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 24 04:35:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:42.967670 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cade4cc-e1ec-4b93-9952-915b309e51a7 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:42.967670 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cade4cc-e1ec-4b93-9952-915b309e51a7 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:42.967670 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cade4cc-e1ec-4b93-9952-915b309e51a7 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:42.969005 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 38/76] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:35:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:42.973386 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cade4cc-e1ec-4b93-9952-915b309e51a7 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:42.986048 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d0e99-9ad9-4c00-a49b-e8f8b5e08056 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:43.020558 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa1808-59a3-4c8f-bd3d-3d3dd796945c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:43.021208 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa1808-59a3-4c8f-bd3d-3d3dd796945c None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:43.021503 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa1808-59a3-4c8f-bd3d-3d3dd796945c None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:43.021773 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa1808-59a3-4c8f-bd3d-3d3dd796945c None admin] PATH_INFO: `/v3/users/e55eed92c6aa44dcbffd3cac5e4faad7` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:43.022932 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa1808-59a3-4c8f-bd3d-3d3dd796945c None admin] RBAC: Authorizing `identity:get_user(user_id=e55eed92c6aa44dcbffd3cac5e4faad7)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:43.024397 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa1808-59a3-4c8f-bd3d-3d3dd796945c None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:43.026204 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 39/77] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:35:42 2022] GET /identity/v3/users/e55eed92c6aa44dcbffd3cac5e4faad7 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:43.026795 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa1808-59a3-4c8f-bd3d-3d3dd796945c None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:43.069041 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:43.081934 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:43.088161 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cade4cc-e1ec-4b93-9952-915b309e51a7 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:43.124533 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00f57a-46d8-453e-9e26-5d1ae1092a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:43.125155 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00f57a-46d8-453e-9e26-5d1ae1092a62 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:43.125468 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00f57a-46d8-453e-9e26-5d1ae1092a62 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:43.125750 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00f57a-46d8-453e-9e26-5d1ae1092a62 None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:43.126423 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00f57a-46d8-453e-9e26-5d1ae1092a62 None admin] RBAC: Adding query filter params (name=member) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:43.126729 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00f57a-46d8-453e-9e26-5d1ae1092a62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:43.128154 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00f57a-46d8-453e-9e26-5d1ae1092a62 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:43.139594 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 39/78] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 24 04:35:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:43.139735 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa1808-59a3-4c8f-bd3d-3d3dd796945c None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:43.140217 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00f57a-46d8-453e-9e26-5d1ae1092a62 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:43.172996 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abf7be-5b48-448d-ad95-7c453a548312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:43.173672 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abf7be-5b48-448d-ad95-7c453a548312 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:43.173952 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abf7be-5b48-448d-ad95-7c453a548312 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:43.174228 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abf7be-5b48-448d-ad95-7c453a548312 None admin] PATH_INFO: `/v3/users/8cd784bb521f420da48da77b1d52602f` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:43.189245 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abf7be-5b48-448d-ad95-7c453a548312 None admin] RBAC: Authorizing `identity:get_user(user_id=8cd784bb521f420da48da77b1d52602f)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:43.190741 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abf7be-5b48-448d-ad95-7c453a548312 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:43.192423 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 40/79] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:35:43 2022] GET /identity/v3/users/8cd784bb521f420da48da77b1d52602f => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:43.193756 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d7c43-bfe6-4135-a9e5-935f41dd1b26 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:43.194043 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d7c43-bfe6-4135-a9e5-935f41dd1b26 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:43.194319 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d7c43-bfe6-4135-a9e5-935f41dd1b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:43.211748 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-878d7c43-bfe6-4135-a9e5-935f41dd1b26 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:43.212918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-878d7c43-bfe6-4135-a9e5-935f41dd1b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:43.242982 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00f57a-46d8-453e-9e26-5d1ae1092a62 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:43.278497 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3dfdf-b94c-48bd-a322-7aaee9bfa334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:43.279006 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 41/80] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:43.279130 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3dfdf-b94c-48bd-a322-7aaee9bfa334 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:43.279360 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3dfdf-b94c-48bd-a322-7aaee9bfa334 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:43.279632 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d3dfdf-b94c-48bd-a322-7aaee9bfa334 None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:43.279858 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d7c43-bfe6-4135-a9e5-935f41dd1b26 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:43.280294 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3dfdf-b94c-48bd-a322-7aaee9bfa334 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:43.280597 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3dfdf-b94c-48bd-a322-7aaee9bfa334 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:43.282014 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d3dfdf-b94c-48bd-a322-7aaee9bfa334 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:43.300986 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 40/81] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:35:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:43.301727 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3dfdf-b94c-48bd-a322-7aaee9bfa334 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:43.316501 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:43.320875 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:43.386934 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d7c43-bfe6-4135-a9e5-935f41dd1b26 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:43.417123 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d3dfdf-b94c-48bd-a322-7aaee9bfa334 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:43.421454 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea4942-98a5-4846-b8af-4c34fb2110f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:43.422077 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea4942-98a5-4846-b8af-4c34fb2110f8 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:43.422357 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea4942-98a5-4846-b8af-4c34fb2110f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:43.422629 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea4942-98a5-4846-b8af-4c34fb2110f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:43.452977 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03c508-3472-4dcf-8c0b-954d11cfea80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:43.453642 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03c508-3472-4dcf-8c0b-954d11cfea80 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:43.453923 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03c508-3472-4dcf-8c0b-954d11cfea80 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:43.454196 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03c508-3472-4dcf-8c0b-954d11cfea80 None admin] PATH_INFO: `/v3/users/8cd784bb521f420da48da77b1d52602f` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:43.456122 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc03c508-3472-4dcf-8c0b-954d11cfea80 None admin] RBAC: Authorizing `identity:get_user(user_id=8cd784bb521f420da48da77b1d52602f)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:43.458047 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc03c508-3472-4dcf-8c0b-954d11cfea80 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:43.460136 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 41/82] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:35:43 2022] GET /identity/v3/users/8cd784bb521f420da48da77b1d52602f => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:43.465516 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03c508-3472-4dcf-8c0b-954d11cfea80 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:43.493226 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea4942-98a5-4846-b8af-4c34fb2110f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:43.494767 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea4942-98a5-4846-b8af-4c34fb2110f8 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:43.527865 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:43.542287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:43.566288 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03c508-3472-4dcf-8c0b-954d11cfea80 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:43.600190 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 42/83] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:35:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:43.601033 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea4942-98a5-4846-b8af-4c34fb2110f8 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:43.601985 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac667972-63db-40b2-a9ce-23e59ac410c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:43.602609 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac667972-63db-40b2-a9ce-23e59ac410c9 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:43.602886 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac667972-63db-40b2-a9ce-23e59ac410c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:43.603292 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac667972-63db-40b2-a9ce-23e59ac410c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:43.674119 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac667972-63db-40b2-a9ce-23e59ac410c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:43.675631 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac667972-63db-40b2-a9ce-23e59ac410c9 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:43.694514 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea4942-98a5-4846-b8af-4c34fb2110f8 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:43.729887 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb51ed1-aa10-4f55-83c4-b137c8731fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:43.730476 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb51ed1-aa10-4f55-83c4-b137c8731fe6 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:43.730757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb51ed1-aa10-4f55-83c4-b137c8731fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:43.731026 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb51ed1-aa10-4f55-83c4-b137c8731fe6 None admin] PATH_INFO: `/v3/users/8cd784bb521f420da48da77b1d52602f` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:43.732176 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb51ed1-aa10-4f55-83c4-b137c8731fe6 None admin] RBAC: Authorizing `identity:get_user(user_id=8cd784bb521f420da48da77b1d52602f)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:43.733646 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb51ed1-aa10-4f55-83c4-b137c8731fe6 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:43.735231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 43/84] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:35:43 2022] GET /identity/v3/users/8cd784bb521f420da48da77b1d52602f => generated 275 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:43.736104 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb51ed1-aa10-4f55-83c4-b137c8731fe6 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:43.738613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:43.752375 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:43.776797 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 42/85] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:35:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:43.777701 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac667972-63db-40b2-a9ce-23e59ac410c9 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:43.842933 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb51ed1-aa10-4f55-83c4-b137c8731fe6 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:43.881748 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8408461-87a2-4964-a373-648c90706561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:43.882391 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8408461-87a2-4964-a373-648c90706561 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:43.882639 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8408461-87a2-4964-a373-648c90706561 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:43.882910 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8408461-87a2-4964-a373-648c90706561 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:43.893519 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac667972-63db-40b2-a9ce-23e59ac410c9 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:43.932596 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a49048-ee6b-4612-a3b6-aa639a733629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:43.933268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a49048-ee6b-4612-a3b6-aa639a733629 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:43.933696 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a49048-ee6b-4612-a3b6-aa639a733629 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:43.933960 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a49048-ee6b-4612-a3b6-aa639a733629 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:43.935094 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a49048-ee6b-4612-a3b6-aa639a733629 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:43.936577 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a49048-ee6b-4612-a3b6-aa639a733629 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:43.941383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 43/86] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:43.941383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a49048-ee6b-4612-a3b6-aa639a733629 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:43.957492 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8408461-87a2-4964-a373-648c90706561 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:43.958960 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8408461-87a2-4964-a373-648c90706561 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:43.960872 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:43.988692 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:44.051915 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a49048-ee6b-4612-a3b6-aa639a733629 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:44.065103 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 44/87] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:35:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:44.065939 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8408461-87a2-4964-a373-648c90706561 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:44.090928 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770a8ff-b43e-45f2-9d30-c49671792f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:44.091584 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770a8ff-b43e-45f2-9d30-c49671792f39 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:44.091865 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770a8ff-b43e-45f2-9d30-c49671792f39 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:44.092139 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770a8ff-b43e-45f2-9d30-c49671792f39 None admin] PATH_INFO: `/v3/projects/33beb4c6e7a44d5a823b242c69b5c231` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:44.093309 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770a8ff-b43e-45f2-9d30-c49671792f39 None admin] RBAC: Authorizing `identity:get_project(project_id=33beb4c6e7a44d5a823b242c69b5c231)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:44.094817 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770a8ff-b43e-45f2-9d30-c49671792f39 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:44.096737 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 44/88] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:35:43 2022] GET /identity/v3/projects/33beb4c6e7a44d5a823b242c69b5c231 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:44.097364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770a8ff-b43e-45f2-9d30-c49671792f39 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:44.178407 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8408461-87a2-4964-a373-648c90706561 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:44.180476 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:44.210176 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770a8ff-b43e-45f2-9d30-c49671792f39 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:44.216904 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf91efb-9ffc-4dad-81a4-9e5a32f865e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:44.217769 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf91efb-9ffc-4dad-81a4-9e5a32f865e8 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:44.218053 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf91efb-9ffc-4dad-81a4-9e5a32f865e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:44.218329 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf91efb-9ffc-4dad-81a4-9e5a32f865e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:44.223891 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:44.245651 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e82f9e-8ffb-462e-b492-8453b1d6c0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:44.246238 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e82f9e-8ffb-462e-b492-8453b1d6c0fe None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:44.246526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e82f9e-8ffb-462e-b492-8453b1d6c0fe None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:44.246795 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e82f9e-8ffb-462e-b492-8453b1d6c0fe None admin] PATH_INFO: `/v3/projects/33beb4c6e7a44d5a823b242c69b5c231` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:44.247925 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e82f9e-8ffb-462e-b492-8453b1d6c0fe None admin] RBAC: Authorizing `identity:get_project(project_id=33beb4c6e7a44d5a823b242c69b5c231)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:44.249428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e82f9e-8ffb-462e-b492-8453b1d6c0fe None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:44.251089 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 45/89] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:35:44 2022] GET /identity/v3/projects/33beb4c6e7a44d5a823b242c69b5c231 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:44.251838 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e82f9e-8ffb-462e-b492-8453b1d6c0fe None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:44.293655 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf91efb-9ffc-4dad-81a4-9e5a32f865e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:44.295153 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf91efb-9ffc-4dad-81a4-9e5a32f865e8 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:44.354454 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e82f9e-8ffb-462e-b492-8453b1d6c0fe None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:44.389118 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5330f-180d-4474-8eeb-2de0a7af283a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:44.389753 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5330f-180d-4474-8eeb-2de0a7af283a None admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:44.390034 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5330f-180d-4474-8eeb-2de0a7af283a None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:44.390308 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5330f-180d-4474-8eeb-2de0a7af283a None admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:44.390963 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5330f-180d-4474-8eeb-2de0a7af283a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:44.392440 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5330f-180d-4474-8eeb-2de0a7af283a None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:44.401877 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 45/90] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:35:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:44.406228 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf91efb-9ffc-4dad-81a4-9e5a32f865e8 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:44.409481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:44.414333 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 46/91] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 24 04:35:44 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:35:44.421925 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5330f-180d-4474-8eeb-2de0a7af283a None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:44.466926 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:44.555062 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5330f-180d-4474-8eeb-2de0a7af283a None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:44.556916 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf91efb-9ffc-4dad-81a4-9e5a32f865e8 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:44.601240 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f2467-49c9-4af8-ba7f-5b51066ce19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:44.601919 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f2467-49c9-4af8-ba7f-5b51066ce19b None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:44.602228 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f2467-49c9-4af8-ba7f-5b51066ce19b None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:44.602507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f2467-49c9-4af8-ba7f-5b51066ce19b None admin] PATH_INFO: `/v3/projects/f5452f51521644e8b7e99328787a3cd2` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:44.603706 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f2467-49c9-4af8-ba7f-5b51066ce19b None admin] RBAC: Authorizing `identity:get_project(project_id=f5452f51521644e8b7e99328787a3cd2)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:44.603828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f43cbb-d7c6-48e7-ba2e-5c30cf39ab88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:44.604394 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f43cbb-d7c6-48e7-ba2e-5c30cf39ab88 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:44.604677 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f43cbb-d7c6-48e7-ba2e-5c30cf39ab88 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:44.604952 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f43cbb-d7c6-48e7-ba2e-5c30cf39ab88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:44.605185 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f2467-49c9-4af8-ba7f-5b51066ce19b None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:44.605757 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f43cbb-d7c6-48e7-ba2e-5c30cf39ab88 None admin] RBAC: Adding query filter params (role.id=74ce7b72bcc94a8a8ad65c3db928e6ac, scope.project.id=33beb4c6e7a44d5a823b242c69b5c231, user.id=e55eed92c6aa44dcbffd3cac5e4faad7) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:44.606545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f43cbb-d7c6-48e7-ba2e-5c30cf39ab88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:44.607118 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 46/92] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:35:44 2022] GET /identity/v3/projects/f5452f51521644e8b7e99328787a3cd2 => generated 312 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:44.612075 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f2467-49c9-4af8-ba7f-5b51066ce19b None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:44.612240 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f43cbb-d7c6-48e7-ba2e-5c30cf39ab88 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:44.614572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 47/93] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:35:44 2022] GET /identity/v3/role_assignments?user.id=e55eed92c6aa44dcbffd3cac5e4faad7&scope.project.id=33beb4c6e7a44d5a823b242c69b5c231&role.id=74ce7b72bcc94a8a8ad65c3db928e6ac => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:44.616817 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f43cbb-d7c6-48e7-ba2e-5c30cf39ab88 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:44.712362 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:44.772122 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:44.772386 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f2467-49c9-4af8-ba7f-5b51066ce19b None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:44.776011 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f43cbb-d7c6-48e7-ba2e-5c30cf39ab88 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:44.817764 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222919a8-66cb-4f87-bc96-0773fbce2f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:44.817764 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222919a8-66cb-4f87-bc96-0773fbce2f02 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:44.817764 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222919a8-66cb-4f87-bc96-0773fbce2f02 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:44.818141 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222919a8-66cb-4f87-bc96-0773fbce2f02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:44.818589 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222919a8-66cb-4f87-bc96-0773fbce2f02 None admin] RBAC: Adding query filter params (role.id=e2eda359ee274ff1914db224f7f9b383, scope.project.id=33beb4c6e7a44d5a823b242c69b5c231, user.id=8cd784bb521f420da48da77b1d52602f) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:44.818904 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222919a8-66cb-4f87-bc96-0773fbce2f02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:44.820363 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222919a8-66cb-4f87-bc96-0773fbce2f02 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:44.828026 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 47/94] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:35:44 2022] GET /identity/v3/role_assignments?user.id=8cd784bb521f420da48da77b1d52602f&scope.project.id=33beb4c6e7a44d5a823b242c69b5c231&role.id=e2eda359ee274ff1914db224f7f9b383 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:44.828867 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222919a8-66cb-4f87-bc96-0773fbce2f02 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:44.831855 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687ca57-2e17-4af4-a6ea-67ebe0e4f379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:44.832896 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687ca57-2e17-4af4-a6ea-67ebe0e4f379 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:44.833326 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687ca57-2e17-4af4-a6ea-67ebe0e4f379 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:44.833798 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687ca57-2e17-4af4-a6ea-67ebe0e4f379 None admin] PATH_INFO: `/v3/projects/33beb4c6e7a44d5a823b242c69b5c231` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:44.835404 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f687ca57-2e17-4af4-a6ea-67ebe0e4f379 None admin] RBAC: Authorizing `identity:get_project(project_id=33beb4c6e7a44d5a823b242c69b5c231)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:44.837137 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f687ca57-2e17-4af4-a6ea-67ebe0e4f379 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:44.839183 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 48/95] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:35:44 2022] GET /identity/v3/projects/33beb4c6e7a44d5a823b242c69b5c231 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:44.845949 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687ca57-2e17-4af4-a6ea-67ebe0e4f379 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:44.959606 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222919a8-66cb-4f87-bc96-0773fbce2f02 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:44.975620 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687ca57-2e17-4af4-a6ea-67ebe0e4f379 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:45.008565 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa606385-3c6f-420c-9ed3-447267d30b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:45.009365 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa606385-3c6f-420c-9ed3-447267d30b89 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:45.009659 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa606385-3c6f-420c-9ed3-447267d30b89 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:45.009933 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa606385-3c6f-420c-9ed3-447267d30b89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:45.011051 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa606385-3c6f-420c-9ed3-447267d30b89 None admin] RBAC: Adding query filter params (role.id=e2eda359ee274ff1914db224f7f9b383, scope.project.id=f5452f51521644e8b7e99328787a3cd2, user.id=8cd784bb521f420da48da77b1d52602f) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:45.011489 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa606385-3c6f-420c-9ed3-447267d30b89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:45.013267 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa606385-3c6f-420c-9ed3-447267d30b89 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:45.016265 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:45.022065 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 48/96] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:35:44 2022] GET /identity/v3/role_assignments?user.id=8cd784bb521f420da48da77b1d52602f&scope.project.id=f5452f51521644e8b7e99328787a3cd2&role.id=e2eda359ee274ff1914db224f7f9b383 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:45.034367 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38e992-23e2-4b34-8d22-549bc41125f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:45.035031 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38e992-23e2-4b34-8d22-549bc41125f7 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:45.035317 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38e992-23e2-4b34-8d22-549bc41125f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:45.035595 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38e992-23e2-4b34-8d22-549bc41125f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:45.036371 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb38e992-23e2-4b34-8d22-549bc41125f7 None admin] RBAC: Adding query filter params (role.id=3c2269f848184abd93ef97d02f6553e4, scope.project.id=33beb4c6e7a44d5a823b242c69b5c231, user.id=8cd784bb521f420da48da77b1d52602f) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:45.036687 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb38e992-23e2-4b34-8d22-549bc41125f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:45.038272 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb38e992-23e2-4b34-8d22-549bc41125f7 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:45.045256 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 49/97] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:35:44 2022] GET /identity/v3/role_assignments?user.id=8cd784bb521f420da48da77b1d52602f&scope.project.id=33beb4c6e7a44d5a823b242c69b5c231&role.id=3c2269f848184abd93ef97d02f6553e4 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:47.275352 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae8475-627f-4c8e-9a4a-92bb816881e2 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:47.275860 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae8475-627f-4c8e-9a4a-92bb816881e2 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:47.275931 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae8475-627f-4c8e-9a4a-92bb816881e2 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:47.277257 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 49/98] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:47.282798 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a47b8-57aa-41b1-a31c-936cdecfe26b None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:47.283528 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a47b8-57aa-41b1-a31c-936cdecfe26b None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:47.283947 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a47b8-57aa-41b1-a31c-936cdecfe26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:47.286676 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46ec19-25b2-49f2-89c3-cb9feb4845e7 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:47.287107 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46ec19-25b2-49f2-89c3-cb9feb4845e7 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:47.287537 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46ec19-25b2-49f2-89c3-cb9feb4845e7 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:47.288929 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 50/99] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:35:47.297852 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf76e9c-a6e3-458e-a087-1f53cbad56f2 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:47.298311 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf76e9c-a6e3-458e-a087-1f53cbad56f2 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:47.298724 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf76e9c-a6e3-458e-a087-1f53cbad56f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:47.333094 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-fcf76e9c-a6e3-458e-a087-1f53cbad56f2 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:47.337369 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-f32a47b8-57aa-41b1-a31c-936cdecfe26b None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:47.337369 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-f32a47b8-57aa-41b1-a31c-936cdecfe26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:47.338869 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-fcf76e9c-a6e3-458e-a087-1f53cbad56f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:47.388501 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:47.448325 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 51/100] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:35:47.478482 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 50/101] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:47.558615 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30177e3f-125f-4409-8588-40698c0f8457 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:47.558918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30177e3f-125f-4409-8588-40698c0f8457 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:47.559171 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30177e3f-125f-4409-8588-40698c0f8457 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:47.560615 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 52/102] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:47.566099 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f33424-ee18-4e09-bd95-d6fbf8d67423 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:47.566397 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f33424-ee18-4e09-bd95-d6fbf8d67423 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:47.566677 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f33424-ee18-4e09-bd95-d6fbf8d67423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:47.593707 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-f0f33424-ee18-4e09-bd95-d6fbf8d67423 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:47.594907 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-f0f33424-ee18-4e09-bd95-d6fbf8d67423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:47.682283 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 51/103] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:35:47.752771 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01734d2d-e666-4c1d-b80d-f56ccffff72a None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:47.753047 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01734d2d-e666-4c1d-b80d-f56ccffff72a None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:47.753298 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01734d2d-e666-4c1d-b80d-f56ccffff72a None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:47.754982 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 53/104] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:47.762417 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cf0a0-4d0c-4fe3-8b69-d88711050976 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:47.762734 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cf0a0-4d0c-4fe3-8b69-d88711050976 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:47.763017 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cf0a0-4d0c-4fe3-8b69-d88711050976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:47.783943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-653cf0a0-4d0c-4fe3-8b69-d88711050976 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:47.785216 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-653cf0a0-4d0c-4fe3-8b69-d88711050976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:47.864189 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 52/105] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:47.876499 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01734d2d-e666-4c1d-b80d-f56ccffff72a None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:47.961397 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cf0a0-4d0c-4fe3-8b69-d88711050976 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:48.020268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:48.066524 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01734d2d-e666-4c1d-b80d-f56ccffff72a None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:48.101262 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:48.112038 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc9c88-f523-423a-87c5-78c30151f4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:48.112682 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc9c88-f523-423a-87c5-78c30151f4ad None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:48.112965 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc9c88-f523-423a-87c5-78c30151f4ad None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:48.113244 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc9c88-f523-423a-87c5-78c30151f4ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:48.114947 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc9c88-f523-423a-87c5-78c30151f4ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:48.116890 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc9c88-f523-423a-87c5-78c30151f4ad None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:48.119762 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 54/106] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:48.121018 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ebf20-83fd-4f7f-8372-68ecfa03e357 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:48.121351 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ebf20-83fd-4f7f-8372-68ecfa03e357 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:48.122095 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ebf20-83fd-4f7f-8372-68ecfa03e357 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:48.123668 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 55/107] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:35:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:48.124648 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ebf20-83fd-4f7f-8372-68ecfa03e357 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:48.148512 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cf0a0-4d0c-4fe3-8b69-d88711050976 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:48.196666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904d77f-df8e-471e-9562-c89b7f241465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:48.197719 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904d77f-df8e-471e-9562-c89b7f241465 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:48.198074 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904d77f-df8e-471e-9562-c89b7f241465 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:48.198408 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904d77f-df8e-471e-9562-c89b7f241465 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:48.211835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0904d77f-df8e-471e-9562-c89b7f241465 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:48.216572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-0904d77f-df8e-471e-9562-c89b7f241465 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:35:48.216572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:48.216572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:48.216572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:48.216572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:48.216572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:48.216572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:48.216572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:48.216572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:48.216572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:48.216572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:48.216572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:48.216572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:48.216572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:48.216572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:48.216572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:48.217625 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:48.217625 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:48.217625 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:48.217625 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:48.217625 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:48.217625 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:48.217625 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:48.217625 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:48.217625 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:48.217625 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:48.217625 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:48.217625 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:48.217625 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:48.217625 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:48.217625 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:48.217625 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:48.218539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:48.218539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:48.218539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:48.218539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:48.218539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:48.218539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:48.218539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:48.218539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:48.218539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:48.218539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:48.218539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:35:48.218539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:35:48.218539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 53/108] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:35:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:35:48.218539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904d77f-df8e-471e-9562-c89b7f241465 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:48.252419 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ebf20-83fd-4f7f-8372-68ecfa03e357 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:48.290729 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7bf2a-e212-4b01-b484-650fb163cc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:48.292037 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7bf2a-e212-4b01-b484-650fb163cc19 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:48.292467 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7bf2a-e212-4b01-b484-650fb163cc19 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:48.292735 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7bf2a-e212-4b01-b484-650fb163cc19 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:48.304042 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde7bf2a-e212-4b01-b484-650fb163cc19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:48.308050 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-bde7bf2a-e212-4b01-b484-650fb163cc19 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:35:48.308050 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:48.308050 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:48.308050 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:48.308050 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:48.308050 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:48.308050 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:48.308050 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:48.308050 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:48.308050 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:48.308050 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:48.308050 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:48.308050 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:48.308050 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:48.308050 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:48.308050 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:48.308918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:48.308918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:48.308918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:48.308918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:48.308918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:48.308918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:48.308918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:48.308918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:48.308918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:48.308918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:48.308918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:48.308918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:48.308918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:48.308918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:48.308918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:48.308918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:48.309694 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:48.309694 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:48.309694 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:48.309694 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:48.309694 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:48.309694 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:48.309694 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:48.309694 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:48.309694 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:48.309694 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:48.309694 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:35:48.309694 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:35:48.309694 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 56/109] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:35:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:48.315679 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632aff72-092a-41f5-8e59-1ee584fa7723 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:48.315984 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632aff72-092a-41f5-8e59-1ee584fa7723 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:48.316231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632aff72-092a-41f5-8e59-1ee584fa7723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:48.320097 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:48.333959 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-632aff72-092a-41f5-8e59-1ee584fa7723 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:48.335160 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-632aff72-092a-41f5-8e59-1ee584fa7723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:48.339415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904d77f-df8e-471e-9562-c89b7f241465 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:48.374774 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e54d8-4650-4906-8427-7db811a8b4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:48.375389 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e54d8-4650-4906-8427-7db811a8b4d0 None admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:48.375670 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e54d8-4650-4906-8427-7db811a8b4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:48.375944 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e54d8-4650-4906-8427-7db811a8b4d0 None admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:48.376597 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e54d8-4650-4906-8427-7db811a8b4d0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:48.378119 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e54d8-4650-4906-8427-7db811a8b4d0 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:48.383895 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:48.401314 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 57/110] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:48.402195 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632aff72-092a-41f5-8e59-1ee584fa7723 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:48.413961 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 54/111] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 24 04:35:48 2022] POST /identity/v3/projects => generated 302 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:35:48.413961 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e54d8-4650-4906-8427-7db811a8b4d0 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:48.529279 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632aff72-092a-41f5-8e59-1ee584fa7723 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:48.560680 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e54d8-4650-4906-8427-7db811a8b4d0 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:48.567953 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb635b0-a151-4f8a-8491-ac2a824812d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:48.568595 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb635b0-a151-4f8a-8491-ac2a824812d2 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:48.568874 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb635b0-a151-4f8a-8491-ac2a824812d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:48.569153 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb635b0-a151-4f8a-8491-ac2a824812d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:48.581920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb635b0-a151-4f8a-8491-ac2a824812d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:48.586854 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-5eb635b0-a151-4f8a-8491-ac2a824812d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:35:48.586854 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:48.586854 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:48.586854 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:48.586854 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:48.586854 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:48.586854 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:48.586854 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:48.586854 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:48.586854 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:48.586854 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:48.586854 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:48.586854 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:48.586854 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:48.586854 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:48.586854 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:48.587703 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:48.587703 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:48.587703 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:48.587703 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:48.587703 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:48.587703 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:48.587703 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:48.587703 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:48.587703 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:48.587703 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:48.587703 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:48.587703 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:48.587703 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:48.587703 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:48.587703 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:48.587703 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:48.588979 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:48.588979 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:48.588979 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:48.588979 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:48.588979 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:48.588979 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:48.588979 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:48.588979 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:48.588979 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:48.588979 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:48.588979 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:35:48.588979 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:35:48.588979 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 58/112] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 24 04:35:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:48.588979 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb635b0-a151-4f8a-8491-ac2a824812d2 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:48.601819 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c45a9-8380-4524-bd7f-e129ff87e7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:48.602439 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c45a9-8380-4524-bd7f-e129ff87e7ed None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:48.602720 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c45a9-8380-4524-bd7f-e129ff87e7ed None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:48.602993 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c45a9-8380-4524-bd7f-e129ff87e7ed None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:48.604234 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c45a9-8380-4524-bd7f-e129ff87e7ed None admin] RBAC: Adding query filter params (name=reader) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:48.604542 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c45a9-8380-4524-bd7f-e129ff87e7ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:48.607347 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c45a9-8380-4524-bd7f-e129ff87e7ed None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:48.609432 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:48.619539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 55/113] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 24 04:35:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:48.620191 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd9f90-2a38-4a11-9778-aec0a21590c9 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:48.620478 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd9f90-2a38-4a11-9778-aec0a21590c9 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:48.620753 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd9f90-2a38-4a11-9778-aec0a21590c9 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:48.625366 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 56/114] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:48.625366 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd9f90-2a38-4a11-9778-aec0a21590c9 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:48.667155 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:48.728166 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb635b0-a151-4f8a-8491-ac2a824812d2 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:48.755685 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd9f90-2a38-4a11-9778-aec0a21590c9 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:48.766554 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65a3c5-1340-49a2-a067-acbb9f38cd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:48.767201 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65a3c5-1340-49a2-a067-acbb9f38cd00 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:48.767539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65a3c5-1340-49a2-a067-acbb9f38cd00 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:48.767872 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65a3c5-1340-49a2-a067-acbb9f38cd00 None admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:48.768592 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65a3c5-1340-49a2-a067-acbb9f38cd00 None admin] RBAC: Adding query filter params (name=member) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:48.768895 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65a3c5-1340-49a2-a067-acbb9f38cd00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:48.770339 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65a3c5-1340-49a2-a067-acbb9f38cd00 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:48.779202 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 59/115] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 24 04:35:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:48.779202 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65a3c5-1340-49a2-a067-acbb9f38cd00 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:48.817549 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341707e-3711-4a75-a2b2-c3e983556aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:48.818109 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341707e-3711-4a75-a2b2-c3e983556aee None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:48.818397 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341707e-3711-4a75-a2b2-c3e983556aee None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:48.818689 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341707e-3711-4a75-a2b2-c3e983556aee None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:48.823487 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9341707e-3711-4a75-a2b2-c3e983556aee None admin] RBAC: Adding query filter params (name=admin) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:48.823857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9341707e-3711-4a75-a2b2-c3e983556aee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:48.825289 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9341707e-3711-4a75-a2b2-c3e983556aee None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:48.835120 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 57/116] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:35:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:48.836390 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd2201-50af-417a-b7b8-f24d209a5dac None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:48.836680 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd2201-50af-417a-b7b8-f24d209a5dac None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:48.836955 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd2201-50af-417a-b7b8-f24d209a5dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:48.859739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-99cd2201-50af-417a-b7b8-f24d209a5dac None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:48.861714 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-99cd2201-50af-417a-b7b8-f24d209a5dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:48.897026 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65a3c5-1340-49a2-a067-acbb9f38cd00 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:48.907466 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:48.927280 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:48.937096 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042c74e-44cd-4885-b93f-c83ae68a56e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:48.937771 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042c74e-44cd-4885-b93f-c83ae68a56e7 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:48.938059 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042c74e-44cd-4885-b93f-c83ae68a56e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:48.938320 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042c74e-44cd-4885-b93f-c83ae68a56e7 None admin] PATH_INFO: `/v3/users/06012746b2a445c6b6b6b8324542ce1d` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:48.942737 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 58/117] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:48.943771 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd2201-50af-417a-b7b8-f24d209a5dac None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:48.963818 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6042c74e-44cd-4885-b93f-c83ae68a56e7 None admin] RBAC: Authorizing `identity:get_user(user_id=06012746b2a445c6b6b6b8324542ce1d)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:48.966537 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6042c74e-44cd-4885-b93f-c83ae68a56e7 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:48.971007 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 60/118] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:35:48 2022] GET /identity/v3/users/06012746b2a445c6b6b6b8324542ce1d => generated 289 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:48.971007 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042c74e-44cd-4885-b93f-c83ae68a56e7 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:49.062038 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd2201-50af-417a-b7b8-f24d209a5dac None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:49.105469 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942b085-d87c-4a16-919d-e5b0025d8d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:49.106577 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042c74e-44cd-4885-b93f-c83ae68a56e7 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:49.106902 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942b085-d87c-4a16-919d-e5b0025d8d49 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:49.107428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942b085-d87c-4a16-919d-e5b0025d8d49 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:49.107898 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942b085-d87c-4a16-919d-e5b0025d8d49 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:49.120910 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2942b085-d87c-4a16-919d-e5b0025d8d49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:49.126752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-2942b085-d87c-4a16-919d-e5b0025d8d49 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:35:49.126752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:49.126752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:49.126752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:49.126752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:49.126752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:49.126752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:49.126752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:49.126752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:49.126752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:49.126752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:49.126752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:49.126752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:49.126752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:49.126752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:49.126752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:49.127692 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:49.127692 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:49.127692 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:49.127692 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:49.127692 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:49.127692 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:49.127692 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:49.127692 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:49.127692 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:49.127692 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:49.127692 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:49.127692 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:49.127692 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:49.127692 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:49.127692 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:49.127692 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:49.128503 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:49.128503 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:49.128503 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:49.128503 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:49.128503 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:49.128503 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:49.128503 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:49.128503 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:49.128503 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:49.128503 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:49.128503 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:35:49.128503 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:35:49.131087 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 59/119] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:35:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:49.132227 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942b085-d87c-4a16-919d-e5b0025d8d49 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:49.148522 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b35dfe-58e4-4732-9454-a88890fe5863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:49.149196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b35dfe-58e4-4732-9454-a88890fe5863 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:49.149548 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b35dfe-58e4-4732-9454-a88890fe5863 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:49.149812 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b35dfe-58e4-4732-9454-a88890fe5863 None admin] PATH_INFO: `/v3/users/8cd784bb521f420da48da77b1d52602f` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:49.151127 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b35dfe-58e4-4732-9454-a88890fe5863 None admin] RBAC: Authorizing `identity:get_user(user_id=8cd784bb521f420da48da77b1d52602f)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:49.153399 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b35dfe-58e4-4732-9454-a88890fe5863 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:49.155795 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 61/120] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:35:48 2022] GET /identity/v3/users/8cd784bb521f420da48da77b1d52602f => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:49.156535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b35dfe-58e4-4732-9454-a88890fe5863 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:49.199326 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:49.214308 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:49.273537 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b35dfe-58e4-4732-9454-a88890fe5863 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:49.275367 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942b085-d87c-4a16-919d-e5b0025d8d49 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:49.308241 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3220e-f5e6-4181-b2ea-21eb5f71dcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:49.308935 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3220e-f5e6-4181-b2ea-21eb5f71dcb4 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:49.309127 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3220e-f5e6-4181-b2ea-21eb5f71dcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:49.309424 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3220e-f5e6-4181-b2ea-21eb5f71dcb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:49.317452 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a2598-26c4-4ed9-9191-b86e5c8f62bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:49.318353 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a2598-26c4-4ed9-9191-b86e5c8f62bf None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:49.318963 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a2598-26c4-4ed9-9191-b86e5c8f62bf None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:49.319456 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a2598-26c4-4ed9-9191-b86e5c8f62bf None admin] PATH_INFO: `/v3/users/e55eed92c6aa44dcbffd3cac5e4faad7` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:49.322054 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a2598-26c4-4ed9-9191-b86e5c8f62bf None admin] RBAC: Authorizing `identity:get_user(user_id=e55eed92c6aa44dcbffd3cac5e4faad7)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:49.323534 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a2598-26c4-4ed9-9191-b86e5c8f62bf None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:49.325169 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 60/121] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:35:49 2022] GET /identity/v3/users/e55eed92c6aa44dcbffd3cac5e4faad7 => generated 247 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:49.326024 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a2598-26c4-4ed9-9191-b86e5c8f62bf None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:49.388092 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3220e-f5e6-4181-b2ea-21eb5f71dcb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:49.389557 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3220e-f5e6-4181-b2ea-21eb5f71dcb4 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:49.424009 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:49.444293 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a2598-26c4-4ed9-9191-b86e5c8f62bf None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:49.463224 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:49.482743 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8da412-c518-4917-912c-da3ad448acc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:49.483412 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8da412-c518-4917-912c-da3ad448acc8 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:49.483748 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8da412-c518-4917-912c-da3ad448acc8 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:49.484027 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8da412-c518-4917-912c-da3ad448acc8 None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:49.484714 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8da412-c518-4917-912c-da3ad448acc8 None admin] RBAC: Adding query filter params (name=member) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:49.485024 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8da412-c518-4917-912c-da3ad448acc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:49.486451 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8da412-c518-4917-912c-da3ad448acc8 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:49.500207 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 61/122] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 24 04:35:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:49.500207 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8da412-c518-4917-912c-da3ad448acc8 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:49.510095 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 62/123] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:35:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:49.510987 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3220e-f5e6-4181-b2ea-21eb5f71dcb4 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:49.621650 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3220e-f5e6-4181-b2ea-21eb5f71dcb4 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:49.629873 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8da412-c518-4917-912c-da3ad448acc8 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:49.656557 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b1923-5899-4e34-8f95-328d32f6fc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:49.657110 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b1923-5899-4e34-8f95-328d32f6fc67 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:49.657417 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b1923-5899-4e34-8f95-328d32f6fc67 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:49.657689 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b1923-5899-4e34-8f95-328d32f6fc67 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:49.659767 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:49.666884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6defc29-e4d8-47e5-a543-4aab2f9dbadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:49.667618 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6defc29-e4d8-47e5-a543-4aab2f9dbadd None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:49.667965 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6defc29-e4d8-47e5-a543-4aab2f9dbadd None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:49.668305 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6defc29-e4d8-47e5-a543-4aab2f9dbadd None admin] PATH_INFO: `/v3/projects/33beb4c6e7a44d5a823b242c69b5c231` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:49.669186 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759b1923-5899-4e34-8f95-328d32f6fc67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:49.669778 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6defc29-e4d8-47e5-a543-4aab2f9dbadd None admin] RBAC: Authorizing `identity:get_project(project_id=33beb4c6e7a44d5a823b242c69b5c231)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:49.671390 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6defc29-e4d8-47e5-a543-4aab2f9dbadd None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:49.678462 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 62/124] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:35:49 2022] GET /identity/v3/projects/33beb4c6e7a44d5a823b242c69b5c231 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:49.678594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-759b1923-5899-4e34-8f95-328d32f6fc67 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:35:49.678594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:49.678594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:49.678594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:49.678594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:49.678594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:49.678594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:49.678594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:49.678594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:49.678594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:49.678594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:49.678594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:49.678594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:49.678594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:49.678594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:49.678594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:49.679406 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:49.679406 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:49.679406 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:49.679406 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:49.679406 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:49.679406 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:49.679406 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:49.679406 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:49.679406 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:49.679406 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:49.679406 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:49.679406 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:49.679406 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:49.679406 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:49.679406 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:49.679406 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:49.680159 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:49.680159 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:49.680159 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:49.680159 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:49.680159 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:49.680159 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:49.680159 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:49.680159 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:49.680159 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:49.680159 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:49.680159 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:35:49.680159 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:35:49.680758 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6defc29-e4d8-47e5-a543-4aab2f9dbadd None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:49.680823 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 63/125] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 24 04:35:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:49.680823 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b1923-5899-4e34-8f95-328d32f6fc67 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:49.730835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:49.787818 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b1923-5899-4e34-8f95-328d32f6fc67 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:49.791960 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6defc29-e4d8-47e5-a543-4aab2f9dbadd None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:49.825147 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75281768-cf91-4bb3-a18f-692d04f876fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:49.825966 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75281768-cf91-4bb3-a18f-692d04f876fe None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:49.826330 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75281768-cf91-4bb3-a18f-692d04f876fe None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:49.826665 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75281768-cf91-4bb3-a18f-692d04f876fe None admin] PATH_INFO: `/v3/users/8cd784bb521f420da48da77b1d52602f` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:49.827828 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75281768-cf91-4bb3-a18f-692d04f876fe None admin] RBAC: Authorizing `identity:get_user(user_id=8cd784bb521f420da48da77b1d52602f)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:49.828120 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b8eff-3e1f-4a28-81bc-f922b80d42dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:49.828760 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b8eff-3e1f-4a28-81bc-f922b80d42dc None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:49.829043 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b8eff-3e1f-4a28-81bc-f922b80d42dc None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:49.829316 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b8eff-3e1f-4a28-81bc-f922b80d42dc None admin] PATH_INFO: `/v3/projects/33beb4c6e7a44d5a823b242c69b5c231` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:49.829608 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75281768-cf91-4bb3-a18f-692d04f876fe None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:49.830465 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b8eff-3e1f-4a28-81bc-f922b80d42dc None admin] RBAC: Authorizing `identity:get_project(project_id=33beb4c6e7a44d5a823b242c69b5c231)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:49.840361 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 64/126] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:35:49 2022] GET /identity/v3/users/8cd784bb521f420da48da77b1d52602f => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:49.840566 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30b8eff-3e1f-4a28-81bc-f922b80d42dc None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:49.840679 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75281768-cf91-4bb3-a18f-692d04f876fe None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:49.840763 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 63/127] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:35:49 2022] GET /identity/v3/projects/33beb4c6e7a44d5a823b242c69b5c231 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:49.840763 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b8eff-3e1f-4a28-81bc-f922b80d42dc None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:49.906201 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:49.945468 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b8eff-3e1f-4a28-81bc-f922b80d42dc None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:49.952907 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75281768-cf91-4bb3-a18f-692d04f876fe None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:49.961540 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:49.985746 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1a150-324b-4fec-bd21-7144780c99e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:49.986652 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1a150-324b-4fec-bd21-7144780c99e6 None admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:49.986932 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1a150-324b-4fec-bd21-7144780c99e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:49.987230 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb1a150-324b-4fec-bd21-7144780c99e6 None admin] PATH_INFO: `/v3/projects/33beb4c6e7a44d5a823b242c69b5c231/users/8cd784bb521f420da48da77b1d52602f/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:49.989526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb1a150-324b-4fec-bd21-7144780c99e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=33beb4c6e7a44d5a823b242c69b5c231, user_id=8cd784bb521f420da48da77b1d52602f, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:49.991109 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb1a150-324b-4fec-bd21-7144780c99e6 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:49.991616 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f89457-b709-4aa1-97f0-5caf01181341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:49.992328 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f89457-b709-4aa1-97f0-5caf01181341 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:49.992679 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f89457-b709-4aa1-97f0-5caf01181341 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:49.993022 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f89457-b709-4aa1-97f0-5caf01181341 None admin] PATH_INFO: `/v3/projects/33beb4c6e7a44d5a823b242c69b5c231` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:49.994707 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f89457-b709-4aa1-97f0-5caf01181341 None admin] RBAC: Authorizing `identity:get_project(project_id=33beb4c6e7a44d5a823b242c69b5c231)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:49.996279 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f89457-b709-4aa1-97f0-5caf01181341 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:49.998219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 65/128] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:35:49 2022] GET /identity/v3/projects/33beb4c6e7a44d5a823b242c69b5c231 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:50.004052 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f89457-b709-4aa1-97f0-5caf01181341 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:50.007222 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 64/129] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 24 04:35:49 2022] PUT /identity/v3/projects/33beb4c6e7a44d5a823b242c69b5c231/users/8cd784bb521f420da48da77b1d52602f/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:35:50.008288 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1a150-324b-4fec-bd21-7144780c99e6 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:50.132285 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb1a150-324b-4fec-bd21-7144780c99e6 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:50.172470 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f89457-b709-4aa1-97f0-5caf01181341 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:50.176412 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c26f4-76b6-4776-854a-b8cba3348da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:50.177268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c26f4-76b6-4776-854a-b8cba3348da5 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:50.177572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c26f4-76b6-4776-854a-b8cba3348da5 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:50.177847 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c26f4-76b6-4776-854a-b8cba3348da5 None admin] PATH_INFO: `/v3/projects/f5452f51521644e8b7e99328787a3cd2` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:50.182086 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c26f4-76b6-4776-854a-b8cba3348da5 None admin] RBAC: Authorizing `identity:get_project(project_id=f5452f51521644e8b7e99328787a3cd2)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:50.183581 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c26f4-76b6-4776-854a-b8cba3348da5 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:50.185727 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 65/130] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:35:50 2022] GET /identity/v3/projects/f5452f51521644e8b7e99328787a3cd2 => generated 312 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:50.187318 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c26f4-76b6-4776-854a-b8cba3348da5 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:50.211388 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:50.221063 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701805e4-b61a-4ee1-bd21-cad4833ad251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:50.222110 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701805e4-b61a-4ee1-bd21-cad4833ad251 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:50.222399 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701805e4-b61a-4ee1-bd21-cad4833ad251 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:50.222808 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701805e4-b61a-4ee1-bd21-cad4833ad251 None admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:50.223592 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701805e4-b61a-4ee1-bd21-cad4833ad251 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:50.223923 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701805e4-b61a-4ee1-bd21-cad4833ad251 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:50.228118 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701805e4-b61a-4ee1-bd21-cad4833ad251 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:50.236047 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 66/131] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:35:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:50.237117 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701805e4-b61a-4ee1-bd21-cad4833ad251 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:50.245017 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:50.330286 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c26f4-76b6-4776-854a-b8cba3348da5 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:50.347099 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701805e4-b61a-4ee1-bd21-cad4833ad251 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:50.378383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb5e87-ff7b-41e6-b07a-3dd08ef6ab45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:50.379945 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb5e87-ff7b-41e6-b07a-3dd08ef6ab45 None admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:50.380370 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb5e87-ff7b-41e6-b07a-3dd08ef6ab45 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:50.380783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb5e87-ff7b-41e6-b07a-3dd08ef6ab45 None admin] PATH_INFO: `/v3/projects/33beb4c6e7a44d5a823b242c69b5c231/users/e55eed92c6aa44dcbffd3cac5e4faad7/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:50.382973 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb5e87-ff7b-41e6-b07a-3dd08ef6ab45 None admin] RBAC: Authorizing `identity:create_grant(project_id=33beb4c6e7a44d5a823b242c69b5c231, user_id=e55eed92c6aa44dcbffd3cac5e4faad7, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:50.383871 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cdb29-e100-4c5e-8473-38258f81b8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:50.384574 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cdb29-e100-4c5e-8473-38258f81b8a8 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:50.384920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cdb29-e100-4c5e-8473-38258f81b8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:50.385064 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb5e87-ff7b-41e6-b07a-3dd08ef6ab45 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:50.385305 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cdb29-e100-4c5e-8473-38258f81b8a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:50.386139 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78cdb29-e100-4c5e-8473-38258f81b8a8 None admin] RBAC: Adding query filter params (role.id=12d1e39175d748a09df9a7263b578070, scope.project.id=33beb4c6e7a44d5a823b242c69b5c231, user.id=06012746b2a445c6b6b6b8324542ce1d) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:50.386532 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78cdb29-e100-4c5e-8473-38258f81b8a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:50.388243 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78cdb29-e100-4c5e-8473-38258f81b8a8 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:50.397261 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 67/132] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:35:50 2022] GET /identity/v3/role_assignments?user.id=06012746b2a445c6b6b6b8324542ce1d&scope.project.id=33beb4c6e7a44d5a823b242c69b5c231&role.id=12d1e39175d748a09df9a7263b578070 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:50.398694 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cdb29-e100-4c5e-8473-38258f81b8a8 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:50.404303 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 66/133] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 24 04:35:50 2022] PUT /identity/v3/projects/33beb4c6e7a44d5a823b242c69b5c231/users/e55eed92c6aa44dcbffd3cac5e4faad7/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:35:50.405796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb5e87-ff7b-41e6-b07a-3dd08ef6ab45 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:50.492556 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:50.552268 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cdb29-e100-4c5e-8473-38258f81b8a8 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:50.572667 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb5e87-ff7b-41e6-b07a-3dd08ef6ab45 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:50.574948 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:50.598943 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ab282-bdd4-41e3-a35e-fe20febb307a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:50.599687 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ab282-bdd4-41e3-a35e-fe20febb307a None admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:50.600084 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ab282-bdd4-41e3-a35e-fe20febb307a None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:50.600421 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ab282-bdd4-41e3-a35e-fe20febb307a None admin] PATH_INFO: `/v3/projects/f5452f51521644e8b7e99328787a3cd2/users/8cd784bb521f420da48da77b1d52602f/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:50.606287 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ab282-bdd4-41e3-a35e-fe20febb307a None admin] RBAC: Authorizing `identity:create_grant(project_id=f5452f51521644e8b7e99328787a3cd2, user_id=8cd784bb521f420da48da77b1d52602f, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:50.607901 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ab282-bdd4-41e3-a35e-fe20febb307a None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:50.629455 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 68/134] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 24 04:35:50 2022] PUT /identity/v3/projects/f5452f51521644e8b7e99328787a3cd2/users/8cd784bb521f420da48da77b1d52602f/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:35:50.631200 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da292b25-82df-46d0-963e-e3c8ca14d62d None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:50.631482 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da292b25-82df-46d0-963e-e3c8ca14d62d None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:50.631756 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da292b25-82df-46d0-963e-e3c8ca14d62d None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:50.633279 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 69/135] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:50.633692 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047076c8-8bef-48fa-90ba-fe036ab4055e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:50.634613 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047076c8-8bef-48fa-90ba-fe036ab4055e None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:50.635123 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047076c8-8bef-48fa-90ba-fe036ab4055e None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:50.635596 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047076c8-8bef-48fa-90ba-fe036ab4055e None admin] PATH_INFO: `/v3/users/8cd784bb521f420da48da77b1d52602f` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:50.637235 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047076c8-8bef-48fa-90ba-fe036ab4055e None admin] RBAC: Authorizing `identity:get_user(user_id=8cd784bb521f420da48da77b1d52602f)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:50.639601 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047076c8-8bef-48fa-90ba-fe036ab4055e None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:50.639768 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be6cfe-8118-4952-aa6a-6284d0128652 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:50.640032 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be6cfe-8118-4952-aa6a-6284d0128652 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:50.640310 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be6cfe-8118-4952-aa6a-6284d0128652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:50.642650 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 67/136] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:35:50 2022] GET /identity/v3/users/8cd784bb521f420da48da77b1d52602f => generated 275 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:50.649581 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047076c8-8bef-48fa-90ba-fe036ab4055e None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:50.669017 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-61be6cfe-8118-4952-aa6a-6284d0128652 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:50.670372 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-61be6cfe-8118-4952-aa6a-6284d0128652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:50.762592 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 70/137] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:35:50.816894 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047076c8-8bef-48fa-90ba-fe036ab4055e None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:50.864851 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c2de7-738e-46de-8618-91314e5f94e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:50.865532 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c2de7-738e-46de-8618-91314e5f94e5 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:50.865816 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c2de7-738e-46de-8618-91314e5f94e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:50.866090 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c2de7-738e-46de-8618-91314e5f94e5 None admin] PATH_INFO: `/v3/projects/33beb4c6e7a44d5a823b242c69b5c231` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:50.870028 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c2de7-738e-46de-8618-91314e5f94e5 None admin] RBAC: Authorizing `identity:get_project(project_id=33beb4c6e7a44d5a823b242c69b5c231)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:50.871506 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c2de7-738e-46de-8618-91314e5f94e5 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:50.873408 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 68/138] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:35:50 2022] GET /identity/v3/projects/33beb4c6e7a44d5a823b242c69b5c231 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:50.879171 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be6cfe-8118-4952-aa6a-6284d0128652 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:50.951252 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:51.013155 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be6cfe-8118-4952-aa6a-6284d0128652 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:51.051199 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb97c7-6457-4db2-a686-2f223de96344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:51.051879 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb97c7-6457-4db2-a686-2f223de96344 None admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:51.052219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb97c7-6457-4db2-a686-2f223de96344 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:51.052494 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb97c7-6457-4db2-a686-2f223de96344 None admin] PATH_INFO: `/v3/projects/33beb4c6e7a44d5a823b242c69b5c231/users/8cd784bb521f420da48da77b1d52602f/roles/3c2269f848184abd93ef97d02f6553e4` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:51.054691 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb97c7-6457-4db2-a686-2f223de96344 None admin] RBAC: Authorizing `identity:create_grant(project_id=33beb4c6e7a44d5a823b242c69b5c231, user_id=8cd784bb521f420da48da77b1d52602f, role_id=3c2269f848184abd93ef97d02f6553e4)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:51.056287 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb97c7-6457-4db2-a686-2f223de96344 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:51.074752 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 71/139] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 24 04:35:50 2022] PUT /identity/v3/projects/33beb4c6e7a44d5a823b242c69b5c231/users/8cd784bb521f420da48da77b1d52602f/roles/3c2269f848184abd93ef97d02f6553e4 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:35:51.283245 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c2de7-738e-46de-8618-91314e5f94e5 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:51.340321 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:51.426084 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c2de7-738e-46de-8618-91314e5f94e5 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:51.467962 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13caf36-6a44-4e08-a03e-ae88f9159c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:51.468612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13caf36-6a44-4e08-a03e-ae88f9159c2b None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:51.468894 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13caf36-6a44-4e08-a03e-ae88f9159c2b None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:51.469173 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13caf36-6a44-4e08-a03e-ae88f9159c2b None admin] PATH_INFO: `/v3/domains/default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:51.470362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13caf36-6a44-4e08-a03e-ae88f9159c2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:51.471835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13caf36-6a44-4e08-a03e-ae88f9159c2b None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:51.473862 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 69/140] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:51.479537 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb97c7-6457-4db2-a686-2f223de96344 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:51.598108 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb97c7-6457-4db2-a686-2f223de96344 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:51.605663 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:51.633327 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb448a7-ebc8-4a24-8b08-605d805a35d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:51.633969 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb448a7-ebc8-4a24-8b08-605d805a35d1 None admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:51.634250 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb448a7-ebc8-4a24-8b08-605d805a35d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:51.634516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb448a7-ebc8-4a24-8b08-605d805a35d1 None admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:51.635171 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb448a7-ebc8-4a24-8b08-605d805a35d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:51.636670 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb448a7-ebc8-4a24-8b08-605d805a35d1 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:51.670766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 72/141] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 24 04:35:51 2022] POST /identity/v3/users => generated 283 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:35:52.710192 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b9ad9-a687-4b13-8c2b-114689a72bf3 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:52.710923 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b9ad9-a687-4b13-8c2b-114689a72bf3 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:52.710923 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b9ad9-a687-4b13-8c2b-114689a72bf3 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:52.712307 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 70/142] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:52.718957 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c097e9-3093-4d73-8ce1-3af37dc16574 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:52.719914 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c097e9-3093-4d73-8ce1-3af37dc16574 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:52.720394 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c097e9-3093-4d73-8ce1-3af37dc16574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:52.741831 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-29c097e9-3093-4d73-8ce1-3af37dc16574 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:52.743515 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-29c097e9-3093-4d73-8ce1-3af37dc16574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:52.818277 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 73/143] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:53.084993 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e274c-4381-4313-bd50-f88900f96b4c None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:53.085758 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e274c-4381-4313-bd50-f88900f96b4c None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:53.086029 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e274c-4381-4313-bd50-f88900f96b4c None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:53.087747 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 71/144] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:35:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:53.097023 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce439c7-8485-4988-aefe-45cb68f0b2f3 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:53.097023 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce439c7-8485-4988-aefe-45cb68f0b2f3 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:53.097023 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce439c7-8485-4988-aefe-45cb68f0b2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:53.114162 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-7ce439c7-8485-4988-aefe-45cb68f0b2f3 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:53.115739 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-7ce439c7-8485-4988-aefe-45cb68f0b2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:53.191166 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 74/145] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:53.325244 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e274c-4381-4313-bd50-f88900f96b4c None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:53.367635 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52527bf-77c7-40ee-8663-3dd7214de62a None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:53.367964 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52527bf-77c7-40ee-8663-3dd7214de62a None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:53.368186 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52527bf-77c7-40ee-8663-3dd7214de62a None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:53.370399 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 75/146] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:35:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:53.380818 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28803fa-2c66-4313-8336-8d1967b61dd8 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:53.381122 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28803fa-2c66-4313-8336-8d1967b61dd8 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:53.381374 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28803fa-2c66-4313-8336-8d1967b61dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:53.412860 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-f28803fa-2c66-4313-8336-8d1967b61dd8 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:53.414291 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-f28803fa-2c66-4313-8336-8d1967b61dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:53.469751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:53.525522 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 76/147] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:35:53.542194 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e274c-4381-4313-bd50-f88900f96b4c None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:53.566107 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:53.636773 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb328ab-6451-4b04-b177-90b7c9bbae2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:53.636773 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb328ab-6451-4b04-b177-90b7c9bbae2e None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:53.636773 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb328ab-6451-4b04-b177-90b7c9bbae2e None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:53.636773 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb328ab-6451-4b04-b177-90b7c9bbae2e None admin] PATH_INFO: `/v3/roles/member` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:53.655469 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28803fa-2c66-4313-8336-8d1967b61dd8 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:53.655705 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb328ab-6451-4b04-b177-90b7c9bbae2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:53.660494 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-efb328ab-6451-4b04-b177-90b7c9bbae2e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:35:53.660494 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:53.660494 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:53.660494 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:53.660494 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:53.660494 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:53.660494 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:53.660494 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:53.660494 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:53.660494 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:53.660494 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:53.660494 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:53.660494 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:53.660494 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:53.660494 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:53.660494 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:53.661456 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:53.661456 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:53.661456 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:53.661456 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:53.661456 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:53.661456 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:53.661456 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:53.661456 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:53.661456 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:53.661456 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:53.661456 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:53.661456 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:53.661456 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:53.661456 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:53.661456 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:53.661456 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:53.662255 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:53.662255 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:53.662255 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:53.662255 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:53.662255 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:53.662255 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:53.662255 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:53.662255 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:53.662255 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:53.662255 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:53.662255 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:35:53.662255 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:35:53.671519 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 72/148] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:35:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:53.678430 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb328ab-6451-4b04-b177-90b7c9bbae2e None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:53.817005 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28803fa-2c66-4313-8336-8d1967b61dd8 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:53.877612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb328ab-6451-4b04-b177-90b7c9bbae2e None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:53.886858 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76ab4a-cac7-47f0-8bd7-d61b3911769c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:53.887446 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76ab4a-cac7-47f0-8bd7-d61b3911769c None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:53.887722 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76ab4a-cac7-47f0-8bd7-d61b3911769c None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:53.887989 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76ab4a-cac7-47f0-8bd7-d61b3911769c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:53.904411 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce76ab4a-cac7-47f0-8bd7-d61b3911769c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:53.909346 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-ce76ab4a-cac7-47f0-8bd7-d61b3911769c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:35:53.909346 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:53.909346 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:53.909346 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:53.909346 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:53.909346 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:53.909346 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:53.909346 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:53.909346 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:53.909346 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:53.909346 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:53.909346 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:53.909346 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:53.909346 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:53.909346 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:53.909346 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:53.910247 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:53.910247 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:53.910247 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:53.910247 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:53.910247 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:53.910247 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:53.910247 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:53.910247 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:53.910247 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:53.910247 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:53.910247 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:53.910247 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:53.910247 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:53.910247 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:53.910247 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:53.910247 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:53.910987 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:53.910987 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:53.910987 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:53.910987 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:53.910987 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:53.910987 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:53.910987 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:53.910987 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:53.910987 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:53.910987 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:53.910987 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:35:53.910987 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:35:53.921372 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 77/149] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:35:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:35:53.934468 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76ab4a-cac7-47f0-8bd7-d61b3911769c None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:53.954172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825f9c2-c509-47b7-8420-074c3109e95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:53.955208 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825f9c2-c509-47b7-8420-074c3109e95e None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:53.955688 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825f9c2-c509-47b7-8420-074c3109e95e None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:53.956175 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825f9c2-c509-47b7-8420-074c3109e95e None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:53.957061 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825f9c2-c509-47b7-8420-074c3109e95e None admin] RBAC: Adding query filter params (name=member) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:53.957581 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825f9c2-c509-47b7-8420-074c3109e95e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:53.959263 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825f9c2-c509-47b7-8420-074c3109e95e None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:53.962509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:53.973614 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 73/150] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 24 04:35:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:53.980628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825f9c2-c509-47b7-8420-074c3109e95e None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:54.029177 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:54.121672 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76ab4a-cac7-47f0-8bd7-d61b3911769c None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:54.181935 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825f9c2-c509-47b7-8420-074c3109e95e None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:54.198082 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b8c72-06fe-43b3-87a6-6f7092380a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:54.198986 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b8c72-06fe-43b3-87a6-6f7092380a37 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:54.199398 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b8c72-06fe-43b3-87a6-6f7092380a37 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:54.199815 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b8c72-06fe-43b3-87a6-6f7092380a37 None admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:54.200631 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b8c72-06fe-43b3-87a6-6f7092380a37 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:54.201071 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b8c72-06fe-43b3-87a6-6f7092380a37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:54.202693 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415b8c72-06fe-43b3-87a6-6f7092380a37 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:54.221641 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 78/151] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 24 04:35:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:54.226314 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b8c72-06fe-43b3-87a6-6f7092380a37 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:54.259638 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb5f73-9b0f-42fc-a76a-78a9f71c8a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:54.260544 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb5f73-9b0f-42fc-a76a-78a9f71c8a5c None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:54.260954 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb5f73-9b0f-42fc-a76a-78a9f71c8a5c None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:54.261365 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb5f73-9b0f-42fc-a76a-78a9f71c8a5c None admin] PATH_INFO: `/v3/users/8cd784bb521f420da48da77b1d52602f` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:54.266089 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb5f73-9b0f-42fc-a76a-78a9f71c8a5c None admin] RBAC: Authorizing `identity:get_user(user_id=8cd784bb521f420da48da77b1d52602f)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:54.267751 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb5f73-9b0f-42fc-a76a-78a9f71c8a5c None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:54.269601 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 74/152] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:35:53 2022] GET /identity/v3/users/8cd784bb521f420da48da77b1d52602f => generated 275 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:54.270519 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb5f73-9b0f-42fc-a76a-78a9f71c8a5c None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:54.401285 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:54.409845 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:54.423678 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb5f73-9b0f-42fc-a76a-78a9f71c8a5c None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:54.470447 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b8c72-06fe-43b3-87a6-6f7092380a37 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:54.502851 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8838d-ee44-44e0-88b1-b70a54fd2789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:54.503508 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8838d-ee44-44e0-88b1-b70a54fd2789 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:54.503787 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8838d-ee44-44e0-88b1-b70a54fd2789 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:54.504058 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8838d-ee44-44e0-88b1-b70a54fd2789 None admin] PATH_INFO: `/v3/users/06012746b2a445c6b6b6b8324542ce1d` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:54.506044 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8838d-ee44-44e0-88b1-b70a54fd2789 None admin] RBAC: Authorizing `identity:get_user(user_id=06012746b2a445c6b6b6b8324542ce1d)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:54.507505 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8838d-ee44-44e0-88b1-b70a54fd2789 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:54.512344 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 75/153] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:35:54 2022] GET /identity/v3/users/06012746b2a445c6b6b6b8324542ce1d => generated 289 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:54.516941 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8838d-ee44-44e0-88b1-b70a54fd2789 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:54.541779 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9333e0ca-7de1-4a3f-8e1f-3f69f55745cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:54.542456 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333e0ca-7de1-4a3f-8e1f-3f69f55745cc None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:54.542712 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333e0ca-7de1-4a3f-8e1f-3f69f55745cc None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:54.542984 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333e0ca-7de1-4a3f-8e1f-3f69f55745cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:54.564118 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9333e0ca-7de1-4a3f-8e1f-3f69f55745cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:54.569509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-9333e0ca-7de1-4a3f-8e1f-3f69f55745cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:35:54.569509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:54.569509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:54.569509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:54.569509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:54.569509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:54.569509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:54.569509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:54.569509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:54.569509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:54.569509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:54.569509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:54.569509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:54.569509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:54.569509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:54.569509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:54.570318 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:54.570318 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:54.570318 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:54.570318 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:54.570318 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:54.570318 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:54.570318 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:54.570318 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:54.570318 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:54.570318 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:54.570318 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:54.570318 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:54.570318 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:54.570318 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:54.570318 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:54.570318 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:54.571068 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:54.571068 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:54.571068 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:54.571068 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:54.571068 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:54.571068 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:54.571068 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:54.571068 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:54.571068 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:54.571068 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:54.571068 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:35:54.571068 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:35:54.571841 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 79/154] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 24 04:35:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:54.573805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc55ac-9e62-40ea-b002-95bfb398d434 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:54.574065 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc55ac-9e62-40ea-b002-95bfb398d434 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:54.574538 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc55ac-9e62-40ea-b002-95bfb398d434 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:54.582450 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 80/155] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:35:54 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:54.583168 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc55ac-9e62-40ea-b002-95bfb398d434 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:54.680754 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8838d-ee44-44e0-88b1-b70a54fd2789 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:54.717312 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5024b3-7b83-46c1-ab6f-bd642ef95245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:54.718356 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5024b3-7b83-46c1-ab6f-bd642ef95245 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:54.718967 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5024b3-7b83-46c1-ab6f-bd642ef95245 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:54.719439 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5024b3-7b83-46c1-ab6f-bd642ef95245 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:54.773742 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:54.790716 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc55ac-9e62-40ea-b002-95bfb398d434 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:54.830843 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc24e4f0-dc46-4d6a-a00e-1b74000b96e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:54.832299 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24e4f0-dc46-4d6a-a00e-1b74000b96e8 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:54.832774 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24e4f0-dc46-4d6a-a00e-1b74000b96e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:54.833305 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24e4f0-dc46-4d6a-a00e-1b74000b96e8 None admin] PATH_INFO: `/v3/projects/33beb4c6e7a44d5a823b242c69b5c231` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:54.835059 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc24e4f0-dc46-4d6a-a00e-1b74000b96e8 None admin] RBAC: Authorizing `identity:get_project(project_id=33beb4c6e7a44d5a823b242c69b5c231)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:54.836753 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc24e4f0-dc46-4d6a-a00e-1b74000b96e8 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:54.838693 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 81/156] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:35:54 2022] GET /identity/v3/projects/33beb4c6e7a44d5a823b242c69b5c231 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:54.840096 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fa47a-5a02-46b3-9b36-5914533cd0f1 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:54.840589 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fa47a-5a02-46b3-9b36-5914533cd0f1 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:54.841057 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fa47a-5a02-46b3-9b36-5914533cd0f1 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:54.842544 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 82/157] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:54.844205 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16fa47a-5a02-46b3-9b36-5914533cd0f1 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:54.851404 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:54.882609 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5024b3-7b83-46c1-ab6f-bd642ef95245 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:54.884969 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5024b3-7b83-46c1-ab6f-bd642ef95245 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:54.991314 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 76/158] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:35:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:54.992993 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0d4bb-f6e3-4b21-9d40-3f2adec324d5 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:54.993507 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0d4bb-f6e3-4b21-9d40-3f2adec324d5 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:54.994064 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0d4bb-f6e3-4b21-9d40-3f2adec324d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:55.013937 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-11a0d4bb-f6e3-4b21-9d40-3f2adec324d5 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:55.015603 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-11a0d4bb-f6e3-4b21-9d40-3f2adec324d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:55.064560 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16fa47a-5a02-46b3-9b36-5914533cd0f1 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:55.083561 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:55.093863 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 77/159] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:55.095113 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbbd24-5bd4-4fd3-bfc1-576661cd7a09 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:55.095391 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbbd24-5bd4-4fd3-bfc1-576661cd7a09 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:55.095732 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbbd24-5bd4-4fd3-bfc1-576661cd7a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:55.102443 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da8477-6e95-4998-8212-51132f8bb573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:55.103306 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da8477-6e95-4998-8212-51132f8bb573 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:55.103791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da8477-6e95-4998-8212-51132f8bb573 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:55.104316 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da8477-6e95-4998-8212-51132f8bb573 None admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:55.105198 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da8477-6e95-4998-8212-51132f8bb573 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:55.105774 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da8477-6e95-4998-8212-51132f8bb573 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:55.107336 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da8477-6e95-4998-8212-51132f8bb573 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:55.114498 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-9ebbbd24-5bd4-4fd3-bfc1-576661cd7a09 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:55.115685 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-9ebbbd24-5bd4-4fd3-bfc1-576661cd7a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:55.117317 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 83/160] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:35:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:55.122256 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da8477-6e95-4998-8212-51132f8bb573 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:55.190915 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:55.191595 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 78/161] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:55.192926 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbbd24-5bd4-4fd3-bfc1-576661cd7a09 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:55.231152 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da8477-6e95-4998-8212-51132f8bb573 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:55.266479 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a8105-2e21-4ec1-8c3e-0b941956a2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:55.267519 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a8105-2e21-4ec1-8c3e-0b941956a2a2 None admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:55.268001 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a8105-2e21-4ec1-8c3e-0b941956a2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:55.268456 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a8105-2e21-4ec1-8c3e-0b941956a2a2 None admin] PATH_INFO: `/v3/projects/33beb4c6e7a44d5a823b242c69b5c231/users/06012746b2a445c6b6b6b8324542ce1d/roles/12d1e39175d748a09df9a7263b578070` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:55.270561 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a8105-2e21-4ec1-8c3e-0b941956a2a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=33beb4c6e7a44d5a823b242c69b5c231, user_id=06012746b2a445c6b6b6b8324542ce1d, role_id=12d1e39175d748a09df9a7263b578070)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:55.272188 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a8105-2e21-4ec1-8c3e-0b941956a2a2 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:55.288860 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 84/162] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 24 04:35:55 2022] PUT /identity/v3/projects/33beb4c6e7a44d5a823b242c69b5c231/users/06012746b2a445c6b6b6b8324542ce1d/roles/12d1e39175d748a09df9a7263b578070 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:35:55.294686 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a8105-2e21-4ec1-8c3e-0b941956a2a2 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:55.360410 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbbd24-5bd4-4fd3-bfc1-576661cd7a09 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:55.396722 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:55.421694 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d4953-e6ac-4fc2-b2ac-509491a83c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:55.422458 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d4953-e6ac-4fc2-b2ac-509491a83c3a None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:55.422688 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d4953-e6ac-4fc2-b2ac-509491a83c3a None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:55.422966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d4953-e6ac-4fc2-b2ac-509491a83c3a None admin] PATH_INFO: `/v3/projects/33beb4c6e7a44d5a823b242c69b5c231` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:55.425240 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512d4953-e6ac-4fc2-b2ac-509491a83c3a None admin] RBAC: Authorizing `identity:get_project(project_id=33beb4c6e7a44d5a823b242c69b5c231)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:55.426876 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512d4953-e6ac-4fc2-b2ac-509491a83c3a None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:55.432476 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 79/163] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:35:55 2022] GET /identity/v3/projects/33beb4c6e7a44d5a823b242c69b5c231 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:55.438555 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d4953-e6ac-4fc2-b2ac-509491a83c3a None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:55.440962 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a8105-2e21-4ec1-8c3e-0b941956a2a2 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:55.477368 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:55.490198 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e07d6-3348-43c9-b85b-8bebd6f49453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:55.493851 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e07d6-3348-43c9-b85b-8bebd6f49453 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:55.494394 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e07d6-3348-43c9-b85b-8bebd6f49453 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:55.494864 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e07d6-3348-43c9-b85b-8bebd6f49453 None admin] PATH_INFO: `/v3/users/e55eed92c6aa44dcbffd3cac5e4faad7` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:55.496732 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e07d6-3348-43c9-b85b-8bebd6f49453 None admin] RBAC: Authorizing `identity:get_user(user_id=e55eed92c6aa44dcbffd3cac5e4faad7)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:55.498651 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e07d6-3348-43c9-b85b-8bebd6f49453 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:55.500748 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 85/164] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:35:55 2022] GET /identity/v3/users/e55eed92c6aa44dcbffd3cac5e4faad7 => generated 247 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:55.507463 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e07d6-3348-43c9-b85b-8bebd6f49453 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:55.573370 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d4953-e6ac-4fc2-b2ac-509491a83c3a None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:55.612711 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c5216-e9f9-4574-90ef-f1bddd41b2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:55.613497 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c5216-e9f9-4574-90ef-f1bddd41b2a6 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:55.613805 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c5216-e9f9-4574-90ef-f1bddd41b2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:55.614076 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c5216-e9f9-4574-90ef-f1bddd41b2a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:55.615052 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c5216-e9f9-4574-90ef-f1bddd41b2a6 None admin] RBAC: Adding query filter params (role.id=e2eda359ee274ff1914db224f7f9b383, scope.project.id=33beb4c6e7a44d5a823b242c69b5c231, user.id=8cd784bb521f420da48da77b1d52602f) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:55.615363 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c5216-e9f9-4574-90ef-f1bddd41b2a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:55.616848 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c5216-e9f9-4574-90ef-f1bddd41b2a6 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:55.624383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 80/165] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:35:55 2022] GET /identity/v3/role_assignments?user.id=8cd784bb521f420da48da77b1d52602f&scope.project.id=33beb4c6e7a44d5a823b242c69b5c231&role.id=e2eda359ee274ff1914db224f7f9b383 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:55.663426 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e07d6-3348-43c9-b85b-8bebd6f49453 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:55.716204 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce8498-c68b-47da-98d8-3901bf965a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:55.717285 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce8498-c68b-47da-98d8-3901bf965a23 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:55.717871 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce8498-c68b-47da-98d8-3901bf965a23 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:55.718342 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce8498-c68b-47da-98d8-3901bf965a23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:55.746944 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c5216-e9f9-4574-90ef-f1bddd41b2a6 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:55.793820 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:55.803805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce8498-c68b-47da-98d8-3901bf965a23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:55.805946 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce8498-c68b-47da-98d8-3901bf965a23 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:55.865844 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:55.914337 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 86/166] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:35:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 04:35:55.921117 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce8498-c68b-47da-98d8-3901bf965a23 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:55.964141 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c5216-e9f9-4574-90ef-f1bddd41b2a6 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:56.007416 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fee24-992d-4c65-9c70-5ee772ab3e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:56.008167 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fee24-992d-4c65-9c70-5ee772ab3e35 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:56.008450 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fee24-992d-4c65-9c70-5ee772ab3e35 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:56.008741 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fee24-992d-4c65-9c70-5ee772ab3e35 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:56.021790 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96fee24-992d-4c65-9c70-5ee772ab3e35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:56.027718 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-a96fee24-992d-4c65-9c70-5ee772ab3e35 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:35:56.027718 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:56.027718 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:56.027718 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:56.027718 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:56.027718 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:56.027718 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:56.027718 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:56.027718 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:56.027718 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:56.027718 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:56.027718 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:56.027718 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:56.027718 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:56.027718 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:56.027718 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:56.028661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:56.028661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:56.028661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:56.028661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:56.028661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:56.028661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:56.028661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:56.028661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:56.028661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:56.028661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:56.028661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:56.028661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:56.028661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:56.028661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:56.028661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:56.028661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:56.029759 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:56.029759 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:56.029759 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:56.029759 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:56.029759 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:56.029759 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:56.029759 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:56.029759 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:56.029759 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:56.029759 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:56.029759 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:35:56.029759 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:35:56.029759 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 81/167] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 24 04:35:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:35:56.031235 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fee24-992d-4c65-9c70-5ee772ab3e35 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:56.127033 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:56.136016 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fee24-992d-4c65-9c70-5ee772ab3e35 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:56.138155 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce8498-c68b-47da-98d8-3901bf965a23 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:56.162044 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:56.175242 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4024787-66e6-4274-82e9-646e53920908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:56.175883 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4024787-66e6-4274-82e9-646e53920908 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:56.176651 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4024787-66e6-4274-82e9-646e53920908 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:56.176937 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4024787-66e6-4274-82e9-646e53920908 None admin] PATH_INFO: `/v3/projects/33beb4c6e7a44d5a823b242c69b5c231` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:56.178182 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4024787-66e6-4274-82e9-646e53920908 None admin] RBAC: Authorizing `identity:get_project(project_id=33beb4c6e7a44d5a823b242c69b5c231)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:56.179812 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4024787-66e6-4274-82e9-646e53920908 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:56.181500 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 82/168] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:35:56 2022] GET /identity/v3/projects/33beb4c6e7a44d5a823b242c69b5c231 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:56.182414 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4024787-66e6-4274-82e9-646e53920908 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:56.254123 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbccf9-08be-49e8-81df-04a7a573afa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:56.254829 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbccf9-08be-49e8-81df-04a7a573afa9 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:56.255112 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbccf9-08be-49e8-81df-04a7a573afa9 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:56.255389 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecbccf9-08be-49e8-81df-04a7a573afa9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:56.294004 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecbccf9-08be-49e8-81df-04a7a573afa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:56.298860 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-0ecbccf9-08be-49e8-81df-04a7a573afa9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:35:56.298860 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:56.298860 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:56.298860 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:56.298860 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:56.298860 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:56.298860 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:56.298860 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:56.298860 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:56.298860 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:56.298860 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:56.298860 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:56.298860 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:56.298860 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:56.298860 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:56.298860 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:56.300302 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:56.300302 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:56.300302 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:56.300302 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:56.300302 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:56.300302 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:56.300302 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:56.300302 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:56.300302 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:56.300302 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:56.300302 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:56.300302 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:56.300302 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:56.300302 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:56.300302 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:56.300302 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:56.301826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:56.301826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:56.301826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:56.301826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:56.301826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:56.301826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:56.301826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:56.301826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:56.301826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:56.301826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:56.301826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:35:56.301826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:35:56.301826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 87/169] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:35:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:56.301826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbccf9-08be-49e8-81df-04a7a573afa9 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:56.307445 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4024787-66e6-4274-82e9-646e53920908 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:56.369935 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b3de6-80da-4c3f-9043-7479b73ae8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:56.370562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b3de6-80da-4c3f-9043-7479b73ae8d6 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:56.370841 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b3de6-80da-4c3f-9043-7479b73ae8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:56.371429 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b3de6-80da-4c3f-9043-7479b73ae8d6 None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:56.372119 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b3de6-80da-4c3f-9043-7479b73ae8d6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:56.372426 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b3de6-80da-4c3f-9043-7479b73ae8d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:56.373879 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3b3de6-80da-4c3f-9043-7479b73ae8d6 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:56.393986 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 83/170] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:35:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:56.394533 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b3de6-80da-4c3f-9043-7479b73ae8d6 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:56.475579 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:56.519894 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecbccf9-08be-49e8-81df-04a7a573afa9 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:56.558024 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b3de6-80da-4c3f-9043-7479b73ae8d6 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:56.590578 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41504e4-c1eb-4e23-96c5-9781c153a6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:56.591526 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41504e4-c1eb-4e23-96c5-9781c153a6a7 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:56.591988 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41504e4-c1eb-4e23-96c5-9781c153a6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:56.592440 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41504e4-c1eb-4e23-96c5-9781c153a6a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:56.593491 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41504e4-c1eb-4e23-96c5-9781c153a6a7 None admin] RBAC: Adding query filter params (role.id=74ce7b72bcc94a8a8ad65c3db928e6ac, scope.project.id=33beb4c6e7a44d5a823b242c69b5c231, user.id=e55eed92c6aa44dcbffd3cac5e4faad7) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:56.593977 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41504e4-c1eb-4e23-96c5-9781c153a6a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:56.595709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41504e4-c1eb-4e23-96c5-9781c153a6a7 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:56.607425 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 88/171] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:35:56 2022] GET /identity/v3/role_assignments?user.id=e55eed92c6aa44dcbffd3cac5e4faad7&scope.project.id=33beb4c6e7a44d5a823b242c69b5c231&role.id=74ce7b72bcc94a8a8ad65c3db928e6ac => generated 608 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:56.609644 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75e8a8-dcb8-4e29-ac90-6ba6ce343f09 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:56.610791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75e8a8-dcb8-4e29-ac90-6ba6ce343f09 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:56.611422 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75e8a8-dcb8-4e29-ac90-6ba6ce343f09 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:56.614268 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 89/172] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:35:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:56.616884 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75e8a8-dcb8-4e29-ac90-6ba6ce343f09 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:56.631572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351861d4-9fde-4f39-acc5-12a89bcba584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:56.632641 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351861d4-9fde-4f39-acc5-12a89bcba584 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:56.633114 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351861d4-9fde-4f39-acc5-12a89bcba584 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:56.633648 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351861d4-9fde-4f39-acc5-12a89bcba584 None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:56.634563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351861d4-9fde-4f39-acc5-12a89bcba584 None admin] RBAC: Adding query filter params (name=member) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:56.635033 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351861d4-9fde-4f39-acc5-12a89bcba584 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:56.636838 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351861d4-9fde-4f39-acc5-12a89bcba584 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:56.661853 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:56.682509 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 84/173] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 24 04:35:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:56.683833 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80111a99-d1d3-49a8-b22c-5cff6d424f0c None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:56.684111 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80111a99-d1d3-49a8-b22c-5cff6d424f0c None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:56.684382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80111a99-d1d3-49a8-b22c-5cff6d424f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:56.721203 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-80111a99-d1d3-49a8-b22c-5cff6d424f0c None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:56.722661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-80111a99-d1d3-49a8-b22c-5cff6d424f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:56.856617 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 85/174] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:56.857643 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80111a99-d1d3-49a8-b22c-5cff6d424f0c None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:56.881592 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75e8a8-dcb8-4e29-ac90-6ba6ce343f09 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:56.927091 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:56.943151 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5dd10-b1d9-4b09-917a-e22debbf7631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:56.945030 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5dd10-b1d9-4b09-917a-e22debbf7631 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:56.947351 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5dd10-b1d9-4b09-917a-e22debbf7631 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:56.948033 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5dd10-b1d9-4b09-917a-e22debbf7631 None admin] PATH_INFO: `/v3/users/8cd784bb521f420da48da77b1d52602f` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:56.951326 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5dd10-b1d9-4b09-917a-e22debbf7631 None admin] RBAC: Authorizing `identity:get_user(user_id=8cd784bb521f420da48da77b1d52602f)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:56.954365 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5dd10-b1d9-4b09-917a-e22debbf7631 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:56.957147 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 90/175] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:35:56 2022] GET /identity/v3/users/8cd784bb521f420da48da77b1d52602f => generated 275 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:56.958663 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b303f37-1158-41bf-97b5-9b18f0d28e7d None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:56.959162 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b303f37-1158-41bf-97b5-9b18f0d28e7d None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:56.959743 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b303f37-1158-41bf-97b5-9b18f0d28e7d None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:56.961525 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 91/176] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:35:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:56.963116 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b303f37-1158-41bf-97b5-9b18f0d28e7d None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:57.058369 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80111a99-d1d3-49a8-b22c-5cff6d424f0c None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:57.088908 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:57.102388 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe935f9-1fd8-47e7-bb56-ffab6de2c2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:57.103437 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe935f9-1fd8-47e7-bb56-ffab6de2c2bc None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:57.103971 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe935f9-1fd8-47e7-bb56-ffab6de2c2bc None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:57.104556 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe935f9-1fd8-47e7-bb56-ffab6de2c2bc None admin] PATH_INFO: `/v3/users/8cd784bb521f420da48da77b1d52602f` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:57.105922 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe935f9-1fd8-47e7-bb56-ffab6de2c2bc None admin] RBAC: Authorizing `identity:get_user(user_id=8cd784bb521f420da48da77b1d52602f)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:57.107650 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe935f9-1fd8-47e7-bb56-ffab6de2c2bc None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:57.108190 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b303f37-1158-41bf-97b5-9b18f0d28e7d None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:57.109994 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 86/177] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:35:56 2022] GET /identity/v3/users/8cd784bb521f420da48da77b1d52602f => generated 275 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:57.111325 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf77cb5-6c0d-4a0e-8df2-9d50519025f3 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:57.111881 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf77cb5-6c0d-4a0e-8df2-9d50519025f3 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:57.112357 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf77cb5-6c0d-4a0e-8df2-9d50519025f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:57.134471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-fbf77cb5-6c0d-4a0e-8df2-9d50519025f3 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:57.136877 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-fbf77cb5-6c0d-4a0e-8df2-9d50519025f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:57.151948 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b67fa-befb-4d0e-99ce-c342e76cea4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:57.152580 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b67fa-befb-4d0e-99ce-c342e76cea4d None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:57.152858 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b67fa-befb-4d0e-99ce-c342e76cea4d None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:57.153138 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b67fa-befb-4d0e-99ce-c342e76cea4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:57.227553 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 87/178] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:57.227553 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf77f50-3184-4ab5-a5d3-6989fb34c7bf None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:57.227553 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf77f50-3184-4ab5-a5d3-6989fb34c7bf None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:57.227553 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf77f50-3184-4ab5-a5d3-6989fb34c7bf None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:57.227553 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 88/179] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:57.228028 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf77f50-3184-4ab5-a5d3-6989fb34c7bf None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:57.244158 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b67fa-befb-4d0e-99ce-c342e76cea4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:57.246677 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b67fa-befb-4d0e-99ce-c342e76cea4d None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:57.280068 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:57.347902 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf77f50-3184-4ab5-a5d3-6989fb34c7bf None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:57.355707 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:57.380549 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 92/180] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:35:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 04:35:57.380549 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b67fa-befb-4d0e-99ce-c342e76cea4d None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:57.393428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab7b910-2b15-491e-9423-2c6388046594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:57.394545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7b910-2b15-491e-9423-2c6388046594 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:57.395055 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7b910-2b15-491e-9423-2c6388046594 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:57.395457 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab7b910-2b15-491e-9423-2c6388046594 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:57.471562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab7b910-2b15-491e-9423-2c6388046594 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:57.473523 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab7b910-2b15-491e-9423-2c6388046594 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:57.498959 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b67fa-befb-4d0e-99ce-c342e76cea4d None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:57.511152 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:57.535546 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be380d-88b6-4590-8760-79b52614667a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:57.536620 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be380d-88b6-4590-8760-79b52614667a None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:57.536907 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be380d-88b6-4590-8760-79b52614667a None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:57.537176 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be380d-88b6-4590-8760-79b52614667a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:57.547371 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be380d-88b6-4590-8760-79b52614667a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:57.552076 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-e9be380d-88b6-4590-8760-79b52614667a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:35:57.552076 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:57.552076 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:57.552076 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:57.552076 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:57.552076 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:57.552076 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:57.552076 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:57.552076 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:57.552076 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:57.552076 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:57.552076 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:57.552076 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:57.552076 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:57.552076 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:57.552076 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:57.552928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:57.552928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:57.552928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:57.552928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:57.552928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:57.552928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:57.552928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:57.552928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:57.552928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:57.552928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:57.552928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:57.552928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:57.552928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:57.552928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:57.552928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:57.552928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:57.554124 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:57.554124 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:57.554124 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:57.554124 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:57.554124 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:57.554124 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:57.554124 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:57.554124 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:57.554124 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:57.554124 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:57.554124 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:35:57.554124 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:35:57.554124 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 93/181] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 24 04:35:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:57.554775 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698a8e0-a9ba-4b96-b01e-f79557997dad None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:57.554775 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698a8e0-a9ba-4b96-b01e-f79557997dad None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:57.555132 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698a8e0-a9ba-4b96-b01e-f79557997dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:57.572521 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-2698a8e0-a9ba-4b96-b01e-f79557997dad None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:57.573730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-2698a8e0-a9ba-4b96-b01e-f79557997dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:57.587632 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 89/182] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:35:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:57.590216 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab7b910-2b15-491e-9423-2c6388046594 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:57.618865 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:57.647132 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 94/183] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:57.647789 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698a8e0-a9ba-4b96-b01e-f79557997dad None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:57.712975 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab7b910-2b15-491e-9423-2c6388046594 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:57.757529 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887520db-4054-46b4-b32c-23f1a7a2fb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:57.758696 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887520db-4054-46b4-b32c-23f1a7a2fb39 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:57.759370 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887520db-4054-46b4-b32c-23f1a7a2fb39 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:57.759809 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887520db-4054-46b4-b32c-23f1a7a2fb39 None admin] PATH_INFO: `/v3/projects/33beb4c6e7a44d5a823b242c69b5c231` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:57.761778 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887520db-4054-46b4-b32c-23f1a7a2fb39 None admin] RBAC: Authorizing `identity:get_project(project_id=33beb4c6e7a44d5a823b242c69b5c231)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:57.764218 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887520db-4054-46b4-b32c-23f1a7a2fb39 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:57.767290 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 90/184] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:35:57 2022] GET /identity/v3/projects/33beb4c6e7a44d5a823b242c69b5c231 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:57.768442 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887520db-4054-46b4-b32c-23f1a7a2fb39 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:57.769570 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698a8e0-a9ba-4b96-b01e-f79557997dad None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:57.773654 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:57.812674 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf8737-9a55-4e42-b7d2-a53ad36163f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:57.813639 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf8737-9a55-4e42-b7d2-a53ad36163f0 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:57.813989 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf8737-9a55-4e42-b7d2-a53ad36163f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:57.814334 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf8737-9a55-4e42-b7d2-a53ad36163f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:57.816316 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf8737-9a55-4e42-b7d2-a53ad36163f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:57.817898 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf8737-9a55-4e42-b7d2-a53ad36163f0 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:57.823977 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 95/185] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:35:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:57.823977 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf8737-9a55-4e42-b7d2-a53ad36163f0 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:57.871878 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:57.884861 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887520db-4054-46b4-b32c-23f1a7a2fb39 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:57.920634 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49cc5a-e7d0-4a74-ab85-b2ac2d5f517c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:57.921256 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49cc5a-e7d0-4a74-ab85-b2ac2d5f517c None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:57.921575 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49cc5a-e7d0-4a74-ab85-b2ac2d5f517c None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:57.921848 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49cc5a-e7d0-4a74-ab85-b2ac2d5f517c None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:57.922533 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49cc5a-e7d0-4a74-ab85-b2ac2d5f517c None admin] RBAC: Adding query filter params (name=admin) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:57.922894 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49cc5a-e7d0-4a74-ab85-b2ac2d5f517c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:57.924347 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49cc5a-e7d0-4a74-ab85-b2ac2d5f517c None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:57.932550 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 91/186] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:35:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:57.934412 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49cc5a-e7d0-4a74-ab85-b2ac2d5f517c None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:57.938166 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf8737-9a55-4e42-b7d2-a53ad36163f0 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:57.971254 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc066265-ce6e-41b8-9534-592063b3e16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:57.971878 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc066265-ce6e-41b8-9534-592063b3e16c None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:57.972149 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc066265-ce6e-41b8-9534-592063b3e16c None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:57.972419 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc066265-ce6e-41b8-9534-592063b3e16c None admin] PATH_INFO: `/v3/projects/f5452f51521644e8b7e99328787a3cd2` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:57.973575 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc066265-ce6e-41b8-9534-592063b3e16c None admin] RBAC: Authorizing `identity:get_project(project_id=f5452f51521644e8b7e99328787a3cd2)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:57.975098 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc066265-ce6e-41b8-9534-592063b3e16c None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:57.976695 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 96/187] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:35:57 2022] GET /identity/v3/projects/f5452f51521644e8b7e99328787a3cd2 => generated 312 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:57.977467 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc066265-ce6e-41b8-9534-592063b3e16c None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:58.013133 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:58.051059 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49cc5a-e7d0-4a74-ab85-b2ac2d5f517c None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:58.080820 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc066265-ce6e-41b8-9534-592063b3e16c None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:58.086843 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcb00e-aaa4-4e70-a06a-056d746fb409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:58.087434 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcb00e-aaa4-4e70-a06a-056d746fb409 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:58.087725 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcb00e-aaa4-4e70-a06a-056d746fb409 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:58.088089 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcb00e-aaa4-4e70-a06a-056d746fb409 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:58.088824 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dcb00e-aaa4-4e70-a06a-056d746fb409 None admin] RBAC: Adding query filter params (role.id=3c2269f848184abd93ef97d02f6553e4, scope.project.id=33beb4c6e7a44d5a823b242c69b5c231, user.id=8cd784bb521f420da48da77b1d52602f) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:58.089143 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dcb00e-aaa4-4e70-a06a-056d746fb409 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:58.090797 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dcb00e-aaa4-4e70-a06a-056d746fb409 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:58.091566 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:58.098237 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 92/188] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:35:57 2022] GET /identity/v3/role_assignments?user.id=8cd784bb521f420da48da77b1d52602f&scope.project.id=33beb4c6e7a44d5a823b242c69b5c231&role.id=3c2269f848184abd93ef97d02f6553e4 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:58.106330 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcb00e-aaa4-4e70-a06a-056d746fb409 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:58.125678 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e8c15-f085-4351-9ccc-857bee0450ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:58.126397 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e8c15-f085-4351-9ccc-857bee0450ae None admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:58.126731 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e8c15-f085-4351-9ccc-857bee0450ae None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:58.127039 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e8c15-f085-4351-9ccc-857bee0450ae None admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:58.127833 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e8c15-f085-4351-9ccc-857bee0450ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:58.129375 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e8c15-f085-4351-9ccc-857bee0450ae None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:58.157535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 97/189] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 24 04:35:57 2022] POST /identity/v3/users => generated 297 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:35:58.158819 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e8c15-f085-4351-9ccc-857bee0450ae None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:58.269002 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcb00e-aaa4-4e70-a06a-056d746fb409 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:58.307180 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:58.318885 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634303e1-e5a8-4280-be68-8e10bb9968e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:58.319551 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634303e1-e5a8-4280-be68-8e10bb9968e8 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:58.319828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634303e1-e5a8-4280-be68-8e10bb9968e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:58.320100 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634303e1-e5a8-4280-be68-8e10bb9968e8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:58.322487 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e8c15-f085-4351-9ccc-857bee0450ae None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:58.336559 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634303e1-e5a8-4280-be68-8e10bb9968e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:58.343562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-634303e1-e5a8-4280-be68-8e10bb9968e8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:35:58.343562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:58.343562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:58.343562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:58.343562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:58.343562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:58.343562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:58.343562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:58.343562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:58.343562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:58.343562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:58.343562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:58.343562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:58.343562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:58.343562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:58.343562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:58.344481 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:58.344481 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:58.344481 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:58.344481 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:58.344481 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:58.344481 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:58.344481 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:58.344481 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:58.344481 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:58.344481 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:58.344481 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:58.344481 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:58.344481 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:58.344481 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:58.344481 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:58.344481 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:58.345293 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:58.345293 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:58.345293 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:58.345293 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:58.345293 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:58.345293 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:58.345293 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:58.345293 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:58.345293 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:58.345293 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:58.345293 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:35:58.345293 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:35:58.345922 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 93/190] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 24 04:35:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:58.346471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634303e1-e5a8-4280-be68-8e10bb9968e8 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:58.370483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364acb51-b626-474c-8c08-a9485ab5a9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:58.371176 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364acb51-b626-474c-8c08-a9485ab5a9e9 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:58.371456 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364acb51-b626-474c-8c08-a9485ab5a9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:58.372044 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364acb51-b626-474c-8c08-a9485ab5a9e9 None admin] PATH_INFO: `/v3/users/005fa3dee4e845ba9994e9f645d27931` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:58.387971 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364acb51-b626-474c-8c08-a9485ab5a9e9 None admin] RBAC: Authorizing `identity:get_user(user_id=005fa3dee4e845ba9994e9f645d27931)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:58.389493 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364acb51-b626-474c-8c08-a9485ab5a9e9 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:58.391332 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 98/191] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:35:58 2022] GET /identity/v3/users/005fa3dee4e845ba9994e9f645d27931 => generated 283 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:58.392525 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4ad20-4f1e-47c7-b52f-784976572035 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:58.392863 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4ad20-4f1e-47c7-b52f-784976572035 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:58.393611 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4ad20-4f1e-47c7-b52f-784976572035 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:58.394547 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 99/192] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:35:58.395100 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4ad20-4f1e-47c7-b52f-784976572035 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:58.424890 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:58.489089 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634303e1-e5a8-4280-be68-8e10bb9968e8 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:58.534329 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89274f-6c6e-413c-83a8-764888815f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:58.534879 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89274f-6c6e-413c-83a8-764888815f3a None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:58.535154 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89274f-6c6e-413c-83a8-764888815f3a None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:58.535421 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89274f-6c6e-413c-83a8-764888815f3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:58.536193 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89274f-6c6e-413c-83a8-764888815f3a None admin] RBAC: Adding query filter params (role.id=e2eda359ee274ff1914db224f7f9b383, scope.project.id=f5452f51521644e8b7e99328787a3cd2, user.id=8cd784bb521f420da48da77b1d52602f) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:58.536512 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89274f-6c6e-413c-83a8-764888815f3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:58.538118 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4ad20-4f1e-47c7-b52f-784976572035 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:58.538236 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89274f-6c6e-413c-83a8-764888815f3a None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:58.544673 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 94/193] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:35:58 2022] GET /identity/v3/role_assignments?user.id=8cd784bb521f420da48da77b1d52602f&scope.project.id=f5452f51521644e8b7e99328787a3cd2&role.id=e2eda359ee274ff1914db224f7f9b383 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:58.545958 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021c379-22cb-49cf-82da-d9098a76f316 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:58.546239 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021c379-22cb-49cf-82da-d9098a76f316 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:58.546509 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021c379-22cb-49cf-82da-d9098a76f316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:58.567129 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-9021c379-22cb-49cf-82da-d9098a76f316 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:35:58.568382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-9021c379-22cb-49cf-82da-d9098a76f316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:35:58.579099 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5350f-1777-48e8-9060-efce38359f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:58.580592 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5350f-1777-48e8-9060-efce38359f9e None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:58.581050 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5350f-1777-48e8-9060-efce38359f9e None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:58.581533 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5350f-1777-48e8-9060-efce38359f9e None admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:58.582561 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5350f-1777-48e8-9060-efce38359f9e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:58.583067 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5350f-1777-48e8-9060-efce38359f9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:58.584782 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5350f-1777-48e8-9060-efce38359f9e None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:58.597290 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 100/194] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:35:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:58.598731 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5350f-1777-48e8-9060-efce38359f9e None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:58.631457 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:58.651807 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 95/195] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:35:58.652517 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021c379-22cb-49cf-82da-d9098a76f316 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:58.786673 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:58.822692 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5350f-1777-48e8-9060-efce38359f9e None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:58.885899 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021c379-22cb-49cf-82da-d9098a76f316 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:58.895046 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df62ec-954c-4b80-bb25-12d2a5bdd8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:58.895729 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df62ec-954c-4b80-bb25-12d2a5bdd8b6 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:58.896007 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df62ec-954c-4b80-bb25-12d2a5bdd8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:58.896280 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df62ec-954c-4b80-bb25-12d2a5bdd8b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:58.926549 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1b4d2-86b7-4c77-8b29-53aa5348ffe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:58.927197 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1b4d2-86b7-4c77-8b29-53aa5348ffe4 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:58.927476 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1b4d2-86b7-4c77-8b29-53aa5348ffe4 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:58.928033 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1b4d2-86b7-4c77-8b29-53aa5348ffe4 None admin] PATH_INFO: `/v3/users/005fa3dee4e845ba9994e9f645d27931` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:58.929611 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe1b4d2-86b7-4c77-8b29-53aa5348ffe4 None admin] RBAC: Authorizing `identity:get_user(user_id=005fa3dee4e845ba9994e9f645d27931)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:58.931141 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe1b4d2-86b7-4c77-8b29-53aa5348ffe4 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:58.932847 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 96/196] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:35:58 2022] GET /identity/v3/users/005fa3dee4e845ba9994e9f645d27931 => generated 283 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:58.942584 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1b4d2-86b7-4c77-8b29-53aa5348ffe4 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:59.009919 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:59.027546 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df62ec-954c-4b80-bb25-12d2a5bdd8b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:59.029829 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df62ec-954c-4b80-bb25-12d2a5bdd8b6 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:59.074500 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1b4d2-86b7-4c77-8b29-53aa5348ffe4 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:59.122889 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc4303-2742-424a-ae68-6119ace7ca1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:59.123537 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc4303-2742-424a-ae68-6119ace7ca1b None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:59.123870 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc4303-2742-424a-ae68-6119ace7ca1b None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:59.124207 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc4303-2742-424a-ae68-6119ace7ca1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:59.160222 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:59.185905 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 101/197] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:35:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:59.186976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df62ec-954c-4b80-bb25-12d2a5bdd8b6 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:59.216244 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fc4303-2742-424a-ae68-6119ace7ca1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:59.218131 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fc4303-2742-424a-ae68-6119ace7ca1b None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:59.274383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:59.288588 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df62ec-954c-4b80-bb25-12d2a5bdd8b6 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:59.326806 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4477f3-d5be-493f-a196-59c96775653c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:59.327913 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4477f3-d5be-493f-a196-59c96775653c None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:59.328497 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 97/198] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:35:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:35:59.328742 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4477f3-d5be-493f-a196-59c96775653c None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:59.329834 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc4303-2742-424a-ae68-6119ace7ca1b None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:59.333950 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4477f3-d5be-493f-a196-59c96775653c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:59.344520 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4477f3-d5be-493f-a196-59c96775653c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:35:59.350225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-db4477f3-d5be-493f-a196-59c96775653c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:35:59.350225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:35:59.350225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:35:59.350225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:35:59.350225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:35:59.350225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:35:59.350225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:35:59.350225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:35:59.350225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:35:59.350225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:35:59.350225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:35:59.350225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:35:59.350225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:35:59.350225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:35:59.350225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:35:59.350225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:35:59.351113 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:35:59.351113 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:35:59.351113 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:35:59.351113 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:35:59.351113 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:35:59.351113 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:35:59.351113 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:35:59.351113 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:35:59.351113 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:35:59.351113 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:35:59.351113 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:35:59.351113 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:35:59.351113 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:35:59.351113 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:35:59.351113 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:35:59.351113 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:35:59.351867 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:35:59.351867 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:35:59.351867 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:35:59.351867 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:35:59.351867 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:35:59.351867 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:35:59.351867 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:35:59.351867 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:35:59.351867 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:35:59.351867 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:35:59.351867 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:35:59.351867 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:35:59.351867 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 102/199] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:35:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:35:59.352494 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4477f3-d5be-493f-a196-59c96775653c None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:59.401796 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:59.445033 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc4303-2742-424a-ae68-6119ace7ca1b None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:59.458177 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4477f3-d5be-493f-a196-59c96775653c None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:59.485980 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08004ed9-9b6f-4b28-aa7f-3d965b47c2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:59.487024 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08004ed9-9b6f-4b28-aa7f-3d965b47c2fd None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:59.487495 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08004ed9-9b6f-4b28-aa7f-3d965b47c2fd None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:59.487965 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08004ed9-9b6f-4b28-aa7f-3d965b47c2fd None admin] PATH_INFO: `/v3/projects/b74b66f35e054f368691db7e9bc5c219` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:59.489364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08004ed9-9b6f-4b28-aa7f-3d965b47c2fd None admin] RBAC: Authorizing `identity:get_project(project_id=b74b66f35e054f368691db7e9bc5c219)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:59.491083 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08004ed9-9b6f-4b28-aa7f-3d965b47c2fd None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:59.493432 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 98/200] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:35:59 2022] GET /identity/v3/projects/b74b66f35e054f368691db7e9bc5c219 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:59.494525 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08004ed9-9b6f-4b28-aa7f-3d965b47c2fd None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:59.494849 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa8959-b258-4be3-af7b-197664c47881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:59.495847 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa8959-b258-4be3-af7b-197664c47881 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:59.496246 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa8959-b258-4be3-af7b-197664c47881 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:59.496827 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa8959-b258-4be3-af7b-197664c47881 None admin] PATH_INFO: `/v3/projects/b74b66f35e054f368691db7e9bc5c219` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:59.498826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa8959-b258-4be3-af7b-197664c47881 None admin] RBAC: Authorizing `identity:get_project(project_id=b74b66f35e054f368691db7e9bc5c219)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:59.500685 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa8959-b258-4be3-af7b-197664c47881 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:59.502392 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 103/201] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:35:59 2022] GET /identity/v3/projects/b74b66f35e054f368691db7e9bc5c219 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:59.503251 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa8959-b258-4be3-af7b-197664c47881 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:59.523161 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:59.607874 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08004ed9-9b6f-4b28-aa7f-3d965b47c2fd None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:59.614822 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa8959-b258-4be3-af7b-197664c47881 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:59.641774 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:59.646691 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b81dfa-3a8a-4dd5-a40f-05d75c0a83fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:59.648622 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b81dfa-3a8a-4dd5-a40f-05d75c0a83fa None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:59.649196 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b81dfa-3a8a-4dd5-a40f-05d75c0a83fa None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:59.649703 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b81dfa-3a8a-4dd5-a40f-05d75c0a83fa None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:59.650592 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b81dfa-3a8a-4dd5-a40f-05d75c0a83fa None admin] RBAC: Adding query filter params (name=reader) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:59.651124 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b81dfa-3a8a-4dd5-a40f-05d75c0a83fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:59.652759 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b81dfa-3a8a-4dd5-a40f-05d75c0a83fa None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:59.653231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6ec80-bf62-41a6-8f59-e49a809ba50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:59.653909 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6ec80-bf62-41a6-8f59-e49a809ba50c None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:59.654205 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6ec80-bf62-41a6-8f59-e49a809ba50c None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:59.654525 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6ec80-bf62-41a6-8f59-e49a809ba50c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:59.655277 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a6ec80-bf62-41a6-8f59-e49a809ba50c None admin] RBAC: Adding query filter params (role.id=74ce7b72bcc94a8a8ad65c3db928e6ac, scope.project.id=b74b66f35e054f368691db7e9bc5c219, user.id=005fa3dee4e845ba9994e9f645d27931) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:59.655618 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a6ec80-bf62-41a6-8f59-e49a809ba50c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:59.657370 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a6ec80-bf62-41a6-8f59-e49a809ba50c None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:59.664151 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 104/202] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:35:59 2022] GET /identity/v3/role_assignments?user.id=005fa3dee4e845ba9994e9f645d27931&scope.project.id=b74b66f35e054f368691db7e9bc5c219&role.id=74ce7b72bcc94a8a8ad65c3db928e6ac => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:59.665036 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6ec80-bf62-41a6-8f59-e49a809ba50c None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:59.665506 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 99/203] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 24 04:35:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:59.671117 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b81dfa-3a8a-4dd5-a40f-05d75c0a83fa None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:59.768491 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:35:59.785583 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6ec80-bf62-41a6-8f59-e49a809ba50c None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:59.791793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b81dfa-3a8a-4dd5-a40f-05d75c0a83fa None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:35:59.825194 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd4694-74b3-4b33-b513-004c2dcabed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:59.826250 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd4694-74b3-4b33-b513-004c2dcabed9 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:59.826665 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd4694-74b3-4b33-b513-004c2dcabed9 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:59.827067 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd4694-74b3-4b33-b513-004c2dcabed9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:59.827968 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd4694-74b3-4b33-b513-004c2dcabed9 None admin] RBAC: Adding query filter params (role.id=3c2269f848184abd93ef97d02f6553e4, scope.project.id=b74b66f35e054f368691db7e9bc5c219, user.id=005fa3dee4e845ba9994e9f645d27931) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:35:59.828422 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd4694-74b3-4b33-b513-004c2dcabed9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:59.830541 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd4694-74b3-4b33-b513-004c2dcabed9 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:59.831884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ecffed-dbea-4a08-b8ee-72336655333d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:35:59.832666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecffed-dbea-4a08-b8ee-72336655333d None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:35:59.833070 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecffed-dbea-4a08-b8ee-72336655333d None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:35:59.833632 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecffed-dbea-4a08-b8ee-72336655333d None admin] PATH_INFO: `/v3/users/06012746b2a445c6b6b6b8324542ce1d` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:35:59.835563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ecffed-dbea-4a08-b8ee-72336655333d None admin] RBAC: Authorizing `identity:get_user(user_id=06012746b2a445c6b6b6b8324542ce1d)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:35:59.836600 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ecffed-dbea-4a08-b8ee-72336655333d None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:35:59.838568 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 105/205] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:35:59 2022] GET /identity/v3/role_assignments?user.id=005fa3dee4e845ba9994e9f645d27931&scope.project.id=b74b66f35e054f368691db7e9bc5c219&role.id=3c2269f848184abd93ef97d02f6553e4 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:59.841389 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 100/205] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:35:59 2022] GET /identity/v3/users/06012746b2a445c6b6b6b8324542ce1d => generated 289 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:35:59.844862 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd4694-74b3-4b33-b513-004c2dcabed9 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:35:59.911780 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:00.011683 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd4694-74b3-4b33-b513-004c2dcabed9 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:00.062468 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6affa-1c42-4bd5-b041-42ada6684ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:00.063904 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6affa-1c42-4bd5-b041-42ada6684ace None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:00.064519 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6affa-1c42-4bd5-b041-42ada6684ace None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:00.065014 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6affa-1c42-4bd5-b041-42ada6684ace None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:00.146777 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6affa-1c42-4bd5-b041-42ada6684ace None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:00.148634 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6affa-1c42-4bd5-b041-42ada6684ace None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:00.213136 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:00.286660 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 106/206] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:35:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:36:00.294468 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ecffed-dbea-4a08-b8ee-72336655333d None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:00.456193 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ecffed-dbea-4a08-b8ee-72336655333d None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:00.503780 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855813d5-aa3c-41c5-8168-91dad2c6ddd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:00.504357 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855813d5-aa3c-41c5-8168-91dad2c6ddd6 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:00.504634 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855813d5-aa3c-41c5-8168-91dad2c6ddd6 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:00.504906 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855813d5-aa3c-41c5-8168-91dad2c6ddd6 None admin] PATH_INFO: `/v3/projects/33beb4c6e7a44d5a823b242c69b5c231` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:00.506202 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855813d5-aa3c-41c5-8168-91dad2c6ddd6 None admin] RBAC: Authorizing `identity:get_project(project_id=33beb4c6e7a44d5a823b242c69b5c231)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:00.507668 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855813d5-aa3c-41c5-8168-91dad2c6ddd6 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:00.509329 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 101/207] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:36:00 2022] GET /identity/v3/projects/33beb4c6e7a44d5a823b242c69b5c231 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:00.515540 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6affa-1c42-4bd5-b041-42ada6684ace None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:00.581532 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f24c9-7231-4696-b588-d229b4e474cc None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:00.581902 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f24c9-7231-4696-b588-d229b4e474cc None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:00.582112 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f24c9-7231-4696-b588-d229b4e474cc None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:00.583481 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 102/208] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:36:00.591237 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997e3a7-594e-40c9-aa33-1e9f6bbde3ea None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:00.591521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997e3a7-594e-40c9-aa33-1e9f6bbde3ea None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:00.591781 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997e3a7-594e-40c9-aa33-1e9f6bbde3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:00.620716 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-9997e3a7-594e-40c9-aa33-1e9f6bbde3ea None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:00.624759 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-9997e3a7-594e-40c9-aa33-1e9f6bbde3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:00.660962 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:00.675692 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6affa-1c42-4bd5-b041-42ada6684ace None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:00.721484 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf6b98-c8d6-4d16-bb18-2f661d1f3880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:00.722433 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf6b98-c8d6-4d16-bb18-2f661d1f3880 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:00.722629 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 103/209] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:00.723082 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf6b98-c8d6-4d16-bb18-2f661d1f3880 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:00.723545 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf6b98-c8d6-4d16-bb18-2f661d1f3880 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:00.723963 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764629f-60b1-4820-bb7a-930739a5d1bf None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:00.724253 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764629f-60b1-4820-bb7a-930739a5d1bf None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:00.724528 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764629f-60b1-4820-bb7a-930739a5d1bf None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:00.725032 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf6b98-c8d6-4d16-bb18-2f661d1f3880 None admin] RBAC: Adding query filter params (role.id=12d1e39175d748a09df9a7263b578070, scope.project.id=33beb4c6e7a44d5a823b242c69b5c231, user.id=06012746b2a445c6b6b6b8324542ce1d) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:00.725592 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf6b98-c8d6-4d16-bb18-2f661d1f3880 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:00.725814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 104/210] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:00.727434 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf6b98-c8d6-4d16-bb18-2f661d1f3880 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:00.737359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8e015-baba-41ab-b5d1-51e286a73dbb None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:00.737359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8e015-baba-41ab-b5d1-51e286a73dbb None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:00.737359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8e015-baba-41ab-b5d1-51e286a73dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:00.751477 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 107/211] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:36:00 2022] GET /identity/v3/role_assignments?user.id=06012746b2a445c6b6b6b8324542ce1d&scope.project.id=33beb4c6e7a44d5a823b242c69b5c231&role.id=12d1e39175d748a09df9a7263b578070 => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:00.766681 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-08e8e015-baba-41ab-b5d1-51e286a73dbb None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:00.767984 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-08e8e015-baba-41ab-b5d1-51e286a73dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:00.865385 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 105/212] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:36:01.019957 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf6b98-c8d6-4d16-bb18-2f661d1f3880 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:01.029967 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:01.144292 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf6b98-c8d6-4d16-bb18-2f661d1f3880 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:01.184352 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb3ba8-be24-4c28-810b-f21145a6850e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:01.185003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb3ba8-be24-4c28-810b-f21145a6850e None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:01.185284 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb3ba8-be24-4c28-810b-f21145a6850e None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:01.185604 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb3ba8-be24-4c28-810b-f21145a6850e None admin] PATH_INFO: `/v3/roles/member` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:01.197210 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeb3ba8-be24-4c28-810b-f21145a6850e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:01.202478 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-aaeb3ba8-be24-4c28-810b-f21145a6850e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:36:01.202478 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:01.202478 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:01.202478 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:01.202478 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:01.202478 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:01.202478 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:01.202478 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:01.202478 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:01.202478 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:01.202478 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:01.202478 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:01.202478 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:01.202478 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:01.202478 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:01.202478 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:01.203329 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:01.203329 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:01.203329 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:01.203329 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:01.203329 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:01.203329 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:01.203329 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:01.203329 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:01.203329 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:01.203329 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:01.203329 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:01.203329 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:01.203329 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:01.203329 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:01.203329 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:01.203329 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:01.204080 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:01.204080 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:01.204080 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:01.204080 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:01.204080 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:01.204080 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:01.204080 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:01.204080 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:01.204080 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:01.204080 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:01.204080 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:36:01.204080 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:01.204080 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 108/213] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:36:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:01.209661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8e015-baba-41ab-b5d1-51e286a73dbb None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:01.269250 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb3ba8-be24-4c28-810b-f21145a6850e None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:01.304787 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:01.340264 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8e015-baba-41ab-b5d1-51e286a73dbb None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:01.368873 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:01.387762 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff5a8b4-62c5-403a-ad91-9b96763db97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:01.388475 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5a8b4-62c5-403a-ad91-9b96763db97f None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:01.388752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5a8b4-62c5-403a-ad91-9b96763db97f None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:01.389113 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5a8b4-62c5-403a-ad91-9b96763db97f None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:01.389815 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff5a8b4-62c5-403a-ad91-9b96763db97f None admin] RBAC: Adding query filter params (name=member) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:01.390113 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff5a8b4-62c5-403a-ad91-9b96763db97f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:01.391591 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff5a8b4-62c5-403a-ad91-9b96763db97f None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:01.403326 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 106/214] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 24 04:36:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:01.407875 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb3ba8-be24-4c28-810b-f21145a6850e None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:01.408648 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff5a8b4-62c5-403a-ad91-9b96763db97f None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:01.446029 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68943515-ccee-4b25-a3a0-f322f1a43722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:01.446029 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68943515-ccee-4b25-a3a0-f322f1a43722 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:01.446370 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68943515-ccee-4b25-a3a0-f322f1a43722 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:01.446535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68943515-ccee-4b25-a3a0-f322f1a43722 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:01.447772 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68943515-ccee-4b25-a3a0-f322f1a43722 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:01.449364 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68943515-ccee-4b25-a3a0-f322f1a43722 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:01.451159 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 109/215] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:01.456483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68943515-ccee-4b25-a3a0-f322f1a43722 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:01.547915 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff5a8b4-62c5-403a-ad91-9b96763db97f None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:01.560926 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68943515-ccee-4b25-a3a0-f322f1a43722 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:01.594390 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39456692-8ed5-434c-8cea-7648b24dc68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:01.595341 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39456692-8ed5-434c-8cea-7648b24dc68d None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:01.595819 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39456692-8ed5-434c-8cea-7648b24dc68d None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:01.595922 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d9363f-d424-48ea-9645-f44c0e33c276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:01.596434 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39456692-8ed5-434c-8cea-7648b24dc68d None admin] PATH_INFO: `/v3/users/fa3f80da6d39443cbff73407b6ce388e` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:01.596547 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9363f-d424-48ea-9645-f44c0e33c276 None admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:01.596790 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9363f-d424-48ea-9645-f44c0e33c276 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:01.597060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9363f-d424-48ea-9645-f44c0e33c276 None admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:01.597851 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d9363f-d424-48ea-9645-f44c0e33c276 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:01.599398 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d9363f-d424-48ea-9645-f44c0e33c276 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:01.608025 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:01.611523 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:01.616334 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39456692-8ed5-434c-8cea-7648b24dc68d None admin] RBAC: Authorizing `identity:get_user(user_id=fa3f80da6d39443cbff73407b6ce388e)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:01.618057 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39456692-8ed5-434c-8cea-7648b24dc68d None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:01.621863 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 107/216] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:36:01 2022] GET /identity/v3/users/fa3f80da6d39443cbff73407b6ce388e => generated 297 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:01.627874 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39456692-8ed5-434c-8cea-7648b24dc68d None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:01.637368 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 110/217] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 24 04:36:01 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:36:01.746948 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39456692-8ed5-434c-8cea-7648b24dc68d None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:01.783774 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c695c2-fddc-4946-b995-2b21e9480ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:01.784397 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c695c2-fddc-4946-b995-2b21e9480ed3 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:01.784664 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c695c2-fddc-4946-b995-2b21e9480ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:01.784935 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c695c2-fddc-4946-b995-2b21e9480ed3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:01.861121 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:01.866339 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c695c2-fddc-4946-b995-2b21e9480ed3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:01.867956 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c695c2-fddc-4946-b995-2b21e9480ed3 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:01.974740 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 108/218] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:36:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:36:01.980359 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d9363f-d424-48ea-9645-f44c0e33c276 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:02.027960 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e7ff7-e5d6-4d99-8862-335630dd90a6 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:02.028473 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e7ff7-e5d6-4d99-8862-335630dd90a6 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:02.028881 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e7ff7-e5d6-4d99-8862-335630dd90a6 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:02.030434 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 109/219] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:36:02.035912 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269cc56-9509-4758-a07a-5fa16bb4fb8d None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:02.036459 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269cc56-9509-4758-a07a-5fa16bb4fb8d None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:02.036919 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269cc56-9509-4758-a07a-5fa16bb4fb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:02.059945 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-1269cc56-9509-4758-a07a-5fa16bb4fb8d None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:02.061507 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-1269cc56-9509-4758-a07a-5fa16bb4fb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:02.104901 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d9363f-d424-48ea-9645-f44c0e33c276 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:02.140330 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 110/220] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:02.153329 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bd458-9d34-42ba-8315-72ce2567a66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:02.153329 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bd458-9d34-42ba-8315-72ce2567a66d None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:02.153329 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bd458-9d34-42ba-8315-72ce2567a66d None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:02.153329 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bd458-9d34-42ba-8315-72ce2567a66d None admin] PATH_INFO: `/v3/projects/b74b66f35e054f368691db7e9bc5c219` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:02.154052 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7bd458-9d34-42ba-8315-72ce2567a66d None admin] RBAC: Authorizing `identity:get_project(project_id=b74b66f35e054f368691db7e9bc5c219)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:02.155519 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7bd458-9d34-42ba-8315-72ce2567a66d None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:02.161475 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 111/221] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:36:01 2022] GET /identity/v3/projects/b74b66f35e054f368691db7e9bc5c219 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:02.163388 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269cc56-9509-4758-a07a-5fa16bb4fb8d None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:02.193787 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:02.226636 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2517b04-662b-4566-96f9-b48c5163dd74 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:02.227069 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2517b04-662b-4566-96f9-b48c5163dd74 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:02.227476 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2517b04-662b-4566-96f9-b48c5163dd74 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:02.229057 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 112/222] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:36:02.239153 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e375f-9ea2-4d16-a9bf-530fe76ed6da None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:02.239515 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e375f-9ea2-4d16-a9bf-530fe76ed6da None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:02.239856 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e375f-9ea2-4d16-a9bf-530fe76ed6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:02.270824 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-7f6e375f-9ea2-4d16-a9bf-530fe76ed6da None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:02.272035 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-7f6e375f-9ea2-4d16-a9bf-530fe76ed6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:02.281612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269cc56-9509-4758-a07a-5fa16bb4fb8d None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:02.346106 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360310e-d095-4dc8-8474-71aba9cdccca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:02.346723 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360310e-d095-4dc8-8474-71aba9cdccca None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:02.347012 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360310e-d095-4dc8-8474-71aba9cdccca None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:02.347285 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360310e-d095-4dc8-8474-71aba9cdccca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:02.348035 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4360310e-d095-4dc8-8474-71aba9cdccca None admin] RBAC: Adding query filter params (role.id=e2eda359ee274ff1914db224f7f9b383, scope.project.id=b74b66f35e054f368691db7e9bc5c219, user.id=fa3f80da6d39443cbff73407b6ce388e) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:02.348345 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4360310e-d095-4dc8-8474-71aba9cdccca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:02.349807 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:02.349916 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4360310e-d095-4dc8-8474-71aba9cdccca None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:02.356072 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 111/223] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:36:02 2022] GET /identity/v3/role_assignments?user.id=fa3f80da6d39443cbff73407b6ce388e&scope.project.id=b74b66f35e054f368691db7e9bc5c219&role.id=e2eda359ee274ff1914db224f7f9b383 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:02.379123 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 113/224] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:02.456257 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360310e-d095-4dc8-8474-71aba9cdccca None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:02.581770 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:02.591879 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360310e-d095-4dc8-8474-71aba9cdccca None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:02.640487 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da76d1c-168f-4cc6-847e-3ad5c67259f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:02.641138 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da76d1c-168f-4cc6-847e-3ad5c67259f0 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:02.641897 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da76d1c-168f-4cc6-847e-3ad5c67259f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:02.642373 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da76d1c-168f-4cc6-847e-3ad5c67259f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:02.658937 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da76d1c-168f-4cc6-847e-3ad5c67259f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:02.663737 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-3da76d1c-168f-4cc6-847e-3ad5c67259f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:36:02.663737 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:02.663737 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:02.663737 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:02.663737 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:02.663737 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:02.663737 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:02.663737 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:02.663737 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:02.663737 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:02.663737 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:02.663737 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:02.663737 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:02.663737 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:02.663737 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:02.663737 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:02.665975 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:02.665975 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:02.665975 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:02.665975 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:02.665975 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:02.665975 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:02.665975 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:02.665975 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:02.665975 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:02.665975 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:02.665975 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:02.665975 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:02.665975 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:02.665975 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:02.665975 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:02.665975 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:02.667811 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:02.667811 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:02.667811 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:02.667811 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:02.667811 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:02.667811 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:02.667811 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:02.667811 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:02.667811 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:02.667811 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:02.667811 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:36:02.667811 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:02.667811 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 112/225] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 24 04:36:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:02.675232 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e375f-9ea2-4d16-a9bf-530fe76ed6da None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:02.721702 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da76d1c-168f-4cc6-847e-3ad5c67259f0 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:02.840050 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da76d1c-168f-4cc6-847e-3ad5c67259f0 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:02.893621 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55083ecd-8a5e-4c71-a54a-cfd9265efa27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:02.894320 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55083ecd-8a5e-4c71-a54a-cfd9265efa27 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:02.894699 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55083ecd-8a5e-4c71-a54a-cfd9265efa27 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:02.895037 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55083ecd-8a5e-4c71-a54a-cfd9265efa27 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:02.917359 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e375f-9ea2-4d16-a9bf-530fe76ed6da None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:02.921190 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55083ecd-8a5e-4c71-a54a-cfd9265efa27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:02.931666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-55083ecd-8a5e-4c71-a54a-cfd9265efa27 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:36:02.931666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:02.931666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:02.931666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:02.931666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:02.931666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:02.931666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:02.931666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:02.931666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:02.931666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:02.931666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:02.931666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:02.931666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:02.931666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:02.931666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:02.931666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:02.932526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:02.932526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:02.932526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:02.932526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:02.932526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:02.932526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:02.932526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:02.932526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:02.932526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:02.932526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:02.932526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:02.932526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:02.932526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:02.932526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:02.932526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:02.932526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:02.933276 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:02.933276 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:02.933276 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:02.933276 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:02.933276 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:02.933276 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:02.933276 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:02.933276 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:02.933276 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:02.933276 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:02.933276 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:36:02.933276 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:02.933276 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 113/226] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 24 04:36:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:02.938982 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55083ecd-8a5e-4c71-a54a-cfd9265efa27 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:02.965310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:02.988917 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6adf1-0a09-4d76-ade8-aebfcc90cdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:02.989479 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6adf1-0a09-4d76-ade8-aebfcc90cdbe None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:02.989801 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6adf1-0a09-4d76-ade8-aebfcc90cdbe None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:02.990074 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b6adf1-0a09-4d76-ade8-aebfcc90cdbe None admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:02.990749 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6adf1-0a09-4d76-ade8-aebfcc90cdbe None admin] RBAC: Adding query filter params (name=admin) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:02.991048 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6adf1-0a09-4d76-ade8-aebfcc90cdbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:02.992540 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b6adf1-0a09-4d76-ade8-aebfcc90cdbe None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:03.002241 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 114/227] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:36:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:03.007903 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6adf1-0a09-4d76-ade8-aebfcc90cdbe None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:03.075220 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55083ecd-8a5e-4c71-a54a-cfd9265efa27 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:03.113217 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3683c17-164c-4c18-92de-87d4ea0ba432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:03.113946 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3683c17-164c-4c18-92de-87d4ea0ba432 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:03.114396 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3683c17-164c-4c18-92de-87d4ea0ba432 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:03.114777 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:03.115903 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3683c17-164c-4c18-92de-87d4ea0ba432 None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:03.116756 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3683c17-164c-4c18-92de-87d4ea0ba432 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:03.117061 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3683c17-164c-4c18-92de-87d4ea0ba432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:03.119344 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3683c17-164c-4c18-92de-87d4ea0ba432 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:03.133855 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 114/228] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:03.137243 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3683c17-164c-4c18-92de-87d4ea0ba432 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:03.227230 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b6adf1-0a09-4d76-ade8-aebfcc90cdbe None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:03.253778 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:03.265852 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3683c17-164c-4c18-92de-87d4ea0ba432 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:03.286628 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c1a22-c7be-4e93-8e20-178411c3d986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:03.287286 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c1a22-c7be-4e93-8e20-178411c3d986 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:03.287564 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c1a22-c7be-4e93-8e20-178411c3d986 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:03.287835 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c1a22-c7be-4e93-8e20-178411c3d986 None admin] PATH_INFO: `/v3/users/005fa3dee4e845ba9994e9f645d27931` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:03.294093 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34c1a22-c7be-4e93-8e20-178411c3d986 None admin] RBAC: Authorizing `identity:get_user(user_id=005fa3dee4e845ba9994e9f645d27931)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:03.295561 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34c1a22-c7be-4e93-8e20-178411c3d986 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:03.297730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 115/229] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:36:03 2022] GET /identity/v3/users/005fa3dee4e845ba9994e9f645d27931 => generated 283 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:03.302959 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069c78f-f46f-4243-8ee9-67e60fac4dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:03.303382 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c1a22-c7be-4e93-8e20-178411c3d986 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:03.304278 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069c78f-f46f-4243-8ee9-67e60fac4dd2 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:03.304648 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069c78f-f46f-4243-8ee9-67e60fac4dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:03.305043 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069c78f-f46f-4243-8ee9-67e60fac4dd2 None admin] PATH_INFO: `/v3/users/005fa3dee4e845ba9994e9f645d27931` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:03.306351 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7069c78f-f46f-4243-8ee9-67e60fac4dd2 None admin] RBAC: Authorizing `identity:get_user(user_id=005fa3dee4e845ba9994e9f645d27931)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:03.307960 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7069c78f-f46f-4243-8ee9-67e60fac4dd2 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:03.310079 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 115/230] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:36:03 2022] GET /identity/v3/users/005fa3dee4e845ba9994e9f645d27931 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:03.326956 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069c78f-f46f-4243-8ee9-67e60fac4dd2 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:03.434145 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069c78f-f46f-4243-8ee9-67e60fac4dd2 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:03.499616 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4afd10d-ddee-4021-b851-d5692a0d4342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:03.500256 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afd10d-ddee-4021-b851-d5692a0d4342 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:03.500530 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afd10d-ddee-4021-b851-d5692a0d4342 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:03.500796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4afd10d-ddee-4021-b851-d5692a0d4342 None admin] PATH_INFO: `/v3/projects/b74b66f35e054f368691db7e9bc5c219` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:03.503664 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4afd10d-ddee-4021-b851-d5692a0d4342 None admin] RBAC: Authorizing `identity:get_project(project_id=b74b66f35e054f368691db7e9bc5c219)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:03.505400 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4afd10d-ddee-4021-b851-d5692a0d4342 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:03.507283 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 116/231] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:36:03 2022] GET /identity/v3/projects/b74b66f35e054f368691db7e9bc5c219 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:03.513457 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4afd10d-ddee-4021-b851-d5692a0d4342 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:03.524174 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c1a22-c7be-4e93-8e20-178411c3d986 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:03.541704 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:03.562006 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:03.598830 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffc2a0-3b91-4ebe-9331-c93be78da7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:03.599542 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffc2a0-3b91-4ebe-9331-c93be78da7c2 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:03.599816 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffc2a0-3b91-4ebe-9331-c93be78da7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:03.600084 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffc2a0-3b91-4ebe-9331-c93be78da7c2 None admin] PATH_INFO: `/v3/projects/b74b66f35e054f368691db7e9bc5c219` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:03.601633 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ffc2a0-3b91-4ebe-9331-c93be78da7c2 None admin] RBAC: Authorizing `identity:get_project(project_id=b74b66f35e054f368691db7e9bc5c219)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:03.603152 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ffc2a0-3b91-4ebe-9331-c93be78da7c2 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:03.605006 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 116/232] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:36:03 2022] GET /identity/v3/projects/b74b66f35e054f368691db7e9bc5c219 => generated 302 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:03.610516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffc2a0-3b91-4ebe-9331-c93be78da7c2 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:03.671936 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4afd10d-ddee-4021-b851-d5692a0d4342 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:03.707282 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a26b780-9b9b-4d53-83cf-b35b4116f34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:03.708037 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26b780-9b9b-4d53-83cf-b35b4116f34b None admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:03.708352 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26b780-9b9b-4d53-83cf-b35b4116f34b None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:03.708667 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26b780-9b9b-4d53-83cf-b35b4116f34b None admin] PATH_INFO: `/v3/projects/b74b66f35e054f368691db7e9bc5c219/users/005fa3dee4e845ba9994e9f645d27931/roles/3c2269f848184abd93ef97d02f6553e4` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:03.711163 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a26b780-9b9b-4d53-83cf-b35b4116f34b None admin] RBAC: Authorizing `identity:create_grant(project_id=b74b66f35e054f368691db7e9bc5c219, user_id=005fa3dee4e845ba9994e9f645d27931, role_id=3c2269f848184abd93ef97d02f6553e4)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:03.712964 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a26b780-9b9b-4d53-83cf-b35b4116f34b None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:03.740806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 117/233] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 24 04:36:03 2022] PUT /identity/v3/projects/b74b66f35e054f368691db7e9bc5c219/users/005fa3dee4e845ba9994e9f645d27931/roles/3c2269f848184abd93ef97d02f6553e4 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:36:03.799598 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffc2a0-3b91-4ebe-9331-c93be78da7c2 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:03.859292 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae32d0-ca69-43e8-9d07-9246c37b6ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:03.859997 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae32d0-ca69-43e8-9d07-9246c37b6ba6 None admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:03.860280 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae32d0-ca69-43e8-9d07-9246c37b6ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:03.860554 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae32d0-ca69-43e8-9d07-9246c37b6ba6 None admin] PATH_INFO: `/v3/projects/b74b66f35e054f368691db7e9bc5c219/users/005fa3dee4e845ba9994e9f645d27931/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:03.862736 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae32d0-ca69-43e8-9d07-9246c37b6ba6 None admin] RBAC: Authorizing `identity:create_grant(project_id=b74b66f35e054f368691db7e9bc5c219, user_id=005fa3dee4e845ba9994e9f645d27931, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:03.864263 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae32d0-ca69-43e8-9d07-9246c37b6ba6 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:03.888458 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 117/234] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 24 04:36:03 2022] PUT /identity/v3/projects/b74b66f35e054f368691db7e9bc5c219/users/005fa3dee4e845ba9994e9f645d27931/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:36:04.165187 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3710a6-0bb0-42dc-b82b-97b044e5760c None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:04.165565 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3710a6-0bb0-42dc-b82b-97b044e5760c None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:04.165784 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3710a6-0bb0-42dc-b82b-97b044e5760c None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:04.167245 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 118/235] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:04.173051 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b7150-0446-4678-bf53-d51b77ad4838 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:04.173350 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b7150-0446-4678-bf53-d51b77ad4838 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:04.173633 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b7150-0446-4678-bf53-d51b77ad4838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:04.193868 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-555b7150-0446-4678-bf53-d51b77ad4838 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:04.195089 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-555b7150-0446-4678-bf53-d51b77ad4838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:04.251283 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:04.291889 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 118/236] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:04.449597 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684265f5-2a28-48f5-8558-5104a0765859 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:04.450103 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684265f5-2a28-48f5-8558-5104a0765859 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:04.450103 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684265f5-2a28-48f5-8558-5104a0765859 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:04.451713 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 119/237] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:04.457682 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a750ff-dbca-46a9-91c1-8fca01d42dcb None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:04.458010 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a750ff-dbca-46a9-91c1-8fca01d42dcb None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:04.458291 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a750ff-dbca-46a9-91c1-8fca01d42dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:04.483204 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-12a750ff-dbca-46a9-91c1-8fca01d42dcb None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:04.484415 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-12a750ff-dbca-46a9-91c1-8fca01d42dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:04.554271 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292af0f2-7a9b-4ad9-afc2-91b03e154f39 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:04.554554 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292af0f2-7a9b-4ad9-afc2-91b03e154f39 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:04.554828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292af0f2-7a9b-4ad9-afc2-91b03e154f39 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:04.556469 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 120/238] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:36:04.563803 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412a86c-53a0-4fc0-9ec5-d10089ecb839 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:04.564098 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412a86c-53a0-4fc0-9ec5-d10089ecb839 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:04.564350 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412a86c-53a0-4fc0-9ec5-d10089ecb839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:04.575023 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 119/239] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:04.595789 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-a412a86c-53a0-4fc0-9ec5-d10089ecb839 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:04.597028 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-a412a86c-53a0-4fc0-9ec5-d10089ecb839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:04.666515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:04.673225 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 121/240] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:36:04.745188 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a750ff-dbca-46a9-91c1-8fca01d42dcb None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:04.884343 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a750ff-dbca-46a9-91c1-8fca01d42dcb None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:04.896007 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:04.923749 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d86cd-b994-44af-a0ff-00fead5d3ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:04.924679 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d86cd-b994-44af-a0ff-00fead5d3ca8 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:04.925146 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d86cd-b994-44af-a0ff-00fead5d3ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:04.925453 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d86cd-b994-44af-a0ff-00fead5d3ca8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:04.937460 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d86cd-b994-44af-a0ff-00fead5d3ca8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:04.942540 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-7f2d86cd-b994-44af-a0ff-00fead5d3ca8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:36:04.942540 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:04.942540 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:04.942540 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:04.942540 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:04.942540 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:04.942540 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:04.942540 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:04.942540 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:04.942540 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:04.942540 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:04.942540 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:04.942540 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:04.942540 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:04.942540 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:04.942540 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:04.943388 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:04.943388 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:04.943388 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:04.943388 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:04.943388 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:04.943388 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:04.943388 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:04.943388 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:04.943388 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:04.943388 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:04.943388 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:04.943388 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:04.943388 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:04.943388 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:04.943388 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:04.943388 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:04.944146 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:04.944146 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:04.944146 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:04.944146 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:04.944146 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:04.944146 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:04.944146 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:04.944146 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:04.944146 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:04.944146 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:04.944146 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:36:04.944146 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:04.944146 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 120/241] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:36:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:04.949789 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412a86c-53a0-4fc0-9ec5-d10089ecb839 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:04.968251 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d86cd-b994-44af-a0ff-00fead5d3ca8 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:05.068852 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412a86c-53a0-4fc0-9ec5-d10089ecb839 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:05.110365 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840832c-309d-47e8-862b-583569453dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:05.111683 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840832c-309d-47e8-862b-583569453dce None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:05.112430 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840832c-309d-47e8-862b-583569453dce None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:05.112958 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840832c-309d-47e8-862b-583569453dce None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:05.113999 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840832c-309d-47e8-862b-583569453dce None admin] RBAC: Adding query filter params (name=reader) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:05.114518 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840832c-309d-47e8-862b-583569453dce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:05.116684 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840832c-309d-47e8-862b-583569453dce None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:05.128617 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 122/242] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 24 04:36:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:05.130029 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840832c-309d-47e8-862b-583569453dce None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:05.134475 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d86cd-b994-44af-a0ff-00fead5d3ca8 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:05.184463 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a9eb2-a130-4a21-b729-85411231e17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:05.185104 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a9eb2-a130-4a21-b729-85411231e17d None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:05.185419 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a9eb2-a130-4a21-b729-85411231e17d None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:05.185691 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a9eb2-a130-4a21-b729-85411231e17d None admin] PATH_INFO: `/v3/domains/default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:05.186815 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a9eb2-a130-4a21-b729-85411231e17d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:05.188788 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1a9eb2-a130-4a21-b729-85411231e17d None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:05.190862 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 121/243] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:05.191767 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a9eb2-a130-4a21-b729-85411231e17d None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:05.217581 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:05.236378 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:05.267058 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840832c-309d-47e8-862b-583569453dce None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:05.304528 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd97ed-7bb4-484b-832c-dc8ca21dcfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:05.305158 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd97ed-7bb4-484b-832c-dc8ca21dcfad None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:05.305468 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd97ed-7bb4-484b-832c-dc8ca21dcfad None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:05.305740 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd97ed-7bb4-484b-832c-dc8ca21dcfad None admin] PATH_INFO: `/v3/roles/member` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:05.317163 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd97ed-7bb4-484b-832c-dc8ca21dcfad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:05.317620 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1a9eb2-a130-4a21-b729-85411231e17d None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:05.322751 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-5bfd97ed-7bb4-484b-832c-dc8ca21dcfad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:36:05.322751 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:05.322751 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:05.322751 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:05.322751 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:05.322751 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:05.322751 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:05.322751 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:05.322751 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:05.322751 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:05.322751 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:05.322751 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:05.322751 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:05.322751 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:05.322751 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:05.322751 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:05.323604 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:05.323604 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:05.323604 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:05.323604 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:05.323604 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:05.323604 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:05.323604 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:05.323604 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:05.323604 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:05.323604 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:05.323604 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:05.323604 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:05.323604 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:05.323604 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:05.323604 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:05.323604 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:05.324361 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:05.324361 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:05.324361 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:05.324361 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:05.324361 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:05.324361 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:05.324361 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:05.324361 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:05.324361 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:05.324361 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:05.324361 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:36:05.324361 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:05.328989 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 123/244] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:36:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:05.329956 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd97ed-7bb4-484b-832c-dc8ca21dcfad None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:05.360631 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada031fb-f084-4acb-85af-1f0d12324024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:05.361724 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada031fb-f084-4acb-85af-1f0d12324024 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:05.362203 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada031fb-f084-4acb-85af-1f0d12324024 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:05.362671 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada031fb-f084-4acb-85af-1f0d12324024 None admin] PATH_INFO: `/v3/users/aac5621f66b94887a9eb9ba5121f6c24` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:05.379783 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada031fb-f084-4acb-85af-1f0d12324024 None admin] RBAC: Authorizing `identity:get_user(user_id=aac5621f66b94887a9eb9ba5121f6c24)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:05.381831 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada031fb-f084-4acb-85af-1f0d12324024 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:05.384010 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 122/245] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:36:05 2022] GET /identity/v3/users/aac5621f66b94887a9eb9ba5121f6c24 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:05.385122 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada031fb-f084-4acb-85af-1f0d12324024 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:05.444996 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd97ed-7bb4-484b-832c-dc8ca21dcfad None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:05.469947 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:05.483146 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c553a7-ac7b-46a1-93b6-6f417441228a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:05.483773 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c553a7-ac7b-46a1-93b6-6f417441228a None admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:05.484049 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c553a7-ac7b-46a1-93b6-6f417441228a None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:05.484319 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c553a7-ac7b-46a1-93b6-6f417441228a None admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:05.484991 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c553a7-ac7b-46a1-93b6-6f417441228a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:05.486663 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c553a7-ac7b-46a1-93b6-6f417441228a None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:05.490856 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:05.503414 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada031fb-f084-4acb-85af-1f0d12324024 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:05.515980 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 124/246] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 24 04:36:05 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:36:05.517599 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c553a7-ac7b-46a1-93b6-6f417441228a None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:05.546432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92925b2c-85b0-4466-a9b4-a8d97af6558d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:05.547667 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92925b2c-85b0-4466-a9b4-a8d97af6558d None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:05.547667 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92925b2c-85b0-4466-a9b4-a8d97af6558d None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:05.548047 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92925b2c-85b0-4466-a9b4-a8d97af6558d None admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:05.548871 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92925b2c-85b0-4466-a9b4-a8d97af6558d None admin] RBAC: Adding query filter params (name=member) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:05.549316 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92925b2c-85b0-4466-a9b4-a8d97af6558d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:05.551070 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92925b2c-85b0-4466-a9b4-a8d97af6558d None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:05.562447 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 123/247] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 24 04:36:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:05.582969 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92925b2c-85b0-4466-a9b4-a8d97af6558d None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:05.654905 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c553a7-ac7b-46a1-93b6-6f417441228a None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:05.704166 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75599d7-4b69-411e-afed-89beb2eb57e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:05.708468 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75599d7-4b69-411e-afed-89beb2eb57e0 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:05.709088 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75599d7-4b69-411e-afed-89beb2eb57e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:05.709701 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75599d7-4b69-411e-afed-89beb2eb57e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:05.789555 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:05.791928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92925b2c-85b0-4466-a9b4-a8d97af6558d None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:05.815844 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75599d7-4b69-411e-afed-89beb2eb57e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:05.817663 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75599d7-4b69-411e-afed-89beb2eb57e0 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:05.834174 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37119d0a-1d0c-4b2f-9907-7e5ca41e6ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:05.834747 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37119d0a-1d0c-4b2f-9907-7e5ca41e6ed6 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:05.835026 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37119d0a-1d0c-4b2f-9907-7e5ca41e6ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:05.835294 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37119d0a-1d0c-4b2f-9907-7e5ca41e6ed6 None admin] PATH_INFO: `/v3/users/fa3f80da6d39443cbff73407b6ce388e` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:05.836596 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37119d0a-1d0c-4b2f-9907-7e5ca41e6ed6 None admin] RBAC: Authorizing `identity:get_user(user_id=fa3f80da6d39443cbff73407b6ce388e)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:05.838139 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37119d0a-1d0c-4b2f-9907-7e5ca41e6ed6 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:05.839870 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 124/248] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:36:05 2022] GET /identity/v3/users/fa3f80da6d39443cbff73407b6ce388e => generated 297 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:05.846862 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37119d0a-1d0c-4b2f-9907-7e5ca41e6ed6 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:05.883269 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:05.954531 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 125/249] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:36:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:36:05.961542 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75599d7-4b69-411e-afed-89beb2eb57e0 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:05.972755 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37119d0a-1d0c-4b2f-9907-7e5ca41e6ed6 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:06.009628 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc11c0d-fcd1-427a-9edb-439144bfc135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:06.010290 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc11c0d-fcd1-427a-9edb-439144bfc135 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:06.010574 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc11c0d-fcd1-427a-9edb-439144bfc135 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:06.010847 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc11c0d-fcd1-427a-9edb-439144bfc135 None admin] PATH_INFO: `/v3/projects/b74b66f35e054f368691db7e9bc5c219` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:06.012132 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc11c0d-fcd1-427a-9edb-439144bfc135 None admin] RBAC: Authorizing `identity:get_project(project_id=b74b66f35e054f368691db7e9bc5c219)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:06.014032 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc11c0d-fcd1-427a-9edb-439144bfc135 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:06.015597 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 125/250] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:36:05 2022] GET /identity/v3/projects/b74b66f35e054f368691db7e9bc5c219 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:06.021607 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc11c0d-fcd1-427a-9edb-439144bfc135 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:06.069909 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:06.097202 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75599d7-4b69-411e-afed-89beb2eb57e0 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:06.137220 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:06.140340 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011ccd3-6325-471e-867b-598f13aa9105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:06.140980 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011ccd3-6325-471e-867b-598f13aa9105 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:06.141299 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011ccd3-6325-471e-867b-598f13aa9105 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:06.141598 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011ccd3-6325-471e-867b-598f13aa9105 None admin] PATH_INFO: `/v3/projects/b74b66f35e054f368691db7e9bc5c219` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:06.143199 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011ccd3-6325-471e-867b-598f13aa9105 None admin] RBAC: Authorizing `identity:get_project(project_id=b74b66f35e054f368691db7e9bc5c219)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:06.144207 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011ccd3-6325-471e-867b-598f13aa9105 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:06.146309 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 126/251] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:36:05 2022] GET /identity/v3/projects/b74b66f35e054f368691db7e9bc5c219 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:06.149870 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4ab6a-8f79-41dd-93bf-09143147a271 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:06.149870 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4ab6a-8f79-41dd-93bf-09143147a271 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:06.149870 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4ab6a-8f79-41dd-93bf-09143147a271 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:06.149870 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 127/252] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:06.155402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4ab6a-8f79-41dd-93bf-09143147a271 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:06.158898 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc11c0d-fcd1-427a-9edb-439144bfc135 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:06.206061 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40a1d7-3d2a-4f56-be34-285ca7d87f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:06.207295 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40a1d7-3d2a-4f56-be34-285ca7d87f75 None admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:06.207797 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40a1d7-3d2a-4f56-be34-285ca7d87f75 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:06.208308 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40a1d7-3d2a-4f56-be34-285ca7d87f75 None admin] PATH_INFO: `/v3/projects/b74b66f35e054f368691db7e9bc5c219/users/fa3f80da6d39443cbff73407b6ce388e/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:06.211745 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a40a1d7-3d2a-4f56-be34-285ca7d87f75 None admin] RBAC: Authorizing `identity:create_grant(project_id=b74b66f35e054f368691db7e9bc5c219, user_id=fa3f80da6d39443cbff73407b6ce388e, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:06.213523 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a40a1d7-3d2a-4f56-be34-285ca7d87f75 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:06.232577 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 126/253] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 24 04:36:06 2022] PUT /identity/v3/projects/b74b66f35e054f368691db7e9bc5c219/users/fa3f80da6d39443cbff73407b6ce388e/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:36:06.234424 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6889ccf-0727-4ce8-9074-140d179618f4 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:06.235452 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6889ccf-0727-4ce8-9074-140d179618f4 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:06.236760 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6889ccf-0727-4ce8-9074-140d179618f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:06.262456 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-d6889ccf-0727-4ce8-9074-140d179618f4 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:06.264511 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-d6889ccf-0727-4ce8-9074-140d179618f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:06.352360 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4ab6a-8f79-41dd-93bf-09143147a271 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:06.353813 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 127/254] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:06.356188 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1083d3a-fb9d-43f5-a830-e0f88887c7fd None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:06.356677 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1083d3a-fb9d-43f5-a830-e0f88887c7fd None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:06.357171 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1083d3a-fb9d-43f5-a830-e0f88887c7fd None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:06.359023 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 128/255] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:06.370833 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86ab73-1ba4-407e-a759-fd7ef8842bf8 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:06.371478 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86ab73-1ba4-407e-a759-fd7ef8842bf8 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:06.371938 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86ab73-1ba4-407e-a759-fd7ef8842bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:06.402409 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-1f86ab73-1ba4-407e-a759-fd7ef8842bf8 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:06.409373 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-1f86ab73-1ba4-407e-a759-fd7ef8842bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:06.439342 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ecb8bc-5d4b-41ba-91fd-f76490ad4dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:06.440397 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecb8bc-5d4b-41ba-91fd-f76490ad4dd0 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:06.440895 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecb8bc-5d4b-41ba-91fd-f76490ad4dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:06.449362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ecb8bc-5d4b-41ba-91fd-f76490ad4dd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:06.449362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ecb8bc-5d4b-41ba-91fd-f76490ad4dd0 None admin] RBAC: Adding query filter params (role.id=12d1e39175d748a09df9a7263b578070, scope.project.id=b74b66f35e054f368691db7e9bc5c219, user.id=aac5621f66b94887a9eb9ba5121f6c24) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:06.449362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ecb8bc-5d4b-41ba-91fd-f76490ad4dd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:06.454277 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ecb8bc-5d4b-41ba-91fd-f76490ad4dd0 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:06.485371 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 128/256] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:36:06 2022] GET /identity/v3/role_assignments?user.id=aac5621f66b94887a9eb9ba5121f6c24&scope.project.id=b74b66f35e054f368691db7e9bc5c219&role.id=12d1e39175d748a09df9a7263b578070 => generated 259 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:06.534174 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 129/257] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:36:06.719729 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ecb8bc-5d4b-41ba-91fd-f76490ad4dd0 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:06.735687 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:06.857043 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ecb8bc-5d4b-41ba-91fd-f76490ad4dd0 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:06.905799 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768de31-51a9-47da-a7fd-710307785a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:06.906464 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768de31-51a9-47da-a7fd-710307785a2e None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:06.906744 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768de31-51a9-47da-a7fd-710307785a2e None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:06.907018 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768de31-51a9-47da-a7fd-710307785a2e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:06.926764 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768de31-51a9-47da-a7fd-710307785a2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:06.932195 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-7768de31-51a9-47da-a7fd-710307785a2e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:36:06.932195 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:06.932195 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:06.932195 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:06.932195 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:06.932195 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:06.932195 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:06.932195 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:06.932195 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:06.932195 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:06.932195 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:06.932195 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:06.932195 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:06.932195 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:06.932195 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:06.932195 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:06.933153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:06.933153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:06.933153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:06.933153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:06.933153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:06.933153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:06.933153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:06.933153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:06.933153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:06.933153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:06.933153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:06.933153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:06.933153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:06.933153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:06.933153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:06.933153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:06.934054 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:06.934054 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:06.934054 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:06.934054 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:06.934054 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:06.934054 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:06.934054 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:06.934054 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:06.934054 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:06.934054 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:06.934054 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:36:06.934054 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:06.934054 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 129/258] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 24 04:36:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:06.939483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86ab73-1ba4-407e-a759-fd7ef8842bf8 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:06.957856 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:07.059813 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768de31-51a9-47da-a7fd-710307785a2e None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:07.093260 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86ab73-1ba4-407e-a759-fd7ef8842bf8 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:07.145374 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480a8ac-8da1-4a11-900c-d66fc922e37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:07.145374 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480a8ac-8da1-4a11-900c-d66fc922e37e None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:07.145374 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480a8ac-8da1-4a11-900c-d66fc922e37e None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:07.145374 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480a8ac-8da1-4a11-900c-d66fc922e37e None admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:07.145978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480a8ac-8da1-4a11-900c-d66fc922e37e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:07.145978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480a8ac-8da1-4a11-900c-d66fc922e37e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:07.149363 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480a8ac-8da1-4a11-900c-d66fc922e37e None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:07.158750 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 130/259] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:07.164501 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480a8ac-8da1-4a11-900c-d66fc922e37e None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:07.175315 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:07.244200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768de31-51a9-47da-a7fd-710307785a2e None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:07.295758 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:07.319173 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b33fc-d63b-4c59-a443-1c843d700045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:07.321541 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b33fc-d63b-4c59-a443-1c843d700045 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:07.322158 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b33fc-d63b-4c59-a443-1c843d700045 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:07.323400 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b33fc-d63b-4c59-a443-1c843d700045 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:07.346406 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b33fc-d63b-4c59-a443-1c843d700045 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:07.354500 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-8d5b33fc-d63b-4c59-a443-1c843d700045 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:36:07.354500 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:07.354500 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:07.354500 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:07.354500 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:07.354500 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:07.354500 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:07.354500 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:07.354500 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:07.354500 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:07.354500 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:07.354500 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:07.354500 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:07.354500 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:07.354500 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:07.354500 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:07.355614 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:07.355614 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:07.355614 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:07.355614 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:07.355614 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:07.355614 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:07.355614 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:07.355614 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:07.355614 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:07.355614 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:07.355614 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:07.355614 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:07.355614 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:07.355614 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:07.355614 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:07.355614 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:07.356589 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:07.356589 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:07.356589 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:07.356589 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:07.356589 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:07.356589 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:07.356589 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:07.356589 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:07.356589 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:07.356589 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:07.356589 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:36:07.356589 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:07.362622 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 130/260] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 24 04:36:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:07.370752 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480a8ac-8da1-4a11-900c-d66fc922e37e None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:07.373884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b33fc-d63b-4c59-a443-1c843d700045 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:07.426064 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868edc4-adee-4458-9dd4-3a21141839ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:07.427164 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868edc4-adee-4458-9dd4-3a21141839ad None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:07.427555 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868edc4-adee-4458-9dd4-3a21141839ad None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:07.427924 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868edc4-adee-4458-9dd4-3a21141839ad None admin] PATH_INFO: `/v3/users/005fa3dee4e845ba9994e9f645d27931` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:07.429845 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868edc4-adee-4458-9dd4-3a21141839ad None admin] RBAC: Authorizing `identity:get_user(user_id=005fa3dee4e845ba9994e9f645d27931)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:07.431865 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868edc4-adee-4458-9dd4-3a21141839ad None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:07.435109 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 131/261] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:36:07 2022] GET /identity/v3/users/005fa3dee4e845ba9994e9f645d27931 => generated 283 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:07.443831 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868edc4-adee-4458-9dd4-3a21141839ad None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:07.493454 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b33fc-d63b-4c59-a443-1c843d700045 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:07.529529 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:07.538171 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07dd65-95b0-44a2-9438-a3c8b957035d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:07.539142 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07dd65-95b0-44a2-9438-a3c8b957035d None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:07.539565 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07dd65-95b0-44a2-9438-a3c8b957035d None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:07.540094 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07dd65-95b0-44a2-9438-a3c8b957035d None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:07.540957 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07dd65-95b0-44a2-9438-a3c8b957035d None admin] RBAC: Adding query filter params (name=admin) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:07.541543 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07dd65-95b0-44a2-9438-a3c8b957035d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:07.543387 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07dd65-95b0-44a2-9438-a3c8b957035d None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:07.554326 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 131/262] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:36:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:07.560819 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07dd65-95b0-44a2-9438-a3c8b957035d None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:07.628127 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868edc4-adee-4458-9dd4-3a21141839ad None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:07.677486 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ccc10d-fc8e-466d-8c92-ce6a8bf56aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:07.678762 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccc10d-fc8e-466d-8c92-ce6a8bf56aa8 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:07.679300 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccc10d-fc8e-466d-8c92-ce6a8bf56aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:07.679719 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ccc10d-fc8e-466d-8c92-ce6a8bf56aa8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:07.690134 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07dd65-95b0-44a2-9438-a3c8b957035d None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:07.702895 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:07.736983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86aa6f-e768-4e14-bd55-da220dc31e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:07.737957 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86aa6f-e768-4e14-bd55-da220dc31e24 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:07.738485 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86aa6f-e768-4e14-bd55-da220dc31e24 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:07.739045 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86aa6f-e768-4e14-bd55-da220dc31e24 None admin] PATH_INFO: `/v3/users/005fa3dee4e845ba9994e9f645d27931` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:07.740564 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86aa6f-e768-4e14-bd55-da220dc31e24 None admin] RBAC: Authorizing `identity:get_user(user_id=005fa3dee4e845ba9994e9f645d27931)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:07.742322 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86aa6f-e768-4e14-bd55-da220dc31e24 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:07.744782 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 132/263] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:36:07 2022] GET /identity/v3/users/005fa3dee4e845ba9994e9f645d27931 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:07.751730 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86aa6f-e768-4e14-bd55-da220dc31e24 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:07.816337 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ccc10d-fc8e-466d-8c92-ce6a8bf56aa8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:07.817942 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ccc10d-fc8e-466d-8c92-ce6a8bf56aa8 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:07.821116 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:07.867574 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86aa6f-e768-4e14-bd55-da220dc31e24 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:07.905468 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced815b6-3327-4c7b-8496-1bc55aae8c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:07.906502 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced815b6-3327-4c7b-8496-1bc55aae8c59 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:07.906959 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced815b6-3327-4c7b-8496-1bc55aae8c59 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:07.907417 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced815b6-3327-4c7b-8496-1bc55aae8c59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:07.982832 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced815b6-3327-4c7b-8496-1bc55aae8c59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:07.984666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced815b6-3327-4c7b-8496-1bc55aae8c59 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:08.035553 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 132/264] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:36:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 04:36:08.041566 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ccc10d-fc8e-466d-8c92-ce6a8bf56aa8 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:08.052086 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:08.100063 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 133/265] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:36:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 04:36:08.106200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced815b6-3327-4c7b-8496-1bc55aae8c59 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:08.135692 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:08.224592 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced815b6-3327-4c7b-8496-1bc55aae8c59 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:08.263796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c896e34f-b53f-42ec-92c8-dbafc0efb09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:08.264901 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896e34f-b53f-42ec-92c8-dbafc0efb09f None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:08.265392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896e34f-b53f-42ec-92c8-dbafc0efb09f None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:08.265871 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896e34f-b53f-42ec-92c8-dbafc0efb09f None admin] PATH_INFO: `/v3/projects/b74b66f35e054f368691db7e9bc5c219` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:08.267300 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c896e34f-b53f-42ec-92c8-dbafc0efb09f None admin] RBAC: Authorizing `identity:get_project(project_id=b74b66f35e054f368691db7e9bc5c219)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:08.269238 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c896e34f-b53f-42ec-92c8-dbafc0efb09f None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:08.271574 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 134/266] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:36:08 2022] GET /identity/v3/projects/b74b66f35e054f368691db7e9bc5c219 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:08.278501 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c896e34f-b53f-42ec-92c8-dbafc0efb09f None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:08.284404 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ccc10d-fc8e-466d-8c92-ce6a8bf56aa8 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:08.311211 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:08.364203 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d2d41-0a57-4191-b82c-d1d33003e70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:08.364867 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d2d41-0a57-4191-b82c-d1d33003e70a None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:08.365151 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d2d41-0a57-4191-b82c-d1d33003e70a None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:08.365446 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d2d41-0a57-4191-b82c-d1d33003e70a None admin] PATH_INFO: `/v3/projects/b74b66f35e054f368691db7e9bc5c219` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:08.370118 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d2d41-0a57-4191-b82c-d1d33003e70a None admin] RBAC: Authorizing `identity:get_project(project_id=b74b66f35e054f368691db7e9bc5c219)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:08.371690 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d2d41-0a57-4191-b82c-d1d33003e70a None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:08.373906 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 133/267] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:36:08 2022] GET /identity/v3/projects/b74b66f35e054f368691db7e9bc5c219 => generated 302 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:08.380540 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d2d41-0a57-4191-b82c-d1d33003e70a None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:08.396999 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c896e34f-b53f-42ec-92c8-dbafc0efb09f None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:08.436528 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa02368-bc0f-4e42-83ef-80de57365167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:08.437520 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa02368-bc0f-4e42-83ef-80de57365167 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:08.437974 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa02368-bc0f-4e42-83ef-80de57365167 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:08.438455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa02368-bc0f-4e42-83ef-80de57365167 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:08.439500 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa02368-bc0f-4e42-83ef-80de57365167 None admin] RBAC: Adding query filter params (role.id=74ce7b72bcc94a8a8ad65c3db928e6ac, scope.project.id=b74b66f35e054f368691db7e9bc5c219, user.id=005fa3dee4e845ba9994e9f645d27931) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:08.440052 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa02368-bc0f-4e42-83ef-80de57365167 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:08.441932 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa02368-bc0f-4e42-83ef-80de57365167 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:08.452453 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 135/268] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:36:08 2022] GET /identity/v3/role_assignments?user.id=005fa3dee4e845ba9994e9f645d27931&scope.project.id=b74b66f35e054f368691db7e9bc5c219&role.id=74ce7b72bcc94a8a8ad65c3db928e6ac => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:08.566940 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d2d41-0a57-4191-b82c-d1d33003e70a None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:08.578944 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:08.606435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1503f5-7ca6-4fb1-90c5-3d0ddb64b0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:08.607100 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1503f5-7ca6-4fb1-90c5-3d0ddb64b0ce None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:08.607461 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1503f5-7ca6-4fb1-90c5-3d0ddb64b0ce None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:08.607738 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1503f5-7ca6-4fb1-90c5-3d0ddb64b0ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:08.608509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1503f5-7ca6-4fb1-90c5-3d0ddb64b0ce None admin] RBAC: Adding query filter params (role.id=3c2269f848184abd93ef97d02f6553e4, scope.project.id=b74b66f35e054f368691db7e9bc5c219, user.id=005fa3dee4e845ba9994e9f645d27931) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:08.608825 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1503f5-7ca6-4fb1-90c5-3d0ddb64b0ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:08.610437 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1503f5-7ca6-4fb1-90c5-3d0ddb64b0ce None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:08.618540 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 134/269] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:36:08 2022] GET /identity/v3/role_assignments?user.id=005fa3dee4e845ba9994e9f645d27931&scope.project.id=b74b66f35e054f368691db7e9bc5c219&role.id=3c2269f848184abd93ef97d02f6553e4 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:08.951134 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb36873-6a79-4f7d-b19f-053ae47c4770 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:08.952060 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb36873-6a79-4f7d-b19f-053ae47c4770 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:08.952504 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb36873-6a79-4f7d-b19f-053ae47c4770 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:08.954378 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 136/270] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:08.960865 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92a13b-0801-4207-9b8d-45584cc4f120 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:08.961328 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92a13b-0801-4207-9b8d-45584cc4f120 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:08.961724 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed92a13b-0801-4207-9b8d-45584cc4f120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:08.985854 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-ed92a13b-0801-4207-9b8d-45584cc4f120 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:08.987048 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-ed92a13b-0801-4207-9b8d-45584cc4f120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:09.043552 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acb53a-e747-465a-a53c-82b38da349f0 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:09.044304 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acb53a-e747-465a-a53c-82b38da349f0 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:09.044816 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acb53a-e747-465a-a53c-82b38da349f0 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:09.046841 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 137/271] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:36:09.056622 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71455a2-d8e5-4bf4-9551-681520fb144f None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:09.056622 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71455a2-d8e5-4bf4-9551-681520fb144f None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:09.056622 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71455a2-d8e5-4bf4-9551-681520fb144f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:09.078157 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 135/272] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:09.092259 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-d71455a2-d8e5-4bf4-9551-681520fb144f None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:09.093739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-d71455a2-d8e5-4bf4-9551-681520fb144f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:09.175289 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 138/273] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:09.422683 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92a13b-0801-4207-9b8d-45584cc4f120 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:09.505840 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71455a2-d8e5-4bf4-9551-681520fb144f None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:09.536580 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:09.548376 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed92a13b-0801-4207-9b8d-45584cc4f120 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:09.550301 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:09.594219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8815730-751f-4fea-a0a7-ebc1be12a87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:09.595551 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8815730-751f-4fea-a0a7-ebc1be12a87e None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:09.595961 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8815730-751f-4fea-a0a7-ebc1be12a87e None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:09.596379 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8815730-751f-4fea-a0a7-ebc1be12a87e None admin] PATH_INFO: `/v3/roles/member` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:09.611317 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8815730-751f-4fea-a0a7-ebc1be12a87e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:09.618518 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-b8815730-751f-4fea-a0a7-ebc1be12a87e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:36:09.618518 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:09.618518 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:09.618518 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:09.618518 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:09.618518 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:09.618518 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:09.618518 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:09.618518 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:09.618518 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:09.618518 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:09.618518 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:09.618518 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:09.618518 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:09.618518 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:09.618518 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:09.619642 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:09.619642 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:09.619642 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:09.619642 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:09.619642 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:09.619642 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:09.619642 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:09.619642 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:09.619642 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:09.619642 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:09.619642 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:09.619642 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:09.619642 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:09.619642 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:09.619642 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:09.619642 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:09.620500 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:09.620500 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:09.620500 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:09.620500 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:09.620500 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:09.620500 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:09.620500 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:09.620500 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:09.620500 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:09.620500 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:09.620500 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:36:09.620500 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:09.621105 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 136/274] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:36:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:09.627752 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8815730-751f-4fea-a0a7-ebc1be12a87e None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:09.634461 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71455a2-d8e5-4bf4-9551-681520fb144f None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:09.682714 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7df13f-d3f0-4d13-a373-0eb718bf14ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:09.683624 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7df13f-d3f0-4d13-a373-0eb718bf14ca None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:09.684046 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7df13f-d3f0-4d13-a373-0eb718bf14ca None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:09.684456 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7df13f-d3f0-4d13-a373-0eb718bf14ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:09.690496 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7df13f-d3f0-4d13-a373-0eb718bf14ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:09.693325 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7df13f-d3f0-4d13-a373-0eb718bf14ca None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:09.696283 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 139/275] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:09.697808 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992cd8f9-927f-4cc7-b01e-209b02c684f3 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:09.698226 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992cd8f9-927f-4cc7-b01e-209b02c684f3 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:09.698620 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992cd8f9-927f-4cc7-b01e-209b02c684f3 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:09.701157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 140/276] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:09.702148 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992cd8f9-927f-4cc7-b01e-209b02c684f3 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:09.738734 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8815730-751f-4fea-a0a7-ebc1be12a87e None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:09.776184 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191cf11-55cb-4d17-9da5-5c11927740b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:09.776852 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191cf11-55cb-4d17-9da5-5c11927740b8 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:09.777126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191cf11-55cb-4d17-9da5-5c11927740b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:09.777439 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191cf11-55cb-4d17-9da5-5c11927740b8 None admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:09.778118 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191cf11-55cb-4d17-9da5-5c11927740b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:09.778420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191cf11-55cb-4d17-9da5-5c11927740b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:09.779823 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191cf11-55cb-4d17-9da5-5c11927740b8 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:09.788377 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 137/277] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 24 04:36:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:09.789616 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348a613-95b2-49d5-a472-7467021af4c8 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:09.789877 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348a613-95b2-49d5-a472-7467021af4c8 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:09.790143 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348a613-95b2-49d5-a472-7467021af4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:09.809739 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-5348a613-95b2-49d5-a472-7467021af4c8 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:09.810983 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-5348a613-95b2-49d5-a472-7467021af4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:09.818338 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:09.829157 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:09.830313 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992cd8f9-927f-4cc7-b01e-209b02c684f3 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:09.866495 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69acbb0-5e01-4e62-bda2-548c86d0a189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:09.867110 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69acbb0-5e01-4e62-bda2-548c86d0a189 None admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:09.867388 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69acbb0-5e01-4e62-bda2-548c86d0a189 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:09.867663 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69acbb0-5e01-4e62-bda2-548c86d0a189 None admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:09.868308 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69acbb0-5e01-4e62-bda2-548c86d0a189 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:09.869829 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69acbb0-5e01-4e62-bda2-548c86d0a189 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:09.882871 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 138/278] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:09.883817 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348a613-95b2-49d5-a472-7467021af4c8 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:09.894070 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 141/279] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 24 04:36:09 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:36:09.895898 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556ce1d-32df-48d8-82aa-2ac8f054183e None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:09.896315 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556ce1d-32df-48d8-82aa-2ac8f054183e None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:09.896725 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556ce1d-32df-48d8-82aa-2ac8f054183e None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:09.898453 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 142/280] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:09.904564 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27808871-cc2c-469a-9428-aecf4e693c9c None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:09.905141 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27808871-cc2c-469a-9428-aecf4e693c9c None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:09.905710 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27808871-cc2c-469a-9428-aecf4e693c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:09.931069 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-27808871-cc2c-469a-9428-aecf4e693c9c None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:09.933008 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-27808871-cc2c-469a-9428-aecf4e693c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:10.037919 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 143/281] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:10.061687 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348a613-95b2-49d5-a472-7467021af4c8 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:10.106551 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2fc4f-feac-48b5-8821-d2fa0d39e4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:10.107200 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2fc4f-feac-48b5-8821-d2fa0d39e4fd None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:10.107478 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2fc4f-feac-48b5-8821-d2fa0d39e4fd None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:10.107743 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2fc4f-feac-48b5-8821-d2fa0d39e4fd None admin] PATH_INFO: `/v3/users/4299d9340975434ea40e71198cb6adc4` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:10.122580 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2fc4f-feac-48b5-8821-d2fa0d39e4fd None admin] RBAC: Authorizing `identity:get_user(user_id=4299d9340975434ea40e71198cb6adc4)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:10.124213 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2fc4f-feac-48b5-8821-d2fa0d39e4fd None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:10.126211 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 139/282] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:36:09 2022] GET /identity/v3/users/4299d9340975434ea40e71198cb6adc4 => generated 293 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:10.137060 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27808871-cc2c-469a-9428-aecf4e693c9c None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:10.217419 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2fc4f-feac-48b5-8821-d2fa0d39e4fd None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:10.232603 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:10.243768 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:10.272563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27808871-cc2c-469a-9428-aecf4e693c9c None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:10.319202 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8aa43-3269-489f-9e57-f502d2c7b598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:10.319907 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8aa43-3269-489f-9e57-f502d2c7b598 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:10.320241 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8aa43-3269-489f-9e57-f502d2c7b598 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:10.320535 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8aa43-3269-489f-9e57-f502d2c7b598 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:10.321405 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8aa43-3269-489f-9e57-f502d2c7b598 None admin] RBAC: Adding query filter params (role.id=e2eda359ee274ff1914db224f7f9b383, user.id=4299d9340975434ea40e71198cb6adc4, scope.system=all) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:10.321742 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8aa43-3269-489f-9e57-f502d2c7b598 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:10.323248 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8aa43-3269-489f-9e57-f502d2c7b598 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:10.336214 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 144/283] 10.222.0.49 () {56 vars in 1308 bytes} [Wed Aug 24 04:36:10 2022] GET /identity/v3/role_assignments?user.id=4299d9340975434ea40e71198cb6adc4&scope.system=all&role.id=e2eda359ee274ff1914db224f7f9b383 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:10.341747 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8aa43-3269-489f-9e57-f502d2c7b598 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:10.383195 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2fc4f-feac-48b5-8821-d2fa0d39e4fd None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:10.424360 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb859e3-f001-4bcc-ab67-66a72c161874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:10.425023 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb859e3-f001-4bcc-ab67-66a72c161874 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:10.425363 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb859e3-f001-4bcc-ab67-66a72c161874 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:10.425642 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb859e3-f001-4bcc-ab67-66a72c161874 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:10.439155 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb859e3-f001-4bcc-ab67-66a72c161874 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:10.444313 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-0cb859e3-f001-4bcc-ab67-66a72c161874 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:36:10.444313 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:10.444313 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:10.444313 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:10.444313 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:10.444313 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:10.444313 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:10.444313 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:10.444313 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:10.444313 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:10.444313 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:10.444313 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:10.444313 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:10.444313 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:10.444313 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:10.444313 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:10.445288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:10.445288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:10.445288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:10.445288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:10.445288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:10.445288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:10.445288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:10.445288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:10.445288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:10.445288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:10.445288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:10.445288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:10.445288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:10.445288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:10.445288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:10.445288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:10.446129 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:10.446129 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:10.446129 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:10.446129 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:10.446129 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:10.446129 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:10.446129 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:10.446129 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:10.446129 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:10.446129 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:10.446129 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:36:10.446129 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:10.447257 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 140/284] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:36:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:36:10.453030 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb859e3-f001-4bcc-ab67-66a72c161874 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:10.474494 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8aa43-3269-489f-9e57-f502d2c7b598 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:10.518780 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f1327-86ff-46bb-a8b5-ae1ed845cacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:10.519850 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f1327-86ff-46bb-a8b5-ae1ed845cacc None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:10.520443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f1327-86ff-46bb-a8b5-ae1ed845cacc None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:10.521167 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f1327-86ff-46bb-a8b5-ae1ed845cacc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:10.532005 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:10.536117 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f1327-86ff-46bb-a8b5-ae1ed845cacc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:10.539453 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:10.543184 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-cf0f1327-86ff-46bb-a8b5-ae1ed845cacc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:36:10.543184 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:10.543184 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:10.543184 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:10.543184 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:10.543184 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:10.543184 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:10.543184 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:10.543184 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:10.543184 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:10.543184 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:10.543184 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:10.543184 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:10.543184 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:10.543184 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:10.543184 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:10.544093 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:10.544093 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:10.544093 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:10.544093 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:10.544093 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:10.544093 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:10.544093 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:10.544093 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:10.544093 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:10.544093 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:10.544093 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:10.544093 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:10.544093 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:10.544093 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:10.544093 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:10.544093 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:10.544865 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:10.544865 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:10.544865 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:10.544865 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:10.544865 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:10.544865 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:10.544865 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:10.544865 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:10.544865 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:10.544865 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:10.544865 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:36:10.544865 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:10.547573 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 145/285] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:36:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:10.554195 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f1327-86ff-46bb-a8b5-ae1ed845cacc None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:10.574141 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb859e3-f001-4bcc-ab67-66a72c161874 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:10.613823 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094ea5a-e633-4ea3-ae4b-3e0a176777aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:10.614431 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094ea5a-e633-4ea3-ae4b-3e0a176777aa None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:10.614702 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094ea5a-e633-4ea3-ae4b-3e0a176777aa None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:10.615033 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094ea5a-e633-4ea3-ae4b-3e0a176777aa None admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:10.615709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094ea5a-e633-4ea3-ae4b-3e0a176777aa None admin] RBAC: Adding query filter params (name=member) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:10.616006 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094ea5a-e633-4ea3-ae4b-3e0a176777aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:10.617525 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094ea5a-e633-4ea3-ae4b-3e0a176777aa None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:10.627432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 141/286] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 24 04:36:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:10.633108 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094ea5a-e633-4ea3-ae4b-3e0a176777aa None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:10.766576 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094ea5a-e633-4ea3-ae4b-3e0a176777aa None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:10.802801 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c4abc-526e-4509-8666-00774303aef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:10.803486 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c4abc-526e-4509-8666-00774303aef2 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:10.803637 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f1327-86ff-46bb-a8b5-ae1ed845cacc None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:10.803768 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c4abc-526e-4509-8666-00774303aef2 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:10.804034 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c4abc-526e-4509-8666-00774303aef2 None admin] PATH_INFO: `/v3/users/fa3f80da6d39443cbff73407b6ce388e` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:10.805424 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c4abc-526e-4509-8666-00774303aef2 None admin] RBAC: Authorizing `identity:get_user(user_id=fa3f80da6d39443cbff73407b6ce388e)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:10.807002 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c4abc-526e-4509-8666-00774303aef2 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:10.808719 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 142/287] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:36:10 2022] GET /identity/v3/users/fa3f80da6d39443cbff73407b6ce388e => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:10.816434 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c4abc-526e-4509-8666-00774303aef2 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:10.819757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:10.860382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6605a33-5dc1-4cae-8bd4-aed9f6f2b25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:10.861528 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6605a33-5dc1-4cae-8bd4-aed9f6f2b25d None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:10.862004 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6605a33-5dc1-4cae-8bd4-aed9f6f2b25d None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:10.863164 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6605a33-5dc1-4cae-8bd4-aed9f6f2b25d None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:10.864204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6605a33-5dc1-4cae-8bd4-aed9f6f2b25d None admin] RBAC: Adding query filter params (name=reader) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:10.865893 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6605a33-5dc1-4cae-8bd4-aed9f6f2b25d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:10.867764 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6605a33-5dc1-4cae-8bd4-aed9f6f2b25d None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:10.888990 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 146/288] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 24 04:36:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:10.895185 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6605a33-5dc1-4cae-8bd4-aed9f6f2b25d None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:11.007313 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c4abc-526e-4509-8666-00774303aef2 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:11.009932 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:11.065448 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48052a-f003-48ec-ad8a-75e89dba00fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:11.065448 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48052a-f003-48ec-ad8a-75e89dba00fb None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:11.065448 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48052a-f003-48ec-ad8a-75e89dba00fb None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:11.065448 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48052a-f003-48ec-ad8a-75e89dba00fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:11.087519 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6605a33-5dc1-4cae-8bd4-aed9f6f2b25d None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:11.139504 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48052a-f003-48ec-ad8a-75e89dba00fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:11.141010 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48052a-f003-48ec-ad8a-75e89dba00fb None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:11.142952 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:11.190463 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8da91-5ba4-4046-99c4-69e02661bbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:11.191268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8da91-5ba4-4046-99c4-69e02661bbb0 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:11.191638 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8da91-5ba4-4046-99c4-69e02661bbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:11.192032 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac8da91-5ba4-4046-99c4-69e02661bbb0 None admin] PATH_INFO: `/v3/users/aac5621f66b94887a9eb9ba5121f6c24` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:11.193391 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8da91-5ba4-4046-99c4-69e02661bbb0 None admin] RBAC: Authorizing `identity:get_user(user_id=aac5621f66b94887a9eb9ba5121f6c24)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:11.194942 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac8da91-5ba4-4046-99c4-69e02661bbb0 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:11.196664 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 147/289] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:36:10 2022] GET /identity/v3/users/aac5621f66b94887a9eb9ba5121f6c24 => generated 297 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:11.202487 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8da91-5ba4-4046-99c4-69e02661bbb0 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:11.256606 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 143/290] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:36:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 04:36:11.262740 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48052a-f003-48ec-ad8a-75e89dba00fb None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:11.379174 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac8da91-5ba4-4046-99c4-69e02661bbb0 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:11.422060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48052a-f003-48ec-ad8a-75e89dba00fb None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:11.423998 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:11.441230 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:11.445081 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240f1d6-4a00-41ce-9b9a-b8658dfdc87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:11.445772 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240f1d6-4a00-41ce-9b9a-b8658dfdc87f None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:11.446066 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240f1d6-4a00-41ce-9b9a-b8658dfdc87f None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:11.446358 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240f1d6-4a00-41ce-9b9a-b8658dfdc87f None admin] PATH_INFO: `/v3/projects/b74b66f35e054f368691db7e9bc5c219` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:11.447579 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0240f1d6-4a00-41ce-9b9a-b8658dfdc87f None admin] RBAC: Authorizing `identity:get_project(project_id=b74b66f35e054f368691db7e9bc5c219)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:11.449046 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0240f1d6-4a00-41ce-9b9a-b8658dfdc87f None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:11.451287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 148/291] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:36:11 2022] GET /identity/v3/projects/b74b66f35e054f368691db7e9bc5c219 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:11.458156 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240f1d6-4a00-41ce-9b9a-b8658dfdc87f None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:11.493406 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a8f29e-866a-46fd-9bd2-6a18fc6ac625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:11.494105 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8f29e-866a-46fd-9bd2-6a18fc6ac625 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:11.494326 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8f29e-866a-46fd-9bd2-6a18fc6ac625 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:11.494593 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8f29e-866a-46fd-9bd2-6a18fc6ac625 None admin] PATH_INFO: `/v3/projects/b74b66f35e054f368691db7e9bc5c219` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:11.496516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a8f29e-866a-46fd-9bd2-6a18fc6ac625 None admin] RBAC: Authorizing `identity:get_project(project_id=b74b66f35e054f368691db7e9bc5c219)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:11.498040 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a8f29e-866a-46fd-9bd2-6a18fc6ac625 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:11.499722 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 144/292] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:36:11 2022] GET /identity/v3/projects/b74b66f35e054f368691db7e9bc5c219 => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:11.510224 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a8f29e-866a-46fd-9bd2-6a18fc6ac625 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:11.589874 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240f1d6-4a00-41ce-9b9a-b8658dfdc87f None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:11.638141 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec80abf-a71e-484b-8e43-b776edd7c5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:11.638745 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec80abf-a71e-484b-8e43-b776edd7c5c9 None admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:11.639022 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec80abf-a71e-484b-8e43-b776edd7c5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:11.639297 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec80abf-a71e-484b-8e43-b776edd7c5c9 None admin] PATH_INFO: `/v3/projects/b74b66f35e054f368691db7e9bc5c219/users/aac5621f66b94887a9eb9ba5121f6c24/roles/12d1e39175d748a09df9a7263b578070` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:11.646698 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec80abf-a71e-484b-8e43-b776edd7c5c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=b74b66f35e054f368691db7e9bc5c219, user_id=aac5621f66b94887a9eb9ba5121f6c24, role_id=12d1e39175d748a09df9a7263b578070)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:11.648263 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec80abf-a71e-484b-8e43-b776edd7c5c9 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:11.667038 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a8f29e-866a-46fd-9bd2-6a18fc6ac625 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:11.675771 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 149/293] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 24 04:36:11 2022] PUT /identity/v3/projects/b74b66f35e054f368691db7e9bc5c219/users/aac5621f66b94887a9eb9ba5121f6c24/roles/12d1e39175d748a09df9a7263b578070 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:36:11.706510 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5db4a-e787-4be6-a544-0331f93f7e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:11.707625 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5db4a-e787-4be6-a544-0331f93f7e10 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:11.708157 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5db4a-e787-4be6-a544-0331f93f7e10 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:11.708885 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5db4a-e787-4be6-a544-0331f93f7e10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:11.710110 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5db4a-e787-4be6-a544-0331f93f7e10 None admin] RBAC: Adding query filter params (role.id=e2eda359ee274ff1914db224f7f9b383, scope.project.id=b74b66f35e054f368691db7e9bc5c219, user.id=fa3f80da6d39443cbff73407b6ce388e) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:11.710683 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5db4a-e787-4be6-a544-0331f93f7e10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:11.712770 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5db4a-e787-4be6-a544-0331f93f7e10 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:11.720769 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 145/294] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:36:11 2022] GET /identity/v3/role_assignments?user.id=fa3f80da6d39443cbff73407b6ce388e&scope.project.id=b74b66f35e054f368691db7e9bc5c219&role.id=e2eda359ee274ff1914db224f7f9b383 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:12.373004 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afb738-9715-4a09-8a2b-723a8d81b6c3 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:12.373945 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afb738-9715-4a09-8a2b-723a8d81b6c3 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:12.374381 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afb738-9715-4a09-8a2b-723a8d81b6c3 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:12.376278 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 150/295] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:12.382782 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bca0e-df77-4daf-a69f-5b6e281dc5a1 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:12.383159 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bca0e-df77-4daf-a69f-5b6e281dc5a1 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:12.383505 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bca0e-df77-4daf-a69f-5b6e281dc5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:12.406247 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-c48bca0e-df77-4daf-a69f-5b6e281dc5a1 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:12.407471 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-c48bca0e-df77-4daf-a69f-5b6e281dc5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:12.436036 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:12.478925 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 146/296] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:12.719286 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754a5e9-94ee-43a2-bc9d-45c2c510dd83 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:12.719457 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754a5e9-94ee-43a2-bc9d-45c2c510dd83 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:12.719728 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754a5e9-94ee-43a2-bc9d-45c2c510dd83 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:12.721379 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 151/297] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:12.726698 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff299a6c-71ca-4347-93dc-ee944ad14424 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:12.727141 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff299a6c-71ca-4347-93dc-ee944ad14424 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:12.727230 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff299a6c-71ca-4347-93dc-ee944ad14424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:12.741624 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754a5e9-94ee-43a2-bc9d-45c2c510dd83 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:12.747087 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-ff299a6c-71ca-4347-93dc-ee944ad14424 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:12.748280 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-ff299a6c-71ca-4347-93dc-ee944ad14424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:12.806167 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:12.832069 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 147/298] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:12.832069 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b20d0e-c8f1-47b1-aa60-7bc96711d71f None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:12.832069 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b20d0e-c8f1-47b1-aa60-7bc96711d71f None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:12.832069 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b20d0e-c8f1-47b1-aa60-7bc96711d71f None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:12.832069 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 148/299] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:12.833643 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239743a4-e062-47a6-ad67-dacb6ae1b34e None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:12.833925 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239743a4-e062-47a6-ad67-dacb6ae1b34e None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:12.834196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239743a4-e062-47a6-ad67-dacb6ae1b34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:12.854911 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-239743a4-e062-47a6-ad67-dacb6ae1b34e None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:12.856397 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-239743a4-e062-47a6-ad67-dacb6ae1b34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:12.863863 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c754a5e9-94ee-43a2-bc9d-45c2c510dd83 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:12.904176 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b536b-2857-4c51-b318-2bec386d4884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:12.905767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b536b-2857-4c51-b318-2bec386d4884 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:12.906535 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b536b-2857-4c51-b318-2bec386d4884 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:12.906884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b536b-2857-4c51-b318-2bec386d4884 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:12.918350 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b536b-2857-4c51-b318-2bec386d4884 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:12.923966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-090b536b-2857-4c51-b318-2bec386d4884 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:36:12.923966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:12.923966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:12.923966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:12.923966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:12.923966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:12.923966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:12.923966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:12.923966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:12.923966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:12.923966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:12.923966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:12.923966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:12.923966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:12.923966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:12.923966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:12.924803 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:12.924803 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:12.924803 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:12.924803 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:12.924803 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:12.924803 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:12.924803 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:12.924803 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:12.924803 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:12.924803 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:12.924803 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:12.924803 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:12.924803 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:12.924803 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:12.924803 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:12.924803 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:12.930581 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:12.930581 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:12.930581 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:12.930581 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:12.930581 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:12.930581 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:12.930581 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:12.930581 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:12.930581 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:12.930581 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:12.930581 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:36:12.930581 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:12.930581 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 152/300] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:36:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:36:12.931209 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b536b-2857-4c51-b318-2bec386d4884 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:12.949148 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 149/301] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:13.038161 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b536b-2857-4c51-b318-2bec386d4884 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:13.055580 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:13.073363 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f47c31-0295-4e79-bd3d-3f2fe1810725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:13.074262 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f47c31-0295-4e79-bd3d-3f2fe1810725 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:13.074789 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f47c31-0295-4e79-bd3d-3f2fe1810725 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:13.075246 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f47c31-0295-4e79-bd3d-3f2fe1810725 None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:13.076121 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f47c31-0295-4e79-bd3d-3f2fe1810725 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:13.076611 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f47c31-0295-4e79-bd3d-3f2fe1810725 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:13.078251 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f47c31-0295-4e79-bd3d-3f2fe1810725 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:13.087043 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 153/302] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 24 04:36:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:13.092864 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239743a4-e062-47a6-ad67-dacb6ae1b34e None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:13.115106 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f47c31-0295-4e79-bd3d-3f2fe1810725 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:13.122844 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:13.231316 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239743a4-e062-47a6-ad67-dacb6ae1b34e None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:13.259987 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f47c31-0295-4e79-bd3d-3f2fe1810725 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:13.266103 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d38ee-4f6d-4ac9-b40a-414007b5d1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:13.266795 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d38ee-4f6d-4ac9-b40a-414007b5d1a4 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:13.267082 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d38ee-4f6d-4ac9-b40a-414007b5d1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:13.267352 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d38ee-4f6d-4ac9-b40a-414007b5d1a4 None admin] PATH_INFO: `/v3/users/dfa16931bed8447eb94a3ee0c400031a` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:13.280743 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d38ee-4f6d-4ac9-b40a-414007b5d1a4 None admin] RBAC: Authorizing `identity:get_user(user_id=dfa16931bed8447eb94a3ee0c400031a)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:13.282235 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96d38ee-4f6d-4ac9-b40a-414007b5d1a4 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:13.288871 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 150/303] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:36:13 2022] GET /identity/v3/users/dfa16931bed8447eb94a3ee0c400031a => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:13.288871 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d38ee-4f6d-4ac9-b40a-414007b5d1a4 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:13.300789 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7313ebc-b6cc-4749-be51-93a6a9289cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:13.301473 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7313ebc-b6cc-4749-be51-93a6a9289cc9 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:13.301760 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7313ebc-b6cc-4749-be51-93a6a9289cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:13.302034 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7313ebc-b6cc-4749-be51-93a6a9289cc9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:13.303441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7313ebc-b6cc-4749-be51-93a6a9289cc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:13.304911 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7313ebc-b6cc-4749-be51-93a6a9289cc9 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:13.306699 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 154/304] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:13.307369 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7313ebc-b6cc-4749-be51-93a6a9289cc9 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:13.360345 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:13.374082 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:13.393070 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d38ee-4f6d-4ac9-b40a-414007b5d1a4 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:13.417399 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7313ebc-b6cc-4749-be51-93a6a9289cc9 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:13.428967 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7055a-7142-42aa-b005-1bcab36abb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:13.429666 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7055a-7142-42aa-b005-1bcab36abb70 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:13.429941 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7055a-7142-42aa-b005-1bcab36abb70 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:13.430212 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7055a-7142-42aa-b005-1bcab36abb70 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:13.440439 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d7055a-7142-42aa-b005-1bcab36abb70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:13.445216 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-d1d7055a-7142-42aa-b005-1bcab36abb70 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:36:13.445216 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:13.445216 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:13.445216 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:13.445216 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:13.445216 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:13.445216 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:13.445216 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:13.445216 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:13.445216 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:13.445216 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:13.445216 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:13.445216 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:13.445216 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:13.445216 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:13.445216 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:13.446134 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:13.446134 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:13.446134 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:13.446134 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:13.446134 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:13.446134 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:13.446134 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:13.446134 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:13.446134 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:13.446134 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:13.446134 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:13.446134 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:13.446134 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:13.446134 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:13.446134 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:13.446134 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:13.446885 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:13.446885 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:13.446885 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:13.446885 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:13.446885 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:13.446885 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:13.446885 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:13.446885 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:13.446885 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:13.446885 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:13.446885 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:36:13.446885 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:13.446885 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 151/305] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:36:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:13.447602 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7055a-7142-42aa-b005-1bcab36abb70 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:13.460639 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17f5cc-a61b-4cd8-83c2-4451035f9363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:13.461255 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17f5cc-a61b-4cd8-83c2-4451035f9363 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:13.461634 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17f5cc-a61b-4cd8-83c2-4451035f9363 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:13.461921 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e17f5cc-a61b-4cd8-83c2-4451035f9363 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:13.462649 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17f5cc-a61b-4cd8-83c2-4451035f9363 None admin] RBAC: Adding query filter params (role.id=12d1e39175d748a09df9a7263b578070, user.id=dfa16931bed8447eb94a3ee0c400031a, scope.system=all) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:13.462959 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17f5cc-a61b-4cd8-83c2-4451035f9363 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:13.464412 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e17f5cc-a61b-4cd8-83c2-4451035f9363 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:13.469697 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 155/306] 10.222.0.49 () {56 vars in 1308 bytes} [Wed Aug 24 04:36:13 2022] GET /identity/v3/role_assignments?user.id=dfa16931bed8447eb94a3ee0c400031a&scope.system=all&role.id=12d1e39175d748a09df9a7263b578070 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:13.477589 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17f5cc-a61b-4cd8-83c2-4451035f9363 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:13.586868 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7055a-7142-42aa-b005-1bcab36abb70 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:13.601690 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e17f5cc-a61b-4cd8-83c2-4451035f9363 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:13.619066 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:13.624940 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1e81d-efb6-4a1a-8218-766745810305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:13.625675 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1e81d-efb6-4a1a-8218-766745810305 None admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:13.626131 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1e81d-efb6-4a1a-8218-766745810305 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:13.626294 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1e81d-efb6-4a1a-8218-766745810305 None admin] PATH_INFO: `/v3/groups` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:13.626922 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e1e81d-efb6-4a1a-8218-766745810305 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:13.628771 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e1e81d-efb6-4a1a-8218-766745810305 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:13.648919 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b415603-3372-4169-b69d-333943de4646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:13.649649 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b415603-3372-4169-b69d-333943de4646 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:13.649929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b415603-3372-4169-b69d-333943de4646 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:13.650200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b415603-3372-4169-b69d-333943de4646 None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:13.650884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b415603-3372-4169-b69d-333943de4646 None admin] RBAC: Adding query filter params (name=member) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:13.651238 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b415603-3372-4169-b69d-333943de4646 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:13.652702 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b415603-3372-4169-b69d-333943de4646 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:13.653599 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 152/307] 10.222.0.49 () {60 vars in 1134 bytes} [Wed Aug 24 04:36:13 2022] POST /identity/v3/groups => generated 229 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:36:13.663945 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 156/308] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 24 04:36:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:13.669690 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1e81d-efb6-4a1a-8218-766745810305 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:13.672924 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:13.785121 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1e81d-efb6-4a1a-8218-766745810305 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:13.802811 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e008eda-2f3b-4f0c-92d5-916bdae9b1eb None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:13.803130 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e008eda-2f3b-4f0c-92d5-916bdae9b1eb None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:13.803365 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e008eda-2f3b-4f0c-92d5-916bdae9b1eb None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:13.805076 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 157/309] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:13.811238 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e0a46-e939-4f66-a82e-8883887a0c17 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:13.811526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e0a46-e939-4f66-a82e-8883887a0c17 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:13.811792 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e0a46-e939-4f66-a82e-8883887a0c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:13.824214 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1999b14-5d5f-40fd-b01f-1edb5a6c0515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:13.824865 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1999b14-5d5f-40fd-b01f-1edb5a6c0515 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:13.825143 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1999b14-5d5f-40fd-b01f-1edb5a6c0515 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:13.826008 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1999b14-5d5f-40fd-b01f-1edb5a6c0515 None admin] PATH_INFO: `/v3/users/4299d9340975434ea40e71198cb6adc4` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:13.826625 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1999b14-5d5f-40fd-b01f-1edb5a6c0515 None admin] RBAC: Authorizing `identity:get_user(user_id=4299d9340975434ea40e71198cb6adc4)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:13.828150 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1999b14-5d5f-40fd-b01f-1edb5a6c0515 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:13.830221 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 153/310] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:36:13 2022] GET /identity/v3/users/4299d9340975434ea40e71198cb6adc4 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:13.833954 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-289e0a46-e939-4f66-a82e-8883887a0c17 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:13.835573 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-289e0a46-e939-4f66-a82e-8883887a0c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:13.835866 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1999b14-5d5f-40fd-b01f-1edb5a6c0515 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:13.911487 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:13.917546 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 158/311] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:13.943560 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1999b14-5d5f-40fd-b01f-1edb5a6c0515 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:13.978781 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee18b5-8529-47f4-9d87-e94153f6b5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:13.979439 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee18b5-8529-47f4-9d87-e94153f6b5f0 None admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:13.979717 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee18b5-8529-47f4-9d87-e94153f6b5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:13.979988 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee18b5-8529-47f4-9d87-e94153f6b5f0 None admin] PATH_INFO: `/v3/system/users/4299d9340975434ea40e71198cb6adc4/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:13.981430 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee18b5-8529-47f4-9d87-e94153f6b5f0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4299d9340975434ea40e71198cb6adc4, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:13.982930 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee18b5-8529-47f4-9d87-e94153f6b5f0 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:13.994171 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 154/312] 10.222.0.49 () {58 vars in 1334 bytes} [Wed Aug 24 04:36:13 2022] PUT /identity/v3/system/users/4299d9340975434ea40e71198cb6adc4/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:36:14.200448 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e0a46-e939-4f66-a82e-8883887a0c17 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:14.304822 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e0a46-e939-4f66-a82e-8883887a0c17 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:14.307566 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:14.341979 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d75256-1a09-4230-800f-4a3f2e00ed0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:14.342936 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d75256-1a09-4230-800f-4a3f2e00ed0b None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:14.343537 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d75256-1a09-4230-800f-4a3f2e00ed0b None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:14.343990 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d75256-1a09-4230-800f-4a3f2e00ed0b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:14.354779 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d75256-1a09-4230-800f-4a3f2e00ed0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:14.359830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-56d75256-1a09-4230-800f-4a3f2e00ed0b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:36:14.359830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:14.359830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:14.359830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:14.359830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:14.359830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:14.359830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:14.359830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:14.359830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:14.359830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:14.359830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:14.359830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:14.359830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:14.359830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:14.359830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:14.359830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:14.360666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:14.360666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:14.360666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:14.360666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:14.360666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:14.360666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:14.360666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:14.360666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:14.360666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:14.360666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:14.360666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:14.360666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:14.360666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:14.360666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:14.360666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:14.360666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:14.361484 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:14.361484 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:14.361484 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:14.361484 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:14.361484 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:14.361484 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:14.361484 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:14.361484 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:14.361484 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:14.361484 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:14.361484 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:36:14.361484 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:14.363411 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 159/313] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:36:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:14.369540 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee18b5-8529-47f4-9d87-e94153f6b5f0 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:14.473260 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee18b5-8529-47f4-9d87-e94153f6b5f0 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:14.508761 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fabd8c-5166-439a-9e84-bdb563f4bf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:14.509694 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fabd8c-5166-439a-9e84-bdb563f4bf7c None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:14.510116 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fabd8c-5166-439a-9e84-bdb563f4bf7c None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:14.510531 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fabd8c-5166-439a-9e84-bdb563f4bf7c None admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:14.511335 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fabd8c-5166-439a-9e84-bdb563f4bf7c None admin] RBAC: Adding query filter params (name=reader) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:14.511806 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fabd8c-5166-439a-9e84-bdb563f4bf7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:14.513367 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fabd8c-5166-439a-9e84-bdb563f4bf7c None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:14.527530 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:14.527530 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 155/314] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 24 04:36:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:14.529191 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d75256-1a09-4230-800f-4a3f2e00ed0b None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:14.639822 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d75256-1a09-4230-800f-4a3f2e00ed0b None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:14.675250 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91270ea3-3675-4d3c-b4da-e7346e2f43a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:14.676271 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91270ea3-3675-4d3c-b4da-e7346e2f43a1 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:14.676747 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91270ea3-3675-4d3c-b4da-e7346e2f43a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:14.677208 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91270ea3-3675-4d3c-b4da-e7346e2f43a1 None admin] PATH_INFO: `/v3/users/aac5621f66b94887a9eb9ba5121f6c24` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:14.678585 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91270ea3-3675-4d3c-b4da-e7346e2f43a1 None admin] RBAC: Authorizing `identity:get_user(user_id=aac5621f66b94887a9eb9ba5121f6c24)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:14.680268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91270ea3-3675-4d3c-b4da-e7346e2f43a1 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:14.682595 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 160/315] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:36:14 2022] GET /identity/v3/users/aac5621f66b94887a9eb9ba5121f6c24 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:14.688486 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fabd8c-5166-439a-9e84-bdb563f4bf7c None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:14.792559 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fabd8c-5166-439a-9e84-bdb563f4bf7c None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:14.827958 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf8557-6d64-43ad-9a18-c63dba6c9ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:14.828919 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf8557-6d64-43ad-9a18-c63dba6c9ebf None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:14.829426 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf8557-6d64-43ad-9a18-c63dba6c9ebf None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:14.829896 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf8557-6d64-43ad-9a18-c63dba6c9ebf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:14.895882 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:14.902932 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf8557-6d64-43ad-9a18-c63dba6c9ebf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:14.904816 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf8557-6d64-43ad-9a18-c63dba6c9ebf None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:15.006187 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 156/316] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:36:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:36:15.011925 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91270ea3-3675-4d3c-b4da-e7346e2f43a1 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:15.044382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:15.123755 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91270ea3-3675-4d3c-b4da-e7346e2f43a1 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:15.159636 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e188b6-bef1-4513-adac-dd48121d4c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:15.160290 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e188b6-bef1-4513-adac-dd48121d4c15 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:15.160565 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e188b6-bef1-4513-adac-dd48121d4c15 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:15.160836 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e188b6-bef1-4513-adac-dd48121d4c15 None admin] PATH_INFO: `/v3/projects/b74b66f35e054f368691db7e9bc5c219` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:15.162076 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e188b6-bef1-4513-adac-dd48121d4c15 None admin] RBAC: Authorizing `identity:get_project(project_id=b74b66f35e054f368691db7e9bc5c219)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:15.163601 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e188b6-bef1-4513-adac-dd48121d4c15 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:15.165616 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 161/317] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:36:15 2022] GET /identity/v3/projects/b74b66f35e054f368691db7e9bc5c219 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:15.171342 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf8557-6d64-43ad-9a18-c63dba6c9ebf None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:15.266922 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:15.274615 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf8557-6d64-43ad-9a18-c63dba6c9ebf None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:15.309625 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52127b37-f44d-4a0e-a2a9-8cbd46bb0a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:15.310091 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52127b37-f44d-4a0e-a2a9-8cbd46bb0a8b None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:15.310374 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52127b37-f44d-4a0e-a2a9-8cbd46bb0a8b None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:15.310646 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52127b37-f44d-4a0e-a2a9-8cbd46bb0a8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:15.311382 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52127b37-f44d-4a0e-a2a9-8cbd46bb0a8b None admin] RBAC: Adding query filter params (role.id=12d1e39175d748a09df9a7263b578070, scope.project.id=b74b66f35e054f368691db7e9bc5c219, user.id=aac5621f66b94887a9eb9ba5121f6c24) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:15.311699 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52127b37-f44d-4a0e-a2a9-8cbd46bb0a8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:15.313210 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52127b37-f44d-4a0e-a2a9-8cbd46bb0a8b None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:15.319876 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 157/318] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:36:15 2022] GET /identity/v3/role_assignments?user.id=aac5621f66b94887a9eb9ba5121f6c24&scope.project.id=b74b66f35e054f368691db7e9bc5c219&role.id=12d1e39175d748a09df9a7263b578070 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:15.485884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3aa94-d0b7-4537-ba33-d4b5be7c7828 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:15.486246 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3aa94-d0b7-4537-ba33-d4b5be7c7828 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:15.486434 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3aa94-d0b7-4537-ba33-d4b5be7c7828 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:15.488078 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 162/319] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:15.493478 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74196e8-ae3d-4317-bba7-9b7759f8edcb None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:15.493923 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74196e8-ae3d-4317-bba7-9b7759f8edcb None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:15.494199 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74196e8-ae3d-4317-bba7-9b7759f8edcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:15.513583 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-a74196e8-ae3d-4317-bba7-9b7759f8edcb None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:15.514787 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-a74196e8-ae3d-4317-bba7-9b7759f8edcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:15.586916 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 158/320] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:15.712020 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbb629-28db-4fae-9971-ef628c0c23f6 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:15.712583 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbb629-28db-4fae-9971-ef628c0c23f6 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:15.712583 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbb629-28db-4fae-9971-ef628c0c23f6 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:15.713980 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 163/321] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:15.720729 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e153b-97f8-4123-ae6a-f4ac9004a4b5 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:15.721016 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e153b-97f8-4123-ae6a-f4ac9004a4b5 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:15.721290 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e153b-97f8-4123-ae6a-f4ac9004a4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:15.740350 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-ad5e153b-97f8-4123-ae6a-f4ac9004a4b5 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:15.741598 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-ad5e153b-97f8-4123-ae6a-f4ac9004a4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:15.813378 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 159/322] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:15.848482 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbb629-28db-4fae-9971-ef628c0c23f6 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:15.924006 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9e4b5-0c67-4dc4-ae1d-066d3f598ab3 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:15.924353 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9e4b5-0c67-4dc4-ae1d-066d3f598ab3 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:15.924557 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9e4b5-0c67-4dc4-ae1d-066d3f598ab3 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:15.926106 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 160/323] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:36:15.930910 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46100bd6-4f12-4c3a-b31e-9b3ae2e39e3f None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:15.931192 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46100bd6-4f12-4c3a-b31e-9b3ae2e39e3f None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:15.931472 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46100bd6-4f12-4c3a-b31e-9b3ae2e39e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:15.947564 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:15.949547 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-46100bd6-4f12-4c3a-b31e-9b3ae2e39e3f None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:15.950915 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-46100bd6-4f12-4c3a-b31e-9b3ae2e39e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:15.952426 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbb629-28db-4fae-9971-ef628c0c23f6 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:15.965635 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:15.989478 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de173b-8618-42d4-be30-1c52e00a2396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:15.990114 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de173b-8618-42d4-be30-1c52e00a2396 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:15.990386 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de173b-8618-42d4-be30-1c52e00a2396 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:15.990682 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de173b-8618-42d4-be30-1c52e00a2396 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:16.000798 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de173b-8618-42d4-be30-1c52e00a2396 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:16.005828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-c8de173b-8618-42d4-be30-1c52e00a2396 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:36:16.005828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:16.005828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:16.005828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:16.005828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:16.005828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:16.005828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:16.005828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:16.005828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:16.005828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:16.005828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:16.005828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:16.005828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:16.005828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:16.005828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:16.005828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:16.006680 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:16.006680 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:16.006680 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:16.006680 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:16.006680 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:16.006680 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:16.006680 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:16.006680 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:16.006680 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:16.006680 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:16.006680 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:16.006680 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:16.006680 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:16.006680 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:16.006680 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:16.006680 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:16.007546 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:16.007546 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:16.007546 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:16.007546 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:16.007546 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:16.007546 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:16.007546 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:16.007546 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:16.007546 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:16.007546 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:16.007546 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:36:16.007546 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:16.007546 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 164/324] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:36:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:16.014441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de173b-8618-42d4-be30-1c52e00a2396 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:16.023855 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 161/325] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:36:16.077482 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46100bd6-4f12-4c3a-b31e-9b3ae2e39e3f None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:16.122119 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de173b-8618-42d4-be30-1c52e00a2396 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:16.163110 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66453f16-2aa8-4f26-88d5-7d21295eb731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:16.163748 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66453f16-2aa8-4f26-88d5-7d21295eb731 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:16.164037 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66453f16-2aa8-4f26-88d5-7d21295eb731 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:16.164313 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66453f16-2aa8-4f26-88d5-7d21295eb731 None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:16.165012 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66453f16-2aa8-4f26-88d5-7d21295eb731 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:16.165318 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66453f16-2aa8-4f26-88d5-7d21295eb731 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:16.166752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66453f16-2aa8-4f26-88d5-7d21295eb731 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:16.175435 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 165/326] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 24 04:36:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:16.181152 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66453f16-2aa8-4f26-88d5-7d21295eb731 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:16.193905 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46100bd6-4f12-4c3a-b31e-9b3ae2e39e3f None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:16.210538 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:16.229591 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d395e7-817f-4174-a340-38f989a39de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:16.230342 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d395e7-817f-4174-a340-38f989a39de2 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:16.230621 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d395e7-817f-4174-a340-38f989a39de2 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:16.230895 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d395e7-817f-4174-a340-38f989a39de2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:16.231989 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d395e7-817f-4174-a340-38f989a39de2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:16.233677 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d395e7-817f-4174-a340-38f989a39de2 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:16.235448 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 162/327] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:16.240800 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d395e7-817f-4174-a340-38f989a39de2 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:16.262253 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:16.286908 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66453f16-2aa8-4f26-88d5-7d21295eb731 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:16.319809 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58aa56c-6f83-4e9a-9356-ed1caddc44b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:16.320470 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58aa56c-6f83-4e9a-9356-ed1caddc44b5 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:16.320751 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58aa56c-6f83-4e9a-9356-ed1caddc44b5 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:16.321075 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58aa56c-6f83-4e9a-9356-ed1caddc44b5 None admin] PATH_INFO: `/v3/users/dfa16931bed8447eb94a3ee0c400031a` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:16.322533 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58aa56c-6f83-4e9a-9356-ed1caddc44b5 None admin] RBAC: Authorizing `identity:get_user(user_id=dfa16931bed8447eb94a3ee0c400031a)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:16.323985 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58aa56c-6f83-4e9a-9356-ed1caddc44b5 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:16.325628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 166/328] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:36:16 2022] GET /identity/v3/users/dfa16931bed8447eb94a3ee0c400031a => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:16.326387 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58aa56c-6f83-4e9a-9356-ed1caddc44b5 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:16.342020 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d395e7-817f-4174-a340-38f989a39de2 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:16.375722 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b2e73-b19d-4c6e-a313-b78edbf6bc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:16.376276 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b2e73-b19d-4c6e-a313-b78edbf6bc62 None admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:16.376552 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b2e73-b19d-4c6e-a313-b78edbf6bc62 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:16.376819 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b2e73-b19d-4c6e-a313-b78edbf6bc62 None admin] PATH_INFO: `/v3/groups` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:16.377480 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b2e73-b19d-4c6e-a313-b78edbf6bc62 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:16.379307 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b2e73-b19d-4c6e-a313-b78edbf6bc62 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:16.395637 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 163/329] 10.222.0.49 () {60 vars in 1134 bytes} [Wed Aug 24 04:36:16 2022] POST /identity/v3/groups => generated 226 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:36:16.395637 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b2e73-b19d-4c6e-a313-b78edbf6bc62 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:16.425676 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:16.439075 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58aa56c-6f83-4e9a-9356-ed1caddc44b5 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:16.479093 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858b150-9237-4cac-9afd-a24450475b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:16.479809 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858b150-9237-4cac-9afd-a24450475b73 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:16.480091 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858b150-9237-4cac-9afd-a24450475b73 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:16.480364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858b150-9237-4cac-9afd-a24450475b73 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:16.492943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858b150-9237-4cac-9afd-a24450475b73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:16.498631 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-1858b150-9237-4cac-9afd-a24450475b73 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:36:16.498631 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:16.498631 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:16.498631 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:16.498631 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:16.498631 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:16.498631 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:16.498631 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:16.498631 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:16.498631 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:16.498631 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:16.498631 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:16.498631 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:16.498631 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:16.498631 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:16.498631 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:16.499563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:16.499563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:16.499563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:16.499563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:16.499563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:16.499563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:16.499563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:16.499563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:16.499563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:16.499563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:16.499563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:16.499563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:16.499563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:16.499563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:16.499563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:16.499563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:16.500677 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:16.500677 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:16.500677 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:16.500677 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:16.500677 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:16.500677 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:16.500677 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:16.500677 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:16.500677 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:16.500677 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:16.500677 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:36:16.500677 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:16.500677 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 167/330] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:36:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:16.503723 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:16.506327 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858b150-9237-4cac-9afd-a24450475b73 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:16.533697 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b2e73-b19d-4c6e-a313-b78edbf6bc62 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:16.576984 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7421cf0-70e8-4916-bd36-9e943ca3b88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:16.578100 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7421cf0-70e8-4916-bd36-9e943ca3b88b None admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:16.578380 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7421cf0-70e8-4916-bd36-9e943ca3b88b None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:16.582131 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7421cf0-70e8-4916-bd36-9e943ca3b88b None admin] PATH_INFO: `/v3/system/users/dfa16931bed8447eb94a3ee0c400031a/roles/12d1e39175d748a09df9a7263b578070` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:16.582131 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7421cf0-70e8-4916-bd36-9e943ca3b88b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=dfa16931bed8447eb94a3ee0c400031a, role_id=12d1e39175d748a09df9a7263b578070)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:16.582131 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7421cf0-70e8-4916-bd36-9e943ca3b88b None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:16.591418 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 164/331] 10.222.0.49 () {58 vars in 1334 bytes} [Wed Aug 24 04:36:16 2022] PUT /identity/v3/system/users/dfa16931bed8447eb94a3ee0c400031a/roles/12d1e39175d748a09df9a7263b578070 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:36:16.623962 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858b150-9237-4cac-9afd-a24450475b73 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:16.673636 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd8ee9-3e88-47b8-8fc0-141621900248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:16.674207 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd8ee9-3e88-47b8-8fc0-141621900248 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:16.674576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd8ee9-3e88-47b8-8fc0-141621900248 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:16.674754 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dd8ee9-3e88-47b8-8fc0-141621900248 None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:16.675461 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd8ee9-3e88-47b8-8fc0-141621900248 None admin] RBAC: Adding query filter params (name=member) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:16.675771 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd8ee9-3e88-47b8-8fc0-141621900248 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:16.677281 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dd8ee9-3e88-47b8-8fc0-141621900248 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:16.688848 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 168/332] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 24 04:36:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:16.694800 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7421cf0-70e8-4916-bd36-9e943ca3b88b None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:16.805880 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7421cf0-70e8-4916-bd36-9e943ca3b88b None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:16.840271 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb95a6-4ca8-4d07-ba0e-f306e5af3dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:16.840998 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb95a6-4ca8-4d07-ba0e-f306e5af3dc7 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:16.841180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb95a6-4ca8-4d07-ba0e-f306e5af3dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:16.841473 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb95a6-4ca8-4d07-ba0e-f306e5af3dc7 None admin] PATH_INFO: `/v3/users/4299d9340975434ea40e71198cb6adc4` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:16.842621 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb95a6-4ca8-4d07-ba0e-f306e5af3dc7 None admin] RBAC: Authorizing `identity:get_user(user_id=4299d9340975434ea40e71198cb6adc4)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:16.844082 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb95a6-4ca8-4d07-ba0e-f306e5af3dc7 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:16.846037 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 165/333] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:36:16 2022] GET /identity/v3/users/4299d9340975434ea40e71198cb6adc4 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:16.852174 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd8ee9-3e88-47b8-8fc0-141621900248 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:16.870505 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:16.968040 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dd8ee9-3e88-47b8-8fc0-141621900248 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:17.004968 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba14810-0bce-468c-b10b-3665bbef6a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:17.005639 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba14810-0bce-468c-b10b-3665bbef6a88 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:17.005916 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba14810-0bce-468c-b10b-3665bbef6a88 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:17.006189 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba14810-0bce-468c-b10b-3665bbef6a88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:17.006928 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba14810-0bce-468c-b10b-3665bbef6a88 None admin] RBAC: Adding query filter params (role.id=e2eda359ee274ff1914db224f7f9b383, user.id=4299d9340975434ea40e71198cb6adc4, scope.system=all) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:17.007236 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba14810-0bce-468c-b10b-3665bbef6a88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:17.008761 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba14810-0bce-468c-b10b-3665bbef6a88 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:17.025508 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 169/334] 10.222.0.49 () {56 vars in 1308 bytes} [Wed Aug 24 04:36:16 2022] GET /identity/v3/role_assignments?user.id=4299d9340975434ea40e71198cb6adc4&scope.system=all&role.id=e2eda359ee274ff1914db224f7f9b383 => generated 510 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:18.631379 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a73830-7901-46eb-884b-f3f16f96b466 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:18.632436 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a73830-7901-46eb-884b-f3f16f96b466 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:18.632910 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a73830-7901-46eb-884b-f3f16f96b466 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:18.634856 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 166/335] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:18.640187 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe0bdb-e522-4b56-b65d-43e7f4b7069b None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:18.640636 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe0bdb-e522-4b56-b65d-43e7f4b7069b None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:18.640785 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe0bdb-e522-4b56-b65d-43e7f4b7069b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:18.666604 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-d2fe0bdb-e522-4b56-b65d-43e7f4b7069b None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:18.668042 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-d2fe0bdb-e522-4b56-b65d-43e7f4b7069b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:18.744681 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:18.752309 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 170/336] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:18.905420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16ac97-8c05-458c-9867-c92b4c07d7a8 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:18.905908 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16ac97-8c05-458c-9867-c92b4c07d7a8 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:18.906328 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16ac97-8c05-458c-9867-c92b4c07d7a8 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:18.908068 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 167/337] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:18.913808 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b77160-f0fc-4aa1-a988-2522d9ccb4bd None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:18.914246 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b77160-f0fc-4aa1-a988-2522d9ccb4bd None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:18.914666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b77160-f0fc-4aa1-a988-2522d9ccb4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:18.937495 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-f2b77160-f0fc-4aa1-a988-2522d9ccb4bd None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:18.938894 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-f2b77160-f0fc-4aa1-a988-2522d9ccb4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:19.019937 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb81778-625d-4f84-85c0-354b1d147bec None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:19.020451 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb81778-625d-4f84-85c0-354b1d147bec None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:19.020893 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb81778-625d-4f84-85c0-354b1d147bec None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:19.022732 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 168/338] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:19.028496 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b5a12-4be5-479a-8e9a-db5c5721006c None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:19.029092 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b5a12-4be5-479a-8e9a-db5c5721006c None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:19.029600 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b5a12-4be5-479a-8e9a-db5c5721006c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:19.032451 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 171/339] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:19.050709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-773b5a12-4be5-479a-8e9a-db5c5721006c None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:19.052326 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-773b5a12-4be5-479a-8e9a-db5c5721006c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:19.056656 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:19.140251 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 169/340] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:36:19.272656 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf50e5-7084-454e-915c-0cb9754c5ef7 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:19.272972 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf50e5-7084-454e-915c-0cb9754c5ef7 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:19.273138 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf50e5-7084-454e-915c-0cb9754c5ef7 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:19.274950 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 172/341] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:19.280427 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4faa57-8769-4958-9c8e-14eb0d36256c None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:19.280960 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4faa57-8769-4958-9c8e-14eb0d36256c None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:19.281487 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4faa57-8769-4958-9c8e-14eb0d36256c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:19.286291 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf50e5-7084-454e-915c-0cb9754c5ef7 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:19.318472 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-8f4faa57-8769-4958-9c8e-14eb0d36256c None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:19.320090 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-8f4faa57-8769-4958-9c8e-14eb0d36256c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:19.434128 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf50e5-7084-454e-915c-0cb9754c5ef7 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:19.436012 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 170/342] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:19.481840 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:19.491466 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354a707-f68a-45aa-8b71-024206f0e3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:19.492114 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354a707-f68a-45aa-8b71-024206f0e3a7 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:19.492389 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354a707-f68a-45aa-8b71-024206f0e3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:19.492658 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354a707-f68a-45aa-8b71-024206f0e3a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:19.502636 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4faa57-8769-4958-9c8e-14eb0d36256c None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:19.531158 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354a707-f68a-45aa-8b71-024206f0e3a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:19.545292 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-e354a707-f68a-45aa-8b71-024206f0e3a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:36:19.545292 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:19.545292 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:19.545292 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:19.545292 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:19.545292 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:19.545292 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:19.545292 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:19.545292 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:19.545292 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:19.545292 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:19.545292 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:19.545292 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:19.545292 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:19.545292 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:19.545292 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:19.546307 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:19.546307 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:19.546307 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:19.546307 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:19.546307 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:19.546307 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:19.546307 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:19.546307 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:19.546307 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:19.546307 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:19.546307 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:19.546307 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:19.546307 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:19.546307 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:19.546307 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:19.546307 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:19.547080 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:19.547080 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:19.547080 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:19.547080 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:19.547080 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:19.547080 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:19.547080 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:19.547080 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:19.547080 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:19.547080 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:19.547080 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:36:19.547080 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:19.547080 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 173/343] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:36:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:36:19.554616 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354a707-f68a-45aa-8b71-024206f0e3a7 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:19.636477 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:19.683934 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4faa57-8769-4958-9c8e-14eb0d36256c None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:19.723274 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8aba1-d212-4046-aa8e-6d550f4e2901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:19.724611 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8aba1-d212-4046-aa8e-6d550f4e2901 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:19.724715 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354a707-f68a-45aa-8b71-024206f0e3a7 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:19.726427 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8aba1-d212-4046-aa8e-6d550f4e2901 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:19.726713 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8aba1-d212-4046-aa8e-6d550f4e2901 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:19.749432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8aba1-d212-4046-aa8e-6d550f4e2901 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:19.754217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-f0f8aba1-d212-4046-aa8e-6d550f4e2901 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:36:19.754217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:19.754217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:19.754217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:19.754217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:19.754217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:19.754217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:19.754217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:19.754217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:19.754217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:19.754217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:19.754217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:19.754217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:19.754217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:19.754217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:19.754217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:19.755063 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:19.755063 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:19.755063 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:19.755063 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:19.755063 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:19.755063 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:19.755063 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:19.755063 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:19.755063 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:19.755063 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:19.755063 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:19.755063 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:19.755063 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:19.755063 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:19.755063 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:19.755063 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:19.756196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:19.756196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:19.756196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:19.756196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:19.756196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:19.756196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:19.756196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:19.756196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:19.756196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:19.756196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:19.756196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:36:19.756196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:19.756196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 171/344] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:36:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:36:19.756834 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8aba1-d212-4046-aa8e-6d550f4e2901 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:19.780788 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282468a-80c5-4cc2-9302-cee56d0a99b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:19.781549 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282468a-80c5-4cc2-9302-cee56d0a99b6 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:19.781778 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282468a-80c5-4cc2-9302-cee56d0a99b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:19.782052 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282468a-80c5-4cc2-9302-cee56d0a99b6 None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:19.782741 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282468a-80c5-4cc2-9302-cee56d0a99b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:19.783045 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282468a-80c5-4cc2-9302-cee56d0a99b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:19.784532 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282468a-80c5-4cc2-9302-cee56d0a99b6 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:19.794280 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 174/345] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 24 04:36:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:19.795175 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282468a-80c5-4cc2-9302-cee56d0a99b6 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:19.857783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:19.904735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282468a-80c5-4cc2-9302-cee56d0a99b6 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:19.944776 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db71857-5332-45b2-9b63-ec61a1f7db5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:19.945432 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db71857-5332-45b2-9b63-ec61a1f7db5e None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:19.945719 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db71857-5332-45b2-9b63-ec61a1f7db5e None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:19.946509 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db71857-5332-45b2-9b63-ec61a1f7db5e None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:19.947331 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db71857-5332-45b2-9b63-ec61a1f7db5e None admin] RBAC: Adding query filter params (name=reader) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:19.948067 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db71857-5332-45b2-9b63-ec61a1f7db5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:19.949774 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db71857-5332-45b2-9b63-ec61a1f7db5e None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:19.961750 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 175/346] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 24 04:36:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:19.962762 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db71857-5332-45b2-9b63-ec61a1f7db5e None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:19.973106 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8aba1-d212-4046-aa8e-6d550f4e2901 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:20.015734 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:20.025482 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ee51f-539e-4c1e-aa40-5d47eecda605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:20.026758 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ee51f-539e-4c1e-aa40-5d47eecda605 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:20.027091 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ee51f-539e-4c1e-aa40-5d47eecda605 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:20.027369 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ee51f-539e-4c1e-aa40-5d47eecda605 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:20.042226 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ee51f-539e-4c1e-aa40-5d47eecda605 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:20.048441 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-665ee51f-539e-4c1e-aa40-5d47eecda605 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:36:20.048441 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:20.048441 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:20.048441 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:20.048441 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:20.048441 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:20.048441 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:20.048441 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:20.048441 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:20.048441 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:20.048441 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:20.048441 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:20.048441 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:20.048441 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:20.048441 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:20.048441 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:20.049310 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:20.049310 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:20.049310 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:20.049310 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:20.049310 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:20.049310 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:20.049310 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:20.049310 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:20.049310 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:20.049310 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:20.049310 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:20.049310 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:20.049310 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:20.049310 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:20.049310 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:20.049310 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:20.050137 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:20.050137 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:20.050137 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:20.050137 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:20.050137 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:20.050137 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:20.050137 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:20.050137 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:20.050137 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:20.050137 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:20.050137 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:36:20.050137 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:20.050137 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 172/347] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 24 04:36:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:20.050867 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ee51f-539e-4c1e-aa40-5d47eecda605 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:20.083424 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db71857-5332-45b2-9b63-ec61a1f7db5e None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:20.098939 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:20.122008 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19b422-e85f-4c2f-bf1f-7b0890b25aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:20.122635 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19b422-e85f-4c2f-bf1f-7b0890b25aa0 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:20.122912 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19b422-e85f-4c2f-bf1f-7b0890b25aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:20.123183 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19b422-e85f-4c2f-bf1f-7b0890b25aa0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:20.171235 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ee51f-539e-4c1e-aa40-5d47eecda605 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:20.200168 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19b422-e85f-4c2f-bf1f-7b0890b25aa0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:20.201745 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b19b422-e85f-4c2f-bf1f-7b0890b25aa0 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:20.211070 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e677d6b-9357-4cff-9b77-be0e65a06cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:20.211716 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e677d6b-9357-4cff-9b77-be0e65a06cf1 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:20.211999 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e677d6b-9357-4cff-9b77-be0e65a06cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:20.212355 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e677d6b-9357-4cff-9b77-be0e65a06cf1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:20.224201 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e677d6b-9357-4cff-9b77-be0e65a06cf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:20.229834 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-3e677d6b-9357-4cff-9b77-be0e65a06cf1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:36:20.229834 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:20.229834 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:20.229834 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:20.229834 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:20.229834 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:20.229834 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:20.229834 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:20.229834 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:20.229834 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:20.229834 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:20.229834 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:20.229834 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:20.229834 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:20.229834 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:20.229834 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:20.230700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:20.230700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:20.230700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:20.230700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:20.230700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:20.230700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:20.230700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:20.230700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:20.230700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:20.230700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:20.230700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:20.230700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:20.230700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:20.230700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:20.230700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:20.230700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:20.231498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:20.231498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:20.231498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:20.231498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:20.231498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:20.231498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:20.231498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:20.231498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:20.231498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:20.231498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:20.231498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:36:20.231498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:20.231498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 173/348] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:36:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:20.232129 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e677d6b-9357-4cff-9b77-be0e65a06cf1 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:20.291835 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:20.341366 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e677d6b-9357-4cff-9b77-be0e65a06cf1 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:20.348643 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 176/349] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:36:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:36:20.351075 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19b422-e85f-4c2f-bf1f-7b0890b25aa0 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:20.369769 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:20.383335 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da32c1-739e-443f-98cb-19ab1f54477f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:20.383989 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da32c1-739e-443f-98cb-19ab1f54477f None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:20.384655 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da32c1-739e-443f-98cb-19ab1f54477f None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:20.384934 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5da32c1-739e-443f-98cb-19ab1f54477f None admin] PATH_INFO: `/v3/users/dfa16931bed8447eb94a3ee0c400031a` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:20.386457 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da32c1-739e-443f-98cb-19ab1f54477f None admin] RBAC: Authorizing `identity:get_user(user_id=dfa16931bed8447eb94a3ee0c400031a)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:20.388716 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5da32c1-739e-443f-98cb-19ab1f54477f None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:20.391374 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 174/350] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:36:20 2022] GET /identity/v3/users/dfa16931bed8447eb94a3ee0c400031a => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:20.392383 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da32c1-739e-443f-98cb-19ab1f54477f None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:20.465371 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19b422-e85f-4c2f-bf1f-7b0890b25aa0 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:20.507323 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5da32c1-739e-443f-98cb-19ab1f54477f None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:20.509380 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9b897-cc34-46d8-ba29-52ffc3a8ca00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:20.511017 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9b897-cc34-46d8-ba29-52ffc3a8ca00 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:20.511314 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9b897-cc34-46d8-ba29-52ffc3a8ca00 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:20.511591 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9b897-cc34-46d8-ba29-52ffc3a8ca00 None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:20.512345 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db9b897-cc34-46d8-ba29-52ffc3a8ca00 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:20.512660 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db9b897-cc34-46d8-ba29-52ffc3a8ca00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:20.514180 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db9b897-cc34-46d8-ba29-52ffc3a8ca00 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:20.527428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 177/351] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:20.528395 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9b897-cc34-46d8-ba29-52ffc3a8ca00 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:20.536352 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:20.555285 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70d0fa-f316-4840-b873-2dcb8a414a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:20.555904 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70d0fa-f316-4840-b873-2dcb8a414a32 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:20.556213 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70d0fa-f316-4840-b873-2dcb8a414a32 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:20.556478 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70d0fa-f316-4840-b873-2dcb8a414a32 None admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:20.557152 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de70d0fa-f316-4840-b873-2dcb8a414a32 None admin] RBAC: Adding query filter params (name=member) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:20.557902 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de70d0fa-f316-4840-b873-2dcb8a414a32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:20.559309 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de70d0fa-f316-4840-b873-2dcb8a414a32 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:20.567778 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 175/352] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 24 04:36:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:20.568610 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70d0fa-f316-4840-b873-2dcb8a414a32 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:20.632622 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:20.661483 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9b897-cc34-46d8-ba29-52ffc3a8ca00 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:20.700355 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70d0fa-f316-4840-b873-2dcb8a414a32 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:20.714230 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e85649-7ed5-431b-84c6-3dc9bc7d0298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:20.715630 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e85649-7ed5-431b-84c6-3dc9bc7d0298 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:20.716757 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e85649-7ed5-431b-84c6-3dc9bc7d0298 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:20.717446 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e85649-7ed5-431b-84c6-3dc9bc7d0298 None admin] PATH_INFO: `/v3/projects/33beb4c6e7a44d5a823b242c69b5c231` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:20.720301 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e85649-7ed5-431b-84c6-3dc9bc7d0298 None admin] RBAC: Authorizing `identity:get_project(project_id=33beb4c6e7a44d5a823b242c69b5c231)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:20.723114 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e85649-7ed5-431b-84c6-3dc9bc7d0298 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:20.726124 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 178/353] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:36:20 2022] GET /identity/v3/projects/33beb4c6e7a44d5a823b242c69b5c231 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:20.730142 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e85649-7ed5-431b-84c6-3dc9bc7d0298 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:20.761714 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876d504-1a55-4ff5-8124-0f04b7893097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:20.762348 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876d504-1a55-4ff5-8124-0f04b7893097 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:20.762625 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876d504-1a55-4ff5-8124-0f04b7893097 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:20.762895 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876d504-1a55-4ff5-8124-0f04b7893097 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:20.763635 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876d504-1a55-4ff5-8124-0f04b7893097 None admin] RBAC: Adding query filter params (role.id=12d1e39175d748a09df9a7263b578070, user.id=dfa16931bed8447eb94a3ee0c400031a, scope.system=all) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:20.763943 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876d504-1a55-4ff5-8124-0f04b7893097 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:20.765443 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876d504-1a55-4ff5-8124-0f04b7893097 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:20.781860 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 176/354] 10.222.0.49 () {56 vars in 1308 bytes} [Wed Aug 24 04:36:20 2022] GET /identity/v3/role_assignments?user.id=dfa16931bed8447eb94a3ee0c400031a&scope.system=all&role.id=12d1e39175d748a09df9a7263b578070 => generated 510 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:20.783224 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9f558-daa0-468d-bbc3-0aad31800a2d None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:20.783509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9f558-daa0-468d-bbc3-0aad31800a2d None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:20.783778 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9f558-daa0-468d-bbc3-0aad31800a2d None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:20.785292 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 177/355] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:20.785858 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9f558-daa0-468d-bbc3-0aad31800a2d None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:20.847217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:20.874932 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e85649-7ed5-431b-84c6-3dc9bc7d0298 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:20.918477 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b57a9a-74cf-45fc-a35c-7c2a818cb7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:20.919118 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b57a9a-74cf-45fc-a35c-7c2a818cb7e8 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:20.919403 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b57a9a-74cf-45fc-a35c-7c2a818cb7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:20.919680 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b57a9a-74cf-45fc-a35c-7c2a818cb7e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:20.947390 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9f558-daa0-468d-bbc3-0aad31800a2d None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:20.991563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:21.003654 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa0ebd-8c34-4ee2-9c47-2fb9e4708ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:21.004642 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa0ebd-8c34-4ee2-9c47-2fb9e4708ff5 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:21.005053 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa0ebd-8c34-4ee2-9c47-2fb9e4708ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:21.005514 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa0ebd-8c34-4ee2-9c47-2fb9e4708ff5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:21.013597 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b57a9a-74cf-45fc-a35c-7c2a818cb7e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:21.015091 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b57a9a-74cf-45fc-a35c-7c2a818cb7e8 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:21.095674 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa0ebd-8c34-4ee2-9c47-2fb9e4708ff5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:21.097460 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa0ebd-8c34-4ee2-9c47-2fb9e4708ff5 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:21.148278 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 179/356] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:36:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:36:21.148278 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b57a9a-74cf-45fc-a35c-7c2a818cb7e8 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:21.156350 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:21.214871 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:21.242148 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 178/357] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:36:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:36:21.243591 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe9082-4de1-48b2-8186-ce9750f8f1a8 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:21.244002 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe9082-4de1-48b2-8186-ce9750f8f1a8 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:21.244389 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe9082-4de1-48b2-8186-ce9750f8f1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:21.262836 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-4cbe9082-4de1-48b2-8186-ce9750f8f1a8 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:21.264050 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-4cbe9082-4de1-48b2-8186-ce9750f8f1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:21.289191 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b57a9a-74cf-45fc-a35c-7c2a818cb7e8 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:21.331054 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae678a-cb48-4afe-9e12-606a01069f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:21.331706 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae678a-cb48-4afe-9e12-606a01069f80 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:21.331986 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae678a-cb48-4afe-9e12-606a01069f80 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:21.332258 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae678a-cb48-4afe-9e12-606a01069f80 None admin] PATH_INFO: `/v3/groups/c75cff3c8b414b43abcb2e2cc91236ae` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:21.339035 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae678a-cb48-4afe-9e12-606a01069f80 None admin] RBAC: Authorizing `identity:get_group(group_id=c75cff3c8b414b43abcb2e2cc91236ae)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:21.340515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae678a-cb48-4afe-9e12-606a01069f80 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:21.342423 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 180/358] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 24 04:36:21 2022] GET /identity/v3/groups/c75cff3c8b414b43abcb2e2cc91236ae => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:21.343059 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae678a-cb48-4afe-9e12-606a01069f80 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:21.344491 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 179/359] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:21.345983 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544020b-cf66-4d51-8eab-614be5f175d0 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:21.346317 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544020b-cf66-4d51-8eab-614be5f175d0 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:21.349570 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544020b-cf66-4d51-8eab-614be5f175d0 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:21.351011 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 180/360] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:21.352697 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544020b-cf66-4d51-8eab-614be5f175d0 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:21.435790 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:21.480004 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae678a-cb48-4afe-9e12-606a01069f80 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:21.481597 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544020b-cf66-4d51-8eab-614be5f175d0 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:21.490866 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:21.524571 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ea176-a7e4-4309-86ab-d1777b3bd738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:21.525714 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ea176-a7e4-4309-86ab-d1777b3bd738 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:21.526254 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ea176-a7e4-4309-86ab-d1777b3bd738 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:21.526767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ea176-a7e4-4309-86ab-d1777b3bd738 None admin] PATH_INFO: `/v3/projects/33beb4c6e7a44d5a823b242c69b5c231` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:21.526903 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589b692-2f64-47cc-b794-07c07bd6fc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:21.527521 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589b692-2f64-47cc-b794-07c07bd6fc07 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:21.527805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589b692-2f64-47cc-b794-07c07bd6fc07 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:21.528092 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589b692-2f64-47cc-b794-07c07bd6fc07 None admin] PATH_INFO: `/v3/projects/b74b66f35e054f368691db7e9bc5c219` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:21.528187 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ea176-a7e4-4309-86ab-d1777b3bd738 None admin] RBAC: Authorizing `identity:get_project(project_id=33beb4c6e7a44d5a823b242c69b5c231)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:21.529189 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589b692-2f64-47cc-b794-07c07bd6fc07 None admin] RBAC: Authorizing `identity:get_project(project_id=b74b66f35e054f368691db7e9bc5c219)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:21.529683 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ea176-a7e4-4309-86ab-d1777b3bd738 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:21.530701 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589b692-2f64-47cc-b794-07c07bd6fc07 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:21.531409 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 181/361] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:36:21 2022] GET /identity/v3/projects/33beb4c6e7a44d5a823b242c69b5c231 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:21.532632 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 181/362] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:36:21 2022] GET /identity/v3/projects/b74b66f35e054f368691db7e9bc5c219 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:21.533938 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95757212-acbb-465b-874d-5d404362ff32 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:21.534218 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95757212-acbb-465b-874d-5d404362ff32 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:21.534495 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95757212-acbb-465b-874d-5d404362ff32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:21.541698 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ea176-a7e4-4309-86ab-d1777b3bd738 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:21.554205 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-95757212-acbb-465b-874d-5d404362ff32 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:21.555436 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-95757212-acbb-465b-874d-5d404362ff32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:21.645067 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 182/363] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:21.646301 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95757212-acbb-465b-874d-5d404362ff32 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:21.670840 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ea176-a7e4-4309-86ab-d1777b3bd738 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:21.720376 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f1137-e931-4971-aefc-482ceac57334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:21.720376 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f1137-e931-4971-aefc-482ceac57334 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:21.720376 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f1137-e931-4971-aefc-482ceac57334 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:21.720376 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f1137-e931-4971-aefc-482ceac57334 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:21.720827 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f1137-e931-4971-aefc-482ceac57334 None admin] RBAC: Adding query filter params (group.id=c75cff3c8b414b43abcb2e2cc91236ae, role.id=e2eda359ee274ff1914db224f7f9b383, scope.project.id=33beb4c6e7a44d5a823b242c69b5c231) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:21.721073 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f1137-e931-4971-aefc-482ceac57334 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:21.722627 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f1137-e931-4971-aefc-482ceac57334 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:21.729717 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 182/364] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Aug 24 04:36:21 2022] GET /identity/v3/role_assignments?group.id=c75cff3c8b414b43abcb2e2cc91236ae&scope.project.id=33beb4c6e7a44d5a823b242c69b5c231&role.id=e2eda359ee274ff1914db224f7f9b383 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:21.730779 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f1137-e931-4971-aefc-482ceac57334 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:21.733067 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:21.788340 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95757212-acbb-465b-874d-5d404362ff32 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:21.802517 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:21.841287 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbc3b9-6330-4c6f-ab98-b714932dfd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:21.842270 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbc3b9-6330-4c6f-ab98-b714932dfd4e None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:21.842651 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbc3b9-6330-4c6f-ab98-b714932dfd4e None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:21.843021 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfbc3b9-6330-4c6f-ab98-b714932dfd4e None admin] PATH_INFO: `/v3/groups/c75cff3c8b414b43abcb2e2cc91236ae` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:21.844352 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbc3b9-6330-4c6f-ab98-b714932dfd4e None admin] RBAC: Authorizing `identity:get_group(group_id=c75cff3c8b414b43abcb2e2cc91236ae)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:21.845972 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfbc3b9-6330-4c6f-ab98-b714932dfd4e None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:21.847920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 183/365] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 24 04:36:21 2022] GET /identity/v3/groups/c75cff3c8b414b43abcb2e2cc91236ae => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:21.848863 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbc3b9-6330-4c6f-ab98-b714932dfd4e None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:21.883806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f1137-e931-4971-aefc-482ceac57334 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:21.928067 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861e8a6-2243-44a3-990b-1d493f1e2631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:21.928958 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861e8a6-2243-44a3-990b-1d493f1e2631 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:21.929499 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861e8a6-2243-44a3-990b-1d493f1e2631 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:21.929939 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861e8a6-2243-44a3-990b-1d493f1e2631 None admin] PATH_INFO: `/v3/groups/c75cff3c8b414b43abcb2e2cc91236ae` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:21.931667 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0861e8a6-2243-44a3-990b-1d493f1e2631 None admin] RBAC: Authorizing `identity:get_group(group_id=c75cff3c8b414b43abcb2e2cc91236ae)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:21.933388 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0861e8a6-2243-44a3-990b-1d493f1e2631 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:21.936409 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 183/366] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 24 04:36:21 2022] GET /identity/v3/groups/c75cff3c8b414b43abcb2e2cc91236ae => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:21.937544 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861e8a6-2243-44a3-990b-1d493f1e2631 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:21.994979 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfbc3b9-6330-4c6f-ab98-b714932dfd4e None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:22.040302 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8969afc-9b77-4760-ad51-1dacd01e0a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:22.041087 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8969afc-9b77-4760-ad51-1dacd01e0a92 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:22.041586 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8969afc-9b77-4760-ad51-1dacd01e0a92 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:22.041977 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8969afc-9b77-4760-ad51-1dacd01e0a92 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:22.044315 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:22.056694 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8969afc-9b77-4760-ad51-1dacd01e0a92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:22.057954 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861e8a6-2243-44a3-990b-1d493f1e2631 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:22.062277 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-f8969afc-9b77-4760-ad51-1dacd01e0a92 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:36:22.062277 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:22.062277 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:22.062277 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:22.062277 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:22.062277 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:22.062277 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:22.062277 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:22.062277 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:22.062277 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:22.062277 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:22.062277 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:22.062277 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:22.062277 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:22.062277 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:22.062277 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:22.063172 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:22.063172 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:22.063172 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:22.063172 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:22.063172 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:22.063172 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:22.063172 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:22.063172 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:22.063172 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:22.063172 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:22.063172 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:22.063172 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:22.063172 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:22.063172 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:22.063172 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:22.063172 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:22.063945 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:22.063945 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:22.063945 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:22.063945 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:22.063945 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:22.063945 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:22.063945 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:22.063945 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:22.063945 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:22.063945 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:22.063945 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:36:22.063945 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:22.063945 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 184/367] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 24 04:36:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:22.065713 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8969afc-9b77-4760-ad51-1dacd01e0a92 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:22.068216 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:22.102729 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330238d0-f71a-40f8-a789-18c65125e003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:22.103458 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330238d0-f71a-40f8-a789-18c65125e003 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:22.103862 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330238d0-f71a-40f8-a789-18c65125e003 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:22.104197 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330238d0-f71a-40f8-a789-18c65125e003 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:22.105005 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330238d0-f71a-40f8-a789-18c65125e003 None admin] RBAC: Adding query filter params (group.id=c75cff3c8b414b43abcb2e2cc91236ae, role.id=e2eda359ee274ff1914db224f7f9b383, scope.project.id=b74b66f35e054f368691db7e9bc5c219) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:22.105316 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330238d0-f71a-40f8-a789-18c65125e003 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:22.107261 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330238d0-f71a-40f8-a789-18c65125e003 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:22.113322 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 184/368] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Aug 24 04:36:21 2022] GET /identity/v3/role_assignments?group.id=c75cff3c8b414b43abcb2e2cc91236ae&scope.project.id=b74b66f35e054f368691db7e9bc5c219&role.id=e2eda359ee274ff1914db224f7f9b383 => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:22.120115 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330238d0-f71a-40f8-a789-18c65125e003 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:22.207108 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8969afc-9b77-4760-ad51-1dacd01e0a92 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:22.248210 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330238d0-f71a-40f8-a789-18c65125e003 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:22.251998 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2db58-910d-42e7-9734-2466999b109f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:22.252667 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2db58-910d-42e7-9734-2466999b109f None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:22.252946 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2db58-910d-42e7-9734-2466999b109f None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:22.253221 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2db58-910d-42e7-9734-2466999b109f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:22.268153 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2db58-910d-42e7-9734-2466999b109f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:22.273564 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-0aa2db58-910d-42e7-9734-2466999b109f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:36:22.273564 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:22.273564 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:22.273564 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:22.273564 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:22.273564 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:22.273564 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:22.273564 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:22.273564 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:22.273564 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:22.273564 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:22.273564 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:22.273564 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:22.273564 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:22.273564 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:22.273564 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:22.274512 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:22.274512 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:22.274512 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:22.274512 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:22.274512 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:22.274512 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:22.274512 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:22.274512 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:22.274512 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:22.274512 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:22.274512 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:22.274512 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:22.274512 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:22.274512 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:22.274512 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:22.274512 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:22.275271 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:22.275271 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:22.275271 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:22.275271 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:22.275271 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:22.275271 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:22.275271 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:22.275271 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:22.275271 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:22.275271 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:22.275271 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:36:22.275271 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:22.275271 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 185/369] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 24 04:36:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:22.275960 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2db58-910d-42e7-9734-2466999b109f None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:22.306231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62215616-0bdf-4733-8aa1-c0e233eb50c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:22.306982 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62215616-0bdf-4733-8aa1-c0e233eb50c3 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:22.307261 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62215616-0bdf-4733-8aa1-c0e233eb50c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:22.307724 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62215616-0bdf-4733-8aa1-c0e233eb50c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:22.308493 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62215616-0bdf-4733-8aa1-c0e233eb50c3 None admin] RBAC: Adding query filter params (group.id=c75cff3c8b414b43abcb2e2cc91236ae, role.id=3c2269f848184abd93ef97d02f6553e4, scope.project.id=33beb4c6e7a44d5a823b242c69b5c231) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:22.308802 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62215616-0bdf-4733-8aa1-c0e233eb50c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:22.310297 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62215616-0bdf-4733-8aa1-c0e233eb50c3 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:22.319083 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 185/370] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Aug 24 04:36:22 2022] GET /identity/v3/role_assignments?group.id=c75cff3c8b414b43abcb2e2cc91236ae&scope.project.id=33beb4c6e7a44d5a823b242c69b5c231&role.id=3c2269f848184abd93ef97d02f6553e4 => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:22.320489 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62215616-0bdf-4733-8aa1-c0e233eb50c3 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:22.352014 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:22.366777 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:22.409663 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2db58-910d-42e7-9734-2466999b109f None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:22.480582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c689a32-3432-487b-be39-af095af85772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:22.481210 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c689a32-3432-487b-be39-af095af85772 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:22.481517 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c689a32-3432-487b-be39-af095af85772 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:22.481791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c689a32-3432-487b-be39-af095af85772 None admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:22.482485 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c689a32-3432-487b-be39-af095af85772 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:22.482793 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c689a32-3432-487b-be39-af095af85772 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:22.484225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c689a32-3432-487b-be39-af095af85772 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:22.500792 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62215616-0bdf-4733-8aa1-c0e233eb50c3 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:22.505344 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 186/371] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:22.511447 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c689a32-3432-487b-be39-af095af85772 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:22.548751 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798d0a7-c0f6-424c-a0db-1daf80b9371e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:22.549419 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798d0a7-c0f6-424c-a0db-1daf80b9371e None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:22.549705 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798d0a7-c0f6-424c-a0db-1daf80b9371e None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:22.549983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798d0a7-c0f6-424c-a0db-1daf80b9371e None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:22.550671 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798d0a7-c0f6-424c-a0db-1daf80b9371e None admin] RBAC: Adding query filter params (name=admin) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:22.550972 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798d0a7-c0f6-424c-a0db-1daf80b9371e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:22.552357 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798d0a7-c0f6-424c-a0db-1daf80b9371e None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:22.562494 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 186/372] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:36:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:22.568093 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798d0a7-c0f6-424c-a0db-1daf80b9371e None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:22.638433 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c689a32-3432-487b-be39-af095af85772 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:22.657699 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:22.677404 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b83ad-8d18-4f21-9770-cb05636195ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:22.678029 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b83ad-8d18-4f21-9770-cb05636195ed None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:22.678310 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b83ad-8d18-4f21-9770-cb05636195ed None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:22.678573 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b83ad-8d18-4f21-9770-cb05636195ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:22.688312 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:22.692780 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798d0a7-c0f6-424c-a0db-1daf80b9371e None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:22.745035 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87c48b-3a51-497e-bcb5-0786f78335b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:22.745698 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87c48b-3a51-497e-bcb5-0786f78335b7 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:22.746004 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87c48b-3a51-497e-bcb5-0786f78335b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:22.746280 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87c48b-3a51-497e-bcb5-0786f78335b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:22.751679 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b83ad-8d18-4f21-9770-cb05636195ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:22.753078 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b83ad-8d18-4f21-9770-cb05636195ed None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:22.823775 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff87c48b-3a51-497e-bcb5-0786f78335b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:22.825664 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff87c48b-3a51-497e-bcb5-0786f78335b7 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:22.870192 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 187/373] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:36:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 04:36:22.878382 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b83ad-8d18-4f21-9770-cb05636195ed None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:22.901227 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:22.936074 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:22.941280 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 187/374] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:36:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 04:36:22.947304 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87c48b-3a51-497e-bcb5-0786f78335b7 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:23.018818 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b83ad-8d18-4f21-9770-cb05636195ed None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:23.054317 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87c48b-3a51-497e-bcb5-0786f78335b7 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:23.079044 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5823345f-d4d5-4c95-aa99-5c389743fcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:23.079692 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823345f-d4d5-4c95-aa99-5c389743fcea None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:23.079970 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823345f-d4d5-4c95-aa99-5c389743fcea None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:23.080295 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823345f-d4d5-4c95-aa99-5c389743fcea None admin] PATH_INFO: `/v3/projects/b74b66f35e054f368691db7e9bc5c219` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:23.086061 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5823345f-d4d5-4c95-aa99-5c389743fcea None admin] RBAC: Authorizing `identity:get_project(project_id=b74b66f35e054f368691db7e9bc5c219)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:23.087507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5823345f-d4d5-4c95-aa99-5c389743fcea None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:23.089309 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 188/375] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:36:22 2022] GET /identity/v3/projects/b74b66f35e054f368691db7e9bc5c219 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:23.091168 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a3fa9-76b8-4873-8dd3-cc8892b00417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:23.091811 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a3fa9-76b8-4873-8dd3-cc8892b00417 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:23.092088 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a3fa9-76b8-4873-8dd3-cc8892b00417 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:23.092360 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a3fa9-76b8-4873-8dd3-cc8892b00417 None admin] PATH_INFO: `/v3/projects/68ea81c5f7c24dfdae5a0b686d31ba39` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:23.093552 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a3fa9-76b8-4873-8dd3-cc8892b00417 None admin] RBAC: Authorizing `identity:get_project(project_id=68ea81c5f7c24dfdae5a0b686d31ba39)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:23.094869 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5823345f-d4d5-4c95-aa99-5c389743fcea None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:23.095107 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a3fa9-76b8-4873-8dd3-cc8892b00417 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:23.097001 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 188/376] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:36:22 2022] GET /identity/v3/projects/68ea81c5f7c24dfdae5a0b686d31ba39 => generated 344 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:23.102262 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a3fa9-76b8-4873-8dd3-cc8892b00417 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:23.185817 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:23.261043 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:23.265887 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a3fa9-76b8-4873-8dd3-cc8892b00417 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:23.310443 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5823345f-d4d5-4c95-aa99-5c389743fcea None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:23.368498 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5b26e-7798-43e9-874e-beb89f384931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:23.369151 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5b26e-7798-43e9-874e-beb89f384931 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:23.369453 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5b26e-7798-43e9-874e-beb89f384931 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:23.369830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5b26e-7798-43e9-874e-beb89f384931 None admin] PATH_INFO: `/v3/groups/98b2a03dcaf242e6841a57e6059f1a3b` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:23.381190 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e5b26e-7798-43e9-874e-beb89f384931 None admin] RBAC: Authorizing `identity:get_group(group_id=98b2a03dcaf242e6841a57e6059f1a3b)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:23.384539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e5b26e-7798-43e9-874e-beb89f384931 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:23.388812 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 189/377] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 24 04:36:23 2022] GET /identity/v3/groups/98b2a03dcaf242e6841a57e6059f1a3b => generated 229 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:23.403417 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252713d-9568-4156-bc6f-695f439a502b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:23.404068 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252713d-9568-4156-bc6f-695f439a502b None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:23.404349 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252713d-9568-4156-bc6f-695f439a502b None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:23.405124 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b252713d-9568-4156-bc6f-695f439a502b None admin] PATH_INFO: `/v3/groups/c75cff3c8b414b43abcb2e2cc91236ae` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:23.408527 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5b26e-7798-43e9-874e-beb89f384931 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:23.413546 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252713d-9568-4156-bc6f-695f439a502b None admin] RBAC: Authorizing `identity:get_group(group_id=c75cff3c8b414b43abcb2e2cc91236ae)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:23.420453 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b252713d-9568-4156-bc6f-695f439a502b None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:23.423373 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 189/378] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 24 04:36:23 2022] GET /identity/v3/groups/c75cff3c8b414b43abcb2e2cc91236ae => generated 226 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:23.429763 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252713d-9568-4156-bc6f-695f439a502b None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:23.610369 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b252713d-9568-4156-bc6f-695f439a502b None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:23.625378 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5b26e-7798-43e9-874e-beb89f384931 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:23.689207 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:23.689461 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d93170-7482-410d-9fe6-4a6d7c882704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:23.690847 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d93170-7482-410d-9fe6-4a6d7c882704 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:23.691253 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d93170-7482-410d-9fe6-4a6d7c882704 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:23.691728 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d93170-7482-410d-9fe6-4a6d7c882704 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:23.692504 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d93170-7482-410d-9fe6-4a6d7c882704 None admin] RBAC: Adding query filter params (group.id=c75cff3c8b414b43abcb2e2cc91236ae, role.id=3c2269f848184abd93ef97d02f6553e4, scope.project.id=b74b66f35e054f368691db7e9bc5c219) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:23.692816 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d93170-7482-410d-9fe6-4a6d7c882704 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:23.694463 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d93170-7482-410d-9fe6-4a6d7c882704 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:23.701385 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 190/379] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Aug 24 04:36:23 2022] GET /identity/v3/role_assignments?group.id=c75cff3c8b414b43abcb2e2cc91236ae&scope.project.id=b74b66f35e054f368691db7e9bc5c219&role.id=3c2269f848184abd93ef97d02f6553e4 => generated 260 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:23.710907 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd381291-f498-48e1-a1b6-0574da460180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:23.711843 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd381291-f498-48e1-a1b6-0574da460180 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:23.712323 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd381291-f498-48e1-a1b6-0574da460180 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:23.712800 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd381291-f498-48e1-a1b6-0574da460180 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:23.714116 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd381291-f498-48e1-a1b6-0574da460180 None admin] RBAC: Adding query filter params (group.id=98b2a03dcaf242e6841a57e6059f1a3b, role.id=74ce7b72bcc94a8a8ad65c3db928e6ac, scope.project.id=68ea81c5f7c24dfdae5a0b686d31ba39) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:23.714641 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd381291-f498-48e1-a1b6-0574da460180 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:23.717311 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd381291-f498-48e1-a1b6-0574da460180 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:23.734673 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 190/380] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Aug 24 04:36:23 2022] GET /identity/v3/role_assignments?group.id=98b2a03dcaf242e6841a57e6059f1a3b&scope.project.id=68ea81c5f7c24dfdae5a0b686d31ba39&role.id=74ce7b72bcc94a8a8ad65c3db928e6ac => generated 260 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:24.262852 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ef330-f936-4031-826f-16ba32fcc8fe None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:24.263391 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ef330-f936-4031-826f-16ba32fcc8fe None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:24.263482 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ef330-f936-4031-826f-16ba32fcc8fe None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:24.265013 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 191/381] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:24.272190 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93650b-ccc5-408b-90bb-5d1b9635ff60 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:24.272724 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93650b-ccc5-408b-90bb-5d1b9635ff60 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:24.273140 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93650b-ccc5-408b-90bb-5d1b9635ff60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:24.309463 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-de93650b-ccc5-408b-90bb-5d1b9635ff60 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:24.311308 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-de93650b-ccc5-408b-90bb-5d1b9635ff60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:24.403782 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 191/382] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:24.586485 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6ab86-c08d-4e4a-91a3-c86de0db3193 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:24.586844 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6ab86-c08d-4e4a-91a3-c86de0db3193 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:24.587014 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6ab86-c08d-4e4a-91a3-c86de0db3193 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:24.588350 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 192/383] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:24.594126 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d16b65-12de-4eaa-bc84-546074925474 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:24.594418 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d16b65-12de-4eaa-bc84-546074925474 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:24.594696 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d16b65-12de-4eaa-bc84-546074925474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:24.618255 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-e5d16b65-12de-4eaa-bc84-546074925474 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:24.619492 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-e5d16b65-12de-4eaa-bc84-546074925474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:24.719764 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 192/384] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:36:24.737248 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6ab86-c08d-4e4a-91a3-c86de0db3193 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:24.758456 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:24.877171 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6ab86-c08d-4e4a-91a3-c86de0db3193 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:24.918664 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91ede2-af0c-4086-82e6-7d8ed99622af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:24.919901 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91ede2-af0c-4086-82e6-7d8ed99622af None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:24.920381 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91ede2-af0c-4086-82e6-7d8ed99622af None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:24.920859 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91ede2-af0c-4086-82e6-7d8ed99622af None admin] PATH_INFO: `/v3/roles/member` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:24.934119 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91ede2-af0c-4086-82e6-7d8ed99622af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:24.939758 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-2a91ede2-af0c-4086-82e6-7d8ed99622af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:36:24.939758 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:24.939758 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:24.939758 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:24.939758 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:24.939758 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:24.939758 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:24.939758 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:24.939758 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:24.939758 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:24.939758 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:24.939758 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:24.939758 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:24.939758 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:24.939758 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:24.939758 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:24.940673 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:24.940673 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:24.940673 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:24.940673 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:24.940673 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:24.940673 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:24.940673 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:24.940673 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:24.940673 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:24.940673 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:24.940673 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:24.940673 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:24.940673 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:24.940673 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:24.940673 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:24.940673 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:24.941526 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:24.941526 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:24.941526 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:24.941526 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:24.941526 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:24.941526 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:24.941526 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:24.941526 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:24.941526 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:24.941526 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:24.941526 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:36:24.941526 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:24.947254 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 193/385] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:36:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:24.950894 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d16b65-12de-4eaa-bc84-546074925474 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:25.019892 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:25.033011 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91ede2-af0c-4086-82e6-7d8ed99622af None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:25.085236 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d16b65-12de-4eaa-bc84-546074925474 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:25.139953 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42feef9-c43b-462c-bb84-675ae67fbd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:25.140595 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42feef9-c43b-462c-bb84-675ae67fbd92 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:25.140879 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42feef9-c43b-462c-bb84-675ae67fbd92 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:25.141215 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42feef9-c43b-462c-bb84-675ae67fbd92 None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:25.142023 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42feef9-c43b-462c-bb84-675ae67fbd92 None admin] RBAC: Adding query filter params (name=member) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:25.142521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42feef9-c43b-462c-bb84-675ae67fbd92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:25.144748 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42feef9-c43b-462c-bb84-675ae67fbd92 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:25.145746 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:25.161187 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 193/386] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 24 04:36:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:25.161187 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57be487-a7df-4dfb-af70-7b8ac440fa9a None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:25.161187 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57be487-a7df-4dfb-af70-7b8ac440fa9a None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:25.161187 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57be487-a7df-4dfb-af70-7b8ac440fa9a None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:25.161976 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 194/387] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:25.171837 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f408f-cd76-44d8-b607-bde13e8ccd6e None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:25.172119 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f408f-cd76-44d8-b607-bde13e8ccd6e None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:25.172388 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f408f-cd76-44d8-b607-bde13e8ccd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:25.187996 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91ede2-af0c-4086-82e6-7d8ed99622af None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:25.197641 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-ae9f408f-cd76-44d8-b607-bde13e8ccd6e None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:25.198909 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-ae9f408f-cd76-44d8-b607-bde13e8ccd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:25.233949 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ffa34-1ab1-4321-8fe3-d03df8d44b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:25.234598 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ffa34-1ab1-4321-8fe3-d03df8d44b70 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:25.234879 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ffa34-1ab1-4321-8fe3-d03df8d44b70 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:25.235425 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ffa34-1ab1-4321-8fe3-d03df8d44b70 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:25.253863 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ffa34-1ab1-4321-8fe3-d03df8d44b70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:25.266188 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-009ffa34-1ab1-4321-8fe3-d03df8d44b70 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:36:25.266188 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:25.266188 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:25.266188 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:25.266188 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:25.266188 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:25.266188 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:25.266188 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:25.266188 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:25.266188 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:25.266188 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:25.266188 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:25.266188 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:25.266188 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:25.266188 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:25.266188 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:25.267661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:25.267661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:25.267661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:25.267661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:25.267661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:25.267661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:25.267661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:25.267661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:25.267661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:25.267661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:25.267661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:25.267661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:25.267661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:25.267661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:25.267661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:25.267661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:25.268435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:25.268435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:25.268435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:25.268435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:25.268435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:25.268435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:25.268435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:25.268435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:25.268435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:25.268435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:25.268435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:36:25.268435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:25.269034 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 194/388] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:36:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:36:25.273366 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ffa34-1ab1-4321-8fe3-d03df8d44b70 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:25.296571 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 195/389] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:25.298153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f408f-cd76-44d8-b607-bde13e8ccd6e None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:25.423900 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:25.533993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ffa34-1ab1-4321-8fe3-d03df8d44b70 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:25.564072 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f408f-cd76-44d8-b607-bde13e8ccd6e None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:25.570126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbd39a-4956-4e14-bc37-477d3feaac3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:25.570770 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbd39a-4956-4e14-bc37-477d3feaac3f None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:25.571047 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbd39a-4956-4e14-bc37-477d3feaac3f None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:25.571313 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbd39a-4956-4e14-bc37-477d3feaac3f None admin] PATH_INFO: `/v3/groups/c75cff3c8b414b43abcb2e2cc91236ae` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:25.572436 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfbd39a-4956-4e14-bc37-477d3feaac3f None admin] RBAC: Authorizing `identity:get_group(group_id=c75cff3c8b414b43abcb2e2cc91236ae)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:25.573952 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfbd39a-4956-4e14-bc37-477d3feaac3f None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:25.575836 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 195/390] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 24 04:36:25 2022] GET /identity/v3/groups/c75cff3c8b414b43abcb2e2cc91236ae => generated 226 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:25.581257 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbd39a-4956-4e14-bc37-477d3feaac3f None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:25.584885 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:25.603250 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5a0db-9c56-4a4f-be7e-8e2b85ec2d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:25.603867 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5a0db-9c56-4a4f-be7e-8e2b85ec2d7e None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:25.604148 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5a0db-9c56-4a4f-be7e-8e2b85ec2d7e None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:25.604419 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5a0db-9c56-4a4f-be7e-8e2b85ec2d7e None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:25.605132 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5a0db-9c56-4a4f-be7e-8e2b85ec2d7e None admin] RBAC: Adding query filter params (name=member) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:25.605474 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5a0db-9c56-4a4f-be7e-8e2b85ec2d7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:25.607030 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5a0db-9c56-4a4f-be7e-8e2b85ec2d7e None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:25.616377 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 196/391] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 24 04:36:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:25.623841 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5a0db-9c56-4a4f-be7e-8e2b85ec2d7e None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:25.705198 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbd39a-4956-4e14-bc37-477d3feaac3f None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:25.746660 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ceb42-78fe-47a7-a712-5f75317576e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:25.747316 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ceb42-78fe-47a7-a712-5f75317576e4 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:25.747600 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ceb42-78fe-47a7-a712-5f75317576e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:25.747873 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ceb42-78fe-47a7-a712-5f75317576e4 None admin] PATH_INFO: `/v3/projects/33beb4c6e7a44d5a823b242c69b5c231` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:25.749631 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ceb42-78fe-47a7-a712-5f75317576e4 None admin] RBAC: Authorizing `identity:get_project(project_id=33beb4c6e7a44d5a823b242c69b5c231)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:25.752056 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ceb42-78fe-47a7-a712-5f75317576e4 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:25.755151 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 196/392] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:36:25 2022] GET /identity/v3/projects/33beb4c6e7a44d5a823b242c69b5c231 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:25.756399 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ceb42-78fe-47a7-a712-5f75317576e4 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:25.785538 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5a0db-9c56-4a4f-be7e-8e2b85ec2d7e None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:25.796050 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:25.826032 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d59ad-2686-41a0-af94-52b635097f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:25.826843 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d59ad-2686-41a0-af94-52b635097f19 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:25.827122 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d59ad-2686-41a0-af94-52b635097f19 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:25.827390 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d59ad-2686-41a0-af94-52b635097f19 None admin] PATH_INFO: `/v3/groups/c75cff3c8b414b43abcb2e2cc91236ae` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:25.828630 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d59ad-2686-41a0-af94-52b635097f19 None admin] RBAC: Authorizing `identity:get_group(group_id=c75cff3c8b414b43abcb2e2cc91236ae)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:25.830251 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d59ad-2686-41a0-af94-52b635097f19 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:25.832296 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 197/393] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 24 04:36:25 2022] GET /identity/v3/groups/c75cff3c8b414b43abcb2e2cc91236ae => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:25.837390 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d59ad-2686-41a0-af94-52b635097f19 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:25.856168 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:25.891628 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ceb42-78fe-47a7-a712-5f75317576e4 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:25.933570 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44659d3e-431d-4d07-b707-6f704a11b3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:25.934734 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44659d3e-431d-4d07-b707-6f704a11b3a2 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:25.935272 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44659d3e-431d-4d07-b707-6f704a11b3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:25.935749 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44659d3e-431d-4d07-b707-6f704a11b3a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:25.950409 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44659d3e-431d-4d07-b707-6f704a11b3a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:25.957034 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d59ad-2686-41a0-af94-52b635097f19 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:25.957283 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-44659d3e-431d-4d07-b707-6f704a11b3a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:36:25.957283 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:25.957283 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:25.957283 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:25.957283 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:25.957283 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:25.957283 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:25.957283 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:25.957283 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:25.957283 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:25.957283 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:25.957283 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:25.957283 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:25.957283 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:25.957283 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:25.957283 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:25.958572 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:25.958572 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:25.958572 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:25.958572 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:25.958572 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:25.958572 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:25.958572 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:25.958572 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:25.958572 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:25.958572 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:25.958572 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:25.958572 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:25.958572 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:25.958572 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:25.958572 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:25.958572 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:25.959415 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:25.959415 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:25.959415 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:25.959415 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:25.959415 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:25.959415 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:25.959415 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:25.959415 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:25.959415 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:25.959415 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:25.959415 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:36:25.959415 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:25.963984 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 197/394] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 24 04:36:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:25.965057 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44659d3e-431d-4d07-b707-6f704a11b3a2 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:26.001871 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754f905-3243-4441-a9cf-90916697e748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:26.003020 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754f905-3243-4441-a9cf-90916697e748 None admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:26.003564 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754f905-3243-4441-a9cf-90916697e748 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:26.004062 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754f905-3243-4441-a9cf-90916697e748 None admin] PATH_INFO: `/v3/projects/33beb4c6e7a44d5a823b242c69b5c231/groups/c75cff3c8b414b43abcb2e2cc91236ae/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:26.006463 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754f905-3243-4441-a9cf-90916697e748 None admin] RBAC: Authorizing `identity:create_grant(project_id=33beb4c6e7a44d5a823b242c69b5c231, group_id=c75cff3c8b414b43abcb2e2cc91236ae, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:26.008671 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754f905-3243-4441-a9cf-90916697e748 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:26.031263 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 198/395] 10.222.0.49 () {58 vars in 1442 bytes} [Wed Aug 24 04:36:25 2022] PUT /identity/v3/projects/33beb4c6e7a44d5a823b242c69b5c231/groups/c75cff3c8b414b43abcb2e2cc91236ae/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:36:26.032837 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754f905-3243-4441-a9cf-90916697e748 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:26.081779 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:26.094225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44659d3e-431d-4d07-b707-6f704a11b3a2 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:26.127507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:26.134564 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0194b2b-edf4-4883-9852-ca09e54061cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:26.135236 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0194b2b-edf4-4883-9852-ca09e54061cc None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:26.135516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0194b2b-edf4-4883-9852-ca09e54061cc None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:26.135791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0194b2b-edf4-4883-9852-ca09e54061cc None admin] PATH_INFO: `/v3/projects/b74b66f35e054f368691db7e9bc5c219` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:26.137093 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0194b2b-edf4-4883-9852-ca09e54061cc None admin] RBAC: Authorizing `identity:get_project(project_id=b74b66f35e054f368691db7e9bc5c219)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:26.138510 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0194b2b-edf4-4883-9852-ca09e54061cc None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:26.140598 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 198/396] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:36:25 2022] GET /identity/v3/projects/b74b66f35e054f368691db7e9bc5c219 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:26.158642 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0194b2b-edf4-4883-9852-ca09e54061cc None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:26.191748 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754f905-3243-4441-a9cf-90916697e748 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:26.243944 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e0567-f597-46a7-93fa-0eb16f94b81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:26.245613 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e0567-f597-46a7-93fa-0eb16f94b81d None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:26.246291 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e0567-f597-46a7-93fa-0eb16f94b81d None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:26.246727 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e0567-f597-46a7-93fa-0eb16f94b81d None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:26.249055 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e0567-f597-46a7-93fa-0eb16f94b81d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:26.249831 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e0567-f597-46a7-93fa-0eb16f94b81d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:26.251468 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e0567-f597-46a7-93fa-0eb16f94b81d None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:26.276024 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 199/397] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:26.283114 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e0567-f597-46a7-93fa-0eb16f94b81d None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:26.349167 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0194b2b-edf4-4883-9852-ca09e54061cc None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:26.419675 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d9bc1-5882-4a4c-9e22-ae34ede00d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:26.420850 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d9bc1-5882-4a4c-9e22-ae34ede00d3a None admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:26.421215 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d9bc1-5882-4a4c-9e22-ae34ede00d3a None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:26.421485 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d9bc1-5882-4a4c-9e22-ae34ede00d3a None admin] PATH_INFO: `/v3/projects/b74b66f35e054f368691db7e9bc5c219/groups/c75cff3c8b414b43abcb2e2cc91236ae/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:26.426883 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8d9bc1-5882-4a4c-9e22-ae34ede00d3a None admin] RBAC: Authorizing `identity:create_grant(project_id=b74b66f35e054f368691db7e9bc5c219, group_id=c75cff3c8b414b43abcb2e2cc91236ae, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:26.428375 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8d9bc1-5882-4a4c-9e22-ae34ede00d3a None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:26.449998 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 199/398] 10.222.0.49 () {58 vars in 1442 bytes} [Wed Aug 24 04:36:26 2022] PUT /identity/v3/projects/b74b66f35e054f368691db7e9bc5c219/groups/c75cff3c8b414b43abcb2e2cc91236ae/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:36:26.456332 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:26.462593 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e0567-f597-46a7-93fa-0eb16f94b81d None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:26.505376 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24822e1d-f7f5-4795-87b7-e1d0e48c055d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:26.506308 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24822e1d-f7f5-4795-87b7-e1d0e48c055d None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:26.506793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24822e1d-f7f5-4795-87b7-e1d0e48c055d None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:26.507212 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24822e1d-f7f5-4795-87b7-e1d0e48c055d None admin] PATH_INFO: `/v3/groups/c75cff3c8b414b43abcb2e2cc91236ae` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:26.508943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24822e1d-f7f5-4795-87b7-e1d0e48c055d None admin] RBAC: Authorizing `identity:get_group(group_id=c75cff3c8b414b43abcb2e2cc91236ae)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:26.510763 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24822e1d-f7f5-4795-87b7-e1d0e48c055d None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:26.513214 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 200/399] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 24 04:36:26 2022] GET /identity/v3/groups/c75cff3c8b414b43abcb2e2cc91236ae => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:26.519422 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d9bc1-5882-4a4c-9e22-ae34ede00d3a None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:26.563319 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60078ef1-6dc7-41fa-a430-2803cfa5d7b7 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:26.563656 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60078ef1-6dc7-41fa-a430-2803cfa5d7b7 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:26.563874 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60078ef1-6dc7-41fa-a430-2803cfa5d7b7 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:26.565626 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 201/400] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:26.587319 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154480b7-684c-4b2a-814f-65b1a3c1aef9 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:26.587600 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154480b7-684c-4b2a-814f-65b1a3c1aef9 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:26.587874 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154480b7-684c-4b2a-814f-65b1a3c1aef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:26.622382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-154480b7-684c-4b2a-814f-65b1a3c1aef9 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:26.623666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-154480b7-684c-4b2a-814f-65b1a3c1aef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:26.653293 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:26.713191 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d9bc1-5882-4a4c-9e22-ae34ede00d3a None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:26.735087 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 202/401] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:36:26.736925 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d75cd7-9adf-49a5-95e5-5dadac8a3969 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:26.737210 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d75cd7-9adf-49a5-95e5-5dadac8a3969 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:26.737507 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d75cd7-9adf-49a5-95e5-5dadac8a3969 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:26.739718 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 203/402] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:26.745955 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259fbf17-aae5-482b-9483-3dc67d2bae2b None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:26.749369 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259fbf17-aae5-482b-9483-3dc67d2bae2b None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:26.749369 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259fbf17-aae5-482b-9483-3dc67d2bae2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:26.757399 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82ea50-9c5b-4271-93eb-648026ee4264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:26.758298 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82ea50-9c5b-4271-93eb-648026ee4264 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:26.758590 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82ea50-9c5b-4271-93eb-648026ee4264 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:26.758865 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82ea50-9c5b-4271-93eb-648026ee4264 None admin] PATH_INFO: `/v3/projects/33beb4c6e7a44d5a823b242c69b5c231` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:26.760771 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82ea50-9c5b-4271-93eb-648026ee4264 None admin] RBAC: Authorizing `identity:get_project(project_id=33beb4c6e7a44d5a823b242c69b5c231)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:26.762805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82ea50-9c5b-4271-93eb-648026ee4264 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:26.764807 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 200/403] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:36:26 2022] GET /identity/v3/projects/33beb4c6e7a44d5a823b242c69b5c231 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:26.766491 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-259fbf17-aae5-482b-9483-3dc67d2bae2b None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:26.767821 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-259fbf17-aae5-482b-9483-3dc67d2bae2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:26.771000 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82ea50-9c5b-4271-93eb-648026ee4264 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:26.896135 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82ea50-9c5b-4271-93eb-648026ee4264 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:26.922542 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 204/404] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:36:26.937027 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:26.941591 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2e112-d236-45d1-ae29-2d5abb3f5c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:26.942343 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2e112-d236-45d1-ae29-2d5abb3f5c1c None admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:26.942622 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2e112-d236-45d1-ae29-2d5abb3f5c1c None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:26.942944 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2e112-d236-45d1-ae29-2d5abb3f5c1c None admin] PATH_INFO: `/v3/projects/33beb4c6e7a44d5a823b242c69b5c231/groups/c75cff3c8b414b43abcb2e2cc91236ae/roles/3c2269f848184abd93ef97d02f6553e4` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:26.946002 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2e112-d236-45d1-ae29-2d5abb3f5c1c None admin] RBAC: Authorizing `identity:create_grant(project_id=33beb4c6e7a44d5a823b242c69b5c231, group_id=c75cff3c8b414b43abcb2e2cc91236ae, role_id=3c2269f848184abd93ef97d02f6553e4)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:26.947580 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d2e112-d236-45d1-ae29-2d5abb3f5c1c None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:26.972228 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 201/405] 10.222.0.49 () {58 vars in 1442 bytes} [Wed Aug 24 04:36:26 2022] PUT /identity/v3/projects/33beb4c6e7a44d5a823b242c69b5c231/groups/c75cff3c8b414b43abcb2e2cc91236ae/roles/3c2269f848184abd93ef97d02f6553e4 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:36:27.094864 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259fbf17-aae5-482b-9483-3dc67d2bae2b None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:27.132767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:27.228146 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2e112-d236-45d1-ae29-2d5abb3f5c1c None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:27.235722 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259fbf17-aae5-482b-9483-3dc67d2bae2b None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:27.275611 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55342c-219d-4156-8b88-1a004f1a3e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:27.276252 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55342c-219d-4156-8b88-1a004f1a3e1f None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:27.276529 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55342c-219d-4156-8b88-1a004f1a3e1f None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:27.276792 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55342c-219d-4156-8b88-1a004f1a3e1f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:27.289219 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c55342c-219d-4156-8b88-1a004f1a3e1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:27.294204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-5c55342c-219d-4156-8b88-1a004f1a3e1f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:36:27.294204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:27.294204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:27.294204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:27.294204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:27.294204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:27.294204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:27.294204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:27.294204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:27.294204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:27.294204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:27.294204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:27.294204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:27.294204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:27.294204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:27.294204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:27.295117 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:27.295117 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:27.295117 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:27.295117 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:27.295117 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:27.295117 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:27.295117 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:27.295117 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:27.295117 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:27.295117 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:27.295117 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:27.295117 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:27.295117 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:27.295117 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:27.295117 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:27.295117 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:27.295974 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:27.295974 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:27.295974 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:27.295974 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:27.295974 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:27.295974 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:27.295974 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:27.295974 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:27.295974 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:27.295974 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:27.295974 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:36:27.295974 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:27.295974 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 205/406] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 24 04:36:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:27.301619 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55342c-219d-4156-8b88-1a004f1a3e1f None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:27.348201 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2e112-d236-45d1-ae29-2d5abb3f5c1c None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:27.387661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab704f7d-9da5-4d94-940e-10b9be66aa1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:27.388438 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab704f7d-9da5-4d94-940e-10b9be66aa1c None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:27.388593 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab704f7d-9da5-4d94-940e-10b9be66aa1c None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:27.388926 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab704f7d-9da5-4d94-940e-10b9be66aa1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:27.396254 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:27.404328 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab704f7d-9da5-4d94-940e-10b9be66aa1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:27.411620 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-ab704f7d-9da5-4d94-940e-10b9be66aa1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:36:27.411620 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:27.411620 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:27.411620 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:27.411620 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:27.411620 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:27.411620 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:27.411620 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:27.411620 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:27.411620 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:27.411620 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:27.411620 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:27.411620 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:27.411620 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:27.411620 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:27.411620 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:27.412539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:27.412539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:27.412539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:27.412539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:27.412539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:27.412539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:27.412539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:27.412539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:27.412539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:27.412539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:27.412539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:27.412539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:27.412539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:27.412539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:27.412539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:27.412539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:27.413360 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:27.413360 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:27.413360 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:27.413360 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:27.413360 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:27.413360 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:27.413360 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:27.413360 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:27.413360 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:27.413360 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:27.413360 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:36:27.413360 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:27.413983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55342c-219d-4156-8b88-1a004f1a3e1f None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:27.415768 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 202/407] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 24 04:36:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:36:27.422123 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab704f7d-9da5-4d94-940e-10b9be66aa1c None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:27.449612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3a9f7-bdc3-4f73-8063-a8cef68d8875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:27.450681 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3a9f7-bdc3-4f73-8063-a8cef68d8875 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:27.451108 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3a9f7-bdc3-4f73-8063-a8cef68d8875 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:27.451545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3a9f7-bdc3-4f73-8063-a8cef68d8875 None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:27.452677 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3a9f7-bdc3-4f73-8063-a8cef68d8875 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:27.453194 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3a9f7-bdc3-4f73-8063-a8cef68d8875 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:27.454710 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b3a9f7-bdc3-4f73-8063-a8cef68d8875 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:27.464153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 206/408] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:27.469670 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3a9f7-bdc3-4f73-8063-a8cef68d8875 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:27.481600 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:27.546143 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab704f7d-9da5-4d94-940e-10b9be66aa1c None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:27.583269 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3a9f7-bdc3-4f73-8063-a8cef68d8875 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:27.587822 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ffd56-011e-418d-bd8f-0eca79cd5d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:27.588758 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ffd56-011e-418d-bd8f-0eca79cd5d19 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:27.589254 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ffd56-011e-418d-bd8f-0eca79cd5d19 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:27.589965 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ffd56-011e-418d-bd8f-0eca79cd5d19 None admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:27.590899 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0ffd56-011e-418d-bd8f-0eca79cd5d19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:27.591380 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0ffd56-011e-418d-bd8f-0eca79cd5d19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:27.593170 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0ffd56-011e-418d-bd8f-0eca79cd5d19 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:27.604388 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 203/409] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:36:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:27.610624 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ffd56-011e-418d-bd8f-0eca79cd5d19 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:27.623480 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629ea4f-4a18-467a-b636-11b3c85d0213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:27.624480 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629ea4f-4a18-467a-b636-11b3c85d0213 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:27.624480 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629ea4f-4a18-467a-b636-11b3c85d0213 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:27.624678 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629ea4f-4a18-467a-b636-11b3c85d0213 None admin] PATH_INFO: `/v3/groups/c75cff3c8b414b43abcb2e2cc91236ae` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:27.625841 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629ea4f-4a18-467a-b636-11b3c85d0213 None admin] RBAC: Authorizing `identity:get_group(group_id=c75cff3c8b414b43abcb2e2cc91236ae)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:27.627339 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b629ea4f-4a18-467a-b636-11b3c85d0213 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:27.629307 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 207/410] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 24 04:36:27 2022] GET /identity/v3/groups/c75cff3c8b414b43abcb2e2cc91236ae => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:27.635386 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629ea4f-4a18-467a-b636-11b3c85d0213 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:27.655581 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:27.732767 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ffd56-011e-418d-bd8f-0eca79cd5d19 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:27.743742 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b629ea4f-4a18-467a-b636-11b3c85d0213 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:27.745891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:27.774358 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df9656-2bbb-4e7c-9811-ad46f15e3e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:27.775469 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df9656-2bbb-4e7c-9811-ad46f15e3e38 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:27.775989 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df9656-2bbb-4e7c-9811-ad46f15e3e38 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:27.776410 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df9656-2bbb-4e7c-9811-ad46f15e3e38 None admin] PATH_INFO: `/v3/groups/98b2a03dcaf242e6841a57e6059f1a3b` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:27.777845 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df9656-2bbb-4e7c-9811-ad46f15e3e38 None admin] RBAC: Authorizing `identity:get_group(group_id=98b2a03dcaf242e6841a57e6059f1a3b)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:27.779469 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df9656-2bbb-4e7c-9811-ad46f15e3e38 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:27.781916 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 204/411] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 24 04:36:27 2022] GET /identity/v3/groups/98b2a03dcaf242e6841a57e6059f1a3b => generated 229 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:27.782780 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988fe478-1d4d-4dd6-a1aa-161b63114a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:27.783423 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fe478-1d4d-4dd6-a1aa-161b63114a68 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:27.783696 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fe478-1d4d-4dd6-a1aa-161b63114a68 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:27.783964 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fe478-1d4d-4dd6-a1aa-161b63114a68 None admin] PATH_INFO: `/v3/projects/b74b66f35e054f368691db7e9bc5c219` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:27.790006 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988fe478-1d4d-4dd6-a1aa-161b63114a68 None admin] RBAC: Authorizing `identity:get_project(project_id=b74b66f35e054f368691db7e9bc5c219)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:27.791696 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df9656-2bbb-4e7c-9811-ad46f15e3e38 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:27.791897 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988fe478-1d4d-4dd6-a1aa-161b63114a68 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:27.794997 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 208/412] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:36:27 2022] GET /identity/v3/projects/b74b66f35e054f368691db7e9bc5c219 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:27.801148 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988fe478-1d4d-4dd6-a1aa-161b63114a68 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:27.898145 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:27.915453 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988fe478-1d4d-4dd6-a1aa-161b63114a68 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:27.966064 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16783428-5e5e-4661-83d2-27bb69287d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:27.966798 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16783428-5e5e-4661-83d2-27bb69287d9a None admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:27.967091 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16783428-5e5e-4661-83d2-27bb69287d9a None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:27.967368 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16783428-5e5e-4661-83d2-27bb69287d9a None admin] PATH_INFO: `/v3/projects/b74b66f35e054f368691db7e9bc5c219/groups/c75cff3c8b414b43abcb2e2cc91236ae/roles/3c2269f848184abd93ef97d02f6553e4` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:27.975398 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16783428-5e5e-4661-83d2-27bb69287d9a None admin] RBAC: Authorizing `identity:create_grant(project_id=b74b66f35e054f368691db7e9bc5c219, group_id=c75cff3c8b414b43abcb2e2cc91236ae, role_id=3c2269f848184abd93ef97d02f6553e4)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:27.976401 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df9656-2bbb-4e7c-9811-ad46f15e3e38 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:27.976902 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16783428-5e5e-4661-83d2-27bb69287d9a None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:28.002854 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 209/413] 10.222.0.49 () {58 vars in 1442 bytes} [Wed Aug 24 04:36:27 2022] PUT /identity/v3/projects/b74b66f35e054f368691db7e9bc5c219/groups/c75cff3c8b414b43abcb2e2cc91236ae/roles/3c2269f848184abd93ef97d02f6553e4 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:36:28.016406 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d60b42-ad2c-4619-8dc0-194ae18d37df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:28.017532 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d60b42-ad2c-4619-8dc0-194ae18d37df None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:28.018055 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d60b42-ad2c-4619-8dc0-194ae18d37df None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:28.018538 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d60b42-ad2c-4619-8dc0-194ae18d37df None admin] PATH_INFO: `/v3/projects/68ea81c5f7c24dfdae5a0b686d31ba39` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:28.020080 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d60b42-ad2c-4619-8dc0-194ae18d37df None admin] RBAC: Authorizing `identity:get_project(project_id=68ea81c5f7c24dfdae5a0b686d31ba39)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:28.021889 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d60b42-ad2c-4619-8dc0-194ae18d37df None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:28.024165 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 205/414] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:36:27 2022] GET /identity/v3/projects/68ea81c5f7c24dfdae5a0b686d31ba39 => generated 344 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:28.030148 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16783428-5e5e-4661-83d2-27bb69287d9a None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:28.205625 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16783428-5e5e-4661-83d2-27bb69287d9a None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:28.245815 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee048ec-ef16-42bc-be67-b03b88cad84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:28.246985 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee048ec-ef16-42bc-be67-b03b88cad84e None admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:28.247471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee048ec-ef16-42bc-be67-b03b88cad84e None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:28.247942 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee048ec-ef16-42bc-be67-b03b88cad84e None admin] PATH_INFO: `/v3/projects/68ea81c5f7c24dfdae5a0b686d31ba39/groups/98b2a03dcaf242e6841a57e6059f1a3b/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:28.250193 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee048ec-ef16-42bc-be67-b03b88cad84e None admin] RBAC: Authorizing `identity:create_grant(project_id=68ea81c5f7c24dfdae5a0b686d31ba39, group_id=98b2a03dcaf242e6841a57e6059f1a3b, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:28.251923 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee048ec-ef16-42bc-be67-b03b88cad84e None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:28.270350 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 210/415] 10.222.0.49 () {58 vars in 1442 bytes} [Wed Aug 24 04:36:28 2022] PUT /identity/v3/projects/68ea81c5f7c24dfdae5a0b686d31ba39/groups/98b2a03dcaf242e6841a57e6059f1a3b/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:36:28.752307 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b58783-7bd2-41ee-bc49-a6cbe2bd7970 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:28.752841 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b58783-7bd2-41ee-bc49-a6cbe2bd7970 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:28.752841 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b58783-7bd2-41ee-bc49-a6cbe2bd7970 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:28.754767 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 206/416] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:28.760515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aabc2d-da61-4aac-bd9a-72528b0cb47a None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:28.761023 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aabc2d-da61-4aac-bd9a-72528b0cb47a None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:28.761204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aabc2d-da61-4aac-bd9a-72528b0cb47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:28.774572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:28.791523 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16319cd8-3f1b-4d28-80ca-ba68ac92b92c None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:28.791860 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16319cd8-3f1b-4d28-80ca-ba68ac92b92c None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:28.792094 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16319cd8-3f1b-4d28-80ca-ba68ac92b92c None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:28.793522 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 207/417] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:36:28.794118 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-b0aabc2d-da61-4aac-bd9a-72528b0cb47a None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:28.795489 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-b0aabc2d-da61-4aac-bd9a-72528b0cb47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:28.798987 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e97b6-9318-4f4c-a10d-eb0e21bb676c None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:28.799263 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e97b6-9318-4f4c-a10d-eb0e21bb676c None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:28.799540 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e97b6-9318-4f4c-a10d-eb0e21bb676c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:28.818262 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-1d3e97b6-9318-4f4c-a10d-eb0e21bb676c None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:28.819483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-1d3e97b6-9318-4f4c-a10d-eb0e21bb676c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:28.889708 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:28.925458 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 211/418] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:36:28.938738 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 208/419] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:36:29.260785 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aabc2d-da61-4aac-bd9a-72528b0cb47a None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:29.296475 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e97b6-9318-4f4c-a10d-eb0e21bb676c None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:29.416608 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e97b6-9318-4f4c-a10d-eb0e21bb676c None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:29.455724 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4992d5-3916-40b7-81b4-0ddb1d71930e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:29.456377 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4992d5-3916-40b7-81b4-0ddb1d71930e None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:29.456653 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4992d5-3916-40b7-81b4-0ddb1d71930e None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:29.456921 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4992d5-3916-40b7-81b4-0ddb1d71930e None admin] PATH_INFO: `/v3/roles/member` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:29.470585 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aabc2d-da61-4aac-bd9a-72528b0cb47a None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:29.485923 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4992d5-3916-40b7-81b4-0ddb1d71930e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:29.490729 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-7f4992d5-3916-40b7-81b4-0ddb1d71930e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:36:29.490729 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:29.490729 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:29.490729 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:29.490729 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:29.490729 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:29.490729 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:29.490729 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:29.490729 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:29.490729 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:29.490729 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:29.490729 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:29.490729 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:29.490729 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:29.490729 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:29.490729 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:29.491582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:29.491582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:29.491582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:29.491582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:29.491582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:29.491582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:29.491582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:29.491582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:29.491582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:29.491582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:29.491582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:29.491582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:29.491582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:29.491582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:29.491582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:29.491582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:29.492420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:29.492420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:29.492420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:29.492420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:29.492420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:29.492420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:29.492420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:29.492420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:29.492420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:29.492420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:29.492420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:36:29.492420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:29.497004 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 209/420] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:36:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:29.502463 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4992d5-3916-40b7-81b4-0ddb1d71930e None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:29.552481 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8f0cf-50db-4b6a-8367-152be842feec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:29.553150 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8f0cf-50db-4b6a-8367-152be842feec None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:29.553451 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8f0cf-50db-4b6a-8367-152be842feec None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:29.553721 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8f0cf-50db-4b6a-8367-152be842feec None admin] PATH_INFO: `/v3/roles/member` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:29.559331 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:29.576084 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:29.586370 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8f0cf-50db-4b6a-8367-152be842feec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:29.591449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-d2e8f0cf-50db-4b6a-8367-152be842feec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:36:29.591449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:29.591449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:29.591449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:29.591449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:29.591449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:29.591449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:29.591449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:29.591449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:29.591449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:29.591449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:29.591449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:29.591449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:29.591449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:29.591449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:29.591449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:29.593530 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:29.593530 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:29.593530 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:29.593530 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:29.593530 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:29.593530 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:29.593530 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:29.593530 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:29.593530 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:29.593530 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:29.593530 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:29.593530 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:29.593530 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:29.593530 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:29.593530 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:29.593530 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:29.595563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:29.595563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:29.595563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:29.595563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:29.595563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:29.595563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:29.595563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:29.595563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:29.595563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:29.595563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:29.595563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:36:29.595563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:29.595563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 212/421] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:36:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:29.601374 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8f0cf-50db-4b6a-8367-152be842feec None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:29.651122 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4992d5-3916-40b7-81b4-0ddb1d71930e None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:29.706213 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f31238-96bf-4592-99bc-88f1c7d01716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:29.706800 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f31238-96bf-4592-99bc-88f1c7d01716 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:29.707086 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f31238-96bf-4592-99bc-88f1c7d01716 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:29.707355 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f31238-96bf-4592-99bc-88f1c7d01716 None admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:29.708048 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f31238-96bf-4592-99bc-88f1c7d01716 None admin] RBAC: Adding query filter params (name=member) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:29.708349 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f31238-96bf-4592-99bc-88f1c7d01716 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:29.709795 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f31238-96bf-4592-99bc-88f1c7d01716 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:29.725808 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 210/422] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 24 04:36:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:29.740975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f31238-96bf-4592-99bc-88f1c7d01716 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:29.760711 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8f0cf-50db-4b6a-8367-152be842feec None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:29.800606 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8059df-8b6a-4a91-bc73-6e803d4a8fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:29.801259 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8059df-8b6a-4a91-bc73-6e803d4a8fef None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:29.801620 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8059df-8b6a-4a91-bc73-6e803d4a8fef None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:29.801900 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8059df-8b6a-4a91-bc73-6e803d4a8fef None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:29.802603 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8059df-8b6a-4a91-bc73-6e803d4a8fef None admin] RBAC: Adding query filter params (name=member) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:29.802905 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8059df-8b6a-4a91-bc73-6e803d4a8fef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:29.804307 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8059df-8b6a-4a91-bc73-6e803d4a8fef None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:29.822940 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 213/423] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 24 04:36:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:29.828362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8059df-8b6a-4a91-bc73-6e803d4a8fef None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:29.892042 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:29.899469 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:29.904845 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f31238-96bf-4592-99bc-88f1c7d01716 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:29.942022 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829341b-98de-451f-9ba9-437b5b048fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:29.942735 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829341b-98de-451f-9ba9-437b5b048fd1 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:29.943079 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829341b-98de-451f-9ba9-437b5b048fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:29.943425 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829341b-98de-451f-9ba9-437b5b048fd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:29.956619 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8059df-8b6a-4a91-bc73-6e803d4a8fef None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:30.003249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12245f06-4aef-4129-b218-d98b7f40e257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:30.004305 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12245f06-4aef-4129-b218-d98b7f40e257 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:30.004731 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12245f06-4aef-4129-b218-d98b7f40e257 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:30.005457 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12245f06-4aef-4129-b218-d98b7f40e257 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:30.019110 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829341b-98de-451f-9ba9-437b5b048fd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:30.020759 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829341b-98de-451f-9ba9-437b5b048fd1 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:30.098188 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12245f06-4aef-4129-b218-d98b7f40e257 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:30.100063 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12245f06-4aef-4129-b218-d98b7f40e257 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:30.125016 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:30.142276 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 211/424] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:36:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:36:30.143743 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3576f5-b1ec-44f0-bbc6-dc7dcb827e7c None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:30.144096 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3576f5-b1ec-44f0-bbc6-dc7dcb827e7c None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:30.144496 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3576f5-b1ec-44f0-bbc6-dc7dcb827e7c None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:30.146249 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 212/425] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:30.147062 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3576f5-b1ec-44f0-bbc6-dc7dcb827e7c None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:30.182928 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:30.243681 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 214/426] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:36:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 04:36:30.245484 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83fedaa-4f22-4871-9029-4f2475b465f3 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:30.245925 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83fedaa-4f22-4871-9029-4f2475b465f3 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:30.246339 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83fedaa-4f22-4871-9029-4f2475b465f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:30.269949 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-c83fedaa-4f22-4871-9029-4f2475b465f3 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:30.271879 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-c83fedaa-4f22-4871-9029-4f2475b465f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:30.280850 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3576f5-b1ec-44f0-bbc6-dc7dcb827e7c None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:30.321026 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580d042-78a2-4160-99d6-ce2655050298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:30.321828 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580d042-78a2-4160-99d6-ce2655050298 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:30.322103 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580d042-78a2-4160-99d6-ce2655050298 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:30.322373 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580d042-78a2-4160-99d6-ce2655050298 None admin] PATH_INFO: `/v3/projects/33beb4c6e7a44d5a823b242c69b5c231` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:30.323556 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580d042-78a2-4160-99d6-ce2655050298 None admin] RBAC: Authorizing `identity:get_project(project_id=33beb4c6e7a44d5a823b242c69b5c231)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:30.325022 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580d042-78a2-4160-99d6-ce2655050298 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:30.331357 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 213/427] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:36:30 2022] GET /identity/v3/projects/33beb4c6e7a44d5a823b242c69b5c231 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:30.331357 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580d042-78a2-4160-99d6-ce2655050298 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:30.357372 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 215/428] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:30.357372 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7d19f-80fc-459c-9957-145d236582c5 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:30.357372 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7d19f-80fc-459c-9957-145d236582c5 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:30.357372 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7d19f-80fc-459c-9957-145d236582c5 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:30.357372 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 216/429] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:30.357372 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7d19f-80fc-459c-9957-145d236582c5 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:30.410862 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:30.457576 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580d042-78a2-4160-99d6-ce2655050298 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:30.476594 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:30.496126 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7d19f-80fc-459c-9957-145d236582c5 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:30.498385 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f82acda-d416-4085-bb71-16641263de89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:30.499105 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82acda-d416-4085-bb71-16641263de89 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:30.499493 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82acda-d416-4085-bb71-16641263de89 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:30.499853 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82acda-d416-4085-bb71-16641263de89 None admin] PATH_INFO: `/v3/projects/b74b66f35e054f368691db7e9bc5c219` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:30.501070 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f82acda-d416-4085-bb71-16641263de89 None admin] RBAC: Authorizing `identity:get_project(project_id=b74b66f35e054f368691db7e9bc5c219)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:30.502662 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f82acda-d416-4085-bb71-16641263de89 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:30.504758 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 214/430] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:36:30 2022] GET /identity/v3/projects/b74b66f35e054f368691db7e9bc5c219 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:30.506351 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7198ae-a9e9-4323-b1bb-226ad11dbc84 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:30.506703 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7198ae-a9e9-4323-b1bb-226ad11dbc84 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:30.507042 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7198ae-a9e9-4323-b1bb-226ad11dbc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:30.527130 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-5f7198ae-a9e9-4323-b1bb-226ad11dbc84 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:30.528447 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-5f7198ae-a9e9-4323-b1bb-226ad11dbc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:30.539078 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08824c8a-ea6c-4466-83b3-b620bbf0ab25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:30.539796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08824c8a-ea6c-4466-83b3-b620bbf0ab25 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:30.540111 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08824c8a-ea6c-4466-83b3-b620bbf0ab25 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:30.540386 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08824c8a-ea6c-4466-83b3-b620bbf0ab25 None admin] PATH_INFO: `/v3/groups/c75cff3c8b414b43abcb2e2cc91236ae` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:30.541624 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08824c8a-ea6c-4466-83b3-b620bbf0ab25 None admin] RBAC: Authorizing `identity:get_group(group_id=c75cff3c8b414b43abcb2e2cc91236ae)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:30.543164 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08824c8a-ea6c-4466-83b3-b620bbf0ab25 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:30.545258 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 217/431] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 24 04:36:30 2022] GET /identity/v3/groups/c75cff3c8b414b43abcb2e2cc91236ae => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:30.545998 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08824c8a-ea6c-4466-83b3-b620bbf0ab25 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:30.608433 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 215/432] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:30.609305 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7198ae-a9e9-4323-b1bb-226ad11dbc84 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:30.677437 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08824c8a-ea6c-4466-83b3-b620bbf0ab25 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:30.678664 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:30.714966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd69c3-8702-496c-bf33-440c54ad5224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:30.715610 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd69c3-8702-496c-bf33-440c54ad5224 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:30.715887 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd69c3-8702-496c-bf33-440c54ad5224 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:30.716156 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd69c3-8702-496c-bf33-440c54ad5224 None admin] PATH_INFO: `/v3/groups/c75cff3c8b414b43abcb2e2cc91236ae` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:30.717320 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd69c3-8702-496c-bf33-440c54ad5224 None admin] RBAC: Authorizing `identity:get_group(group_id=c75cff3c8b414b43abcb2e2cc91236ae)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:30.718809 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd69c3-8702-496c-bf33-440c54ad5224 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:30.720649 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 218/433] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 24 04:36:30 2022] GET /identity/v3/groups/c75cff3c8b414b43abcb2e2cc91236ae => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:30.720786 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7198ae-a9e9-4323-b1bb-226ad11dbc84 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:30.726538 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec02225-4435-4a93-a55b-b03637da7281 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:30.726860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec02225-4435-4a93-a55b-b03637da7281 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:30.727136 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec02225-4435-4a93-a55b-b03637da7281 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:30.728661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 219/434] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:30.729307 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec02225-4435-4a93-a55b-b03637da7281 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:30.756421 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:30.762126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07c034-1230-4bd1-b9f6-ee38edbb54d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:30.762957 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07c034-1230-4bd1-b9f6-ee38edbb54d0 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:30.763239 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07c034-1230-4bd1-b9f6-ee38edbb54d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:30.763507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07c034-1230-4bd1-b9f6-ee38edbb54d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:30.764248 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d07c034-1230-4bd1-b9f6-ee38edbb54d0 None admin] RBAC: Adding query filter params (group.id=c75cff3c8b414b43abcb2e2cc91236ae, role.id=e2eda359ee274ff1914db224f7f9b383, scope.project.id=33beb4c6e7a44d5a823b242c69b5c231) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:30.764556 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d07c034-1230-4bd1-b9f6-ee38edbb54d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:30.766155 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d07c034-1230-4bd1-b9f6-ee38edbb54d0 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:30.772477 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 216/435] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Aug 24 04:36:30 2022] GET /identity/v3/role_assignments?group.id=c75cff3c8b414b43abcb2e2cc91236ae&scope.project.id=33beb4c6e7a44d5a823b242c69b5c231&role.id=e2eda359ee274ff1914db224f7f9b383 => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:30.773204 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07c034-1230-4bd1-b9f6-ee38edbb54d0 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:30.871239 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec02225-4435-4a93-a55b-b03637da7281 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:30.914331 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07c034-1230-4bd1-b9f6-ee38edbb54d0 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:30.920282 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df35960-311d-410c-9a24-bfb9a960f053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:30.920957 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df35960-311d-410c-9a24-bfb9a960f053 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:30.921230 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df35960-311d-410c-9a24-bfb9a960f053 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:30.921537 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df35960-311d-410c-9a24-bfb9a960f053 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:30.934469 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df35960-311d-410c-9a24-bfb9a960f053 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:30.939392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-2df35960-311d-410c-9a24-bfb9a960f053 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:36:30.939392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:30.939392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:30.939392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:30.939392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:30.939392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:30.939392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:30.939392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:30.939392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:30.939392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:30.939392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:30.939392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:30.939392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:30.939392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:30.939392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:30.939392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:30.940371 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:30.940371 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:30.940371 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:30.940371 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:30.940371 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:30.940371 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:30.940371 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:30.940371 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:30.940371 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:30.940371 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:30.940371 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:30.940371 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:30.940371 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:30.940371 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:30.940371 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:30.940371 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:30.941200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:30.941200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:30.941200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:30.941200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:30.941200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:30.941200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:30.941200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:30.941200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:30.941200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:30.941200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:30.941200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:36:30.941200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:30.941200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 220/436] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 24 04:36:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:30.942532 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f351a37-6031-420a-96b6-8aee442eb7c0 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:30.942532 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f351a37-6031-420a-96b6-8aee442eb7c0 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:30.942532 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f351a37-6031-420a-96b6-8aee442eb7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:30.953380 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:30.962730 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-3f351a37-6031-420a-96b6-8aee442eb7c0 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:30.964038 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-3f351a37-6031-420a-96b6-8aee442eb7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:30.967100 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763ce33-c808-4deb-9f8a-989d13d08756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:30.967743 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763ce33-c808-4deb-9f8a-989d13d08756 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:30.968004 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763ce33-c808-4deb-9f8a-989d13d08756 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:30.968276 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763ce33-c808-4deb-9f8a-989d13d08756 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:30.969043 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763ce33-c808-4deb-9f8a-989d13d08756 None admin] RBAC: Adding query filter params (group.id=c75cff3c8b414b43abcb2e2cc91236ae, role.id=e2eda359ee274ff1914db224f7f9b383, scope.project.id=b74b66f35e054f368691db7e9bc5c219) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:30.969380 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763ce33-c808-4deb-9f8a-989d13d08756 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:30.972433 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763ce33-c808-4deb-9f8a-989d13d08756 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:30.979628 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 217/437] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Aug 24 04:36:30 2022] GET /identity/v3/role_assignments?group.id=c75cff3c8b414b43abcb2e2cc91236ae&scope.project.id=b74b66f35e054f368691db7e9bc5c219&role.id=e2eda359ee274ff1914db224f7f9b383 => generated 611 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:30.980372 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763ce33-c808-4deb-9f8a-989d13d08756 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:31.065452 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 221/438] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:31.065452 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f351a37-6031-420a-96b6-8aee442eb7c0 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:31.082000 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:31.126035 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763ce33-c808-4deb-9f8a-989d13d08756 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:31.179646 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac797e7-ebe0-4947-bdff-5b60427ec505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:31.179894 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac797e7-ebe0-4947-bdff-5b60427ec505 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:31.180176 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac797e7-ebe0-4947-bdff-5b60427ec505 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:31.180534 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac797e7-ebe0-4947-bdff-5b60427ec505 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:31.195817 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac797e7-ebe0-4947-bdff-5b60427ec505 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:31.201419 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-bac797e7-ebe0-4947-bdff-5b60427ec505 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:36:31.201419 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:31.201419 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:31.201419 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:31.201419 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:31.201419 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:31.201419 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:31.201419 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:31.201419 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:31.201419 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:31.201419 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:31.201419 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:31.201419 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:31.201419 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:31.201419 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:31.201419 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:31.202382 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:31.202382 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:31.202382 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:31.202382 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:31.202382 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:31.202382 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:31.202382 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:31.202382 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:31.202382 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:31.202382 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:31.202382 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:31.202382 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:31.202382 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:31.202382 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:31.202382 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:31.202382 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:31.203180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:31.203180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:31.203180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:31.203180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:31.203180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:31.203180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:31.203180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:31.203180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:31.203180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:31.203180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:31.203180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:36:31.203180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:31.203180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 218/439] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 24 04:36:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:31.210819 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac797e7-ebe0-4947-bdff-5b60427ec505 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:31.218916 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f351a37-6031-420a-96b6-8aee442eb7c0 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:31.267643 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb008e-4ab4-4814-b37f-7b6a270ed87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:31.268408 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb008e-4ab4-4814-b37f-7b6a270ed87e None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:31.268680 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb008e-4ab4-4814-b37f-7b6a270ed87e None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:31.268842 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb008e-4ab4-4814-b37f-7b6a270ed87e None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:31.270737 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb008e-4ab4-4814-b37f-7b6a270ed87e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:31.270737 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb008e-4ab4-4814-b37f-7b6a270ed87e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:31.271360 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb008e-4ab4-4814-b37f-7b6a270ed87e None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:31.276166 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:31.283792 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 222/440] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:31.290426 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb008e-4ab4-4814-b37f-7b6a270ed87e None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:31.342091 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac797e7-ebe0-4947-bdff-5b60427ec505 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:31.389880 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c6a06-67db-471a-b89b-440e5d0e0966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:31.390966 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c6a06-67db-471a-b89b-440e5d0e0966 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:31.391072 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:31.391315 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c6a06-67db-471a-b89b-440e5d0e0966 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:31.391618 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c6a06-67db-471a-b89b-440e5d0e0966 None admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:31.392365 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c6a06-67db-471a-b89b-440e5d0e0966 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:31.392677 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c6a06-67db-471a-b89b-440e5d0e0966 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:31.394547 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c6a06-67db-471a-b89b-440e5d0e0966 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:31.405945 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 219/441] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:31.406688 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c6a06-67db-471a-b89b-440e5d0e0966 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:31.418384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb008e-4ab4-4814-b37f-7b6a270ed87e None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:31.452930 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c3058-d558-4cd7-8837-1fd321cb8860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:31.453581 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c3058-d558-4cd7-8837-1fd321cb8860 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:31.453852 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c3058-d558-4cd7-8837-1fd321cb8860 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:31.454120 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c3058-d558-4cd7-8837-1fd321cb8860 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:31.508730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c6a06-67db-471a-b89b-440e5d0e0966 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:31.523989 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:31.524182 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c3058-d558-4cd7-8837-1fd321cb8860 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:31.525667 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c3058-d558-4cd7-8837-1fd321cb8860 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:31.544991 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e19a07-9c3e-4d99-8917-30ad6d0e7d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:31.545902 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e19a07-9c3e-4d99-8917-30ad6d0e7d97 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:31.546043 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e19a07-9c3e-4d99-8917-30ad6d0e7d97 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:31.546211 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e19a07-9c3e-4d99-8917-30ad6d0e7d97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:31.556857 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e19a07-9c3e-4d99-8917-30ad6d0e7d97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:31.562972 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-d1e19a07-9c3e-4d99-8917-30ad6d0e7d97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:36:31.562972 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:31.562972 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:31.562972 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:31.562972 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:31.562972 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:31.562972 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:31.562972 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:31.562972 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:31.562972 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:31.562972 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:31.562972 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:31.562972 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:31.562972 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:31.562972 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:31.562972 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:31.563928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:31.563928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:31.563928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:31.563928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:31.563928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:31.563928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:31.563928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:31.563928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:31.563928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:31.563928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:31.563928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:31.563928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:31.563928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:31.563928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:31.563928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:31.563928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:31.564706 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:31.564706 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:31.564706 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:31.564706 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:31.564706 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:31.564706 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:31.564706 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:31.564706 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:31.564706 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:31.564706 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:31.564706 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:36:31.564706 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:31.564706 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 220/442] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 24 04:36:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:31.565432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e19a07-9c3e-4d99-8917-30ad6d0e7d97 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:31.604453 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:31.630834 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 223/443] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:36:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 04:36:31.631690 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c3058-d558-4cd7-8837-1fd321cb8860 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:31.671187 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e19a07-9c3e-4d99-8917-30ad6d0e7d97 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:31.705083 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d31b63-e625-490b-b731-bd7987c6431d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:31.705722 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d31b63-e625-490b-b731-bd7987c6431d None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:31.705994 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d31b63-e625-490b-b731-bd7987c6431d None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:31.706263 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d31b63-e625-490b-b731-bd7987c6431d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:31.731895 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c3058-d558-4cd7-8837-1fd321cb8860 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:31.748017 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:31.767456 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135d450-3fb8-40fb-a5bb-ccb44db9626f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:31.768078 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135d450-3fb8-40fb-a5bb-ccb44db9626f None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:31.768351 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135d450-3fb8-40fb-a5bb-ccb44db9626f None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:31.768616 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135d450-3fb8-40fb-a5bb-ccb44db9626f None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:31.769279 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135d450-3fb8-40fb-a5bb-ccb44db9626f None admin] RBAC: Adding query filter params (name=admin) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:31.769605 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135d450-3fb8-40fb-a5bb-ccb44db9626f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:31.770997 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135d450-3fb8-40fb-a5bb-ccb44db9626f None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:31.773987 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d31b63-e625-490b-b731-bd7987c6431d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:31.775472 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d31b63-e625-490b-b731-bd7987c6431d None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:31.779320 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 224/444] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:36:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:31.780129 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135d450-3fb8-40fb-a5bb-ccb44db9626f None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:31.815351 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:31.877630 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 221/445] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:36:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:36:31.878794 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d31b63-e625-490b-b731-bd7987c6431d None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:31.883788 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135d450-3fb8-40fb-a5bb-ccb44db9626f None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:31.918611 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee36cd4-48fd-4f5a-8d3d-7cd35514dd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:31.919251 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee36cd4-48fd-4f5a-8d3d-7cd35514dd1d None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:31.919530 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee36cd4-48fd-4f5a-8d3d-7cd35514dd1d None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:31.919805 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee36cd4-48fd-4f5a-8d3d-7cd35514dd1d None admin] PATH_INFO: `/v3/projects/33beb4c6e7a44d5a823b242c69b5c231` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:31.923080 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee36cd4-48fd-4f5a-8d3d-7cd35514dd1d None admin] RBAC: Authorizing `identity:get_project(project_id=33beb4c6e7a44d5a823b242c69b5c231)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:31.923080 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee36cd4-48fd-4f5a-8d3d-7cd35514dd1d None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:31.924311 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 225/446] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:36:31 2022] GET /identity/v3/projects/33beb4c6e7a44d5a823b242c69b5c231 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:31.925141 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee36cd4-48fd-4f5a-8d3d-7cd35514dd1d None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:31.961656 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:31.988401 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d31b63-e625-490b-b731-bd7987c6431d None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:32.024596 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4512f-4aa3-4f5d-b61a-09c2c46f54e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:32.025229 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4512f-4aa3-4f5d-b61a-09c2c46f54e0 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:32.025527 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4512f-4aa3-4f5d-b61a-09c2c46f54e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:32.025796 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4512f-4aa3-4f5d-b61a-09c2c46f54e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:32.032607 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee36cd4-48fd-4f5a-8d3d-7cd35514dd1d None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:32.035046 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:32.067019 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff51508-8390-428f-875f-6cc01843e40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:32.067656 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff51508-8390-428f-875f-6cc01843e40d None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:32.067956 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff51508-8390-428f-875f-6cc01843e40d None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:32.068195 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff51508-8390-428f-875f-6cc01843e40d None admin] PATH_INFO: `/v3/projects/b74b66f35e054f368691db7e9bc5c219` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:32.069390 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff51508-8390-428f-875f-6cc01843e40d None admin] RBAC: Authorizing `identity:get_project(project_id=b74b66f35e054f368691db7e9bc5c219)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:32.070905 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff51508-8390-428f-875f-6cc01843e40d None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:32.072716 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 226/447] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:36:31 2022] GET /identity/v3/projects/b74b66f35e054f368691db7e9bc5c219 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:32.073306 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff51508-8390-428f-875f-6cc01843e40d None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:32.098070 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c4512f-4aa3-4f5d-b61a-09c2c46f54e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:32.099539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c4512f-4aa3-4f5d-b61a-09c2c46f54e0 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:32.178387 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff51508-8390-428f-875f-6cc01843e40d None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:32.180524 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:32.207623 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 222/448] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:36:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:36:32.208512 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4512f-4aa3-4f5d-b61a-09c2c46f54e0 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:32.223929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc7327-3cfb-45f5-a0ae-fac9edd094d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:32.224577 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc7327-3cfb-45f5-a0ae-fac9edd094d0 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:32.224879 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc7327-3cfb-45f5-a0ae-fac9edd094d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:32.225149 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc7327-3cfb-45f5-a0ae-fac9edd094d0 None admin] PATH_INFO: `/v3/groups/c75cff3c8b414b43abcb2e2cc91236ae` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:32.226380 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc7327-3cfb-45f5-a0ae-fac9edd094d0 None admin] RBAC: Authorizing `identity:get_group(group_id=c75cff3c8b414b43abcb2e2cc91236ae)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:32.227870 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc7327-3cfb-45f5-a0ae-fac9edd094d0 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:32.229600 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 227/449] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 24 04:36:32 2022] GET /identity/v3/groups/c75cff3c8b414b43abcb2e2cc91236ae => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:32.230401 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc7327-3cfb-45f5-a0ae-fac9edd094d0 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:32.274540 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:32.313948 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4512f-4aa3-4f5d-b61a-09c2c46f54e0 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:32.335067 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc7327-3cfb-45f5-a0ae-fac9edd094d0 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:32.350257 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b1959-2ced-4112-93f5-5783f3619a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:32.350893 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b1959-2ced-4112-93f5-5783f3619a7b None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:32.351166 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b1959-2ced-4112-93f5-5783f3619a7b None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:32.351431 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b1959-2ced-4112-93f5-5783f3619a7b None admin] PATH_INFO: `/v3/groups/c75cff3c8b414b43abcb2e2cc91236ae` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:32.352714 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4b1959-2ced-4112-93f5-5783f3619a7b None admin] RBAC: Authorizing `identity:get_group(group_id=c75cff3c8b414b43abcb2e2cc91236ae)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:32.354539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4b1959-2ced-4112-93f5-5783f3619a7b None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:32.356354 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 223/450] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 24 04:36:32 2022] GET /identity/v3/groups/c75cff3c8b414b43abcb2e2cc91236ae => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:32.357102 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b1959-2ced-4112-93f5-5783f3619a7b None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:32.370524 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02977680-c720-4f3b-96ca-75b61e27b297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:32.371160 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02977680-c720-4f3b-96ca-75b61e27b297 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:32.371437 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02977680-c720-4f3b-96ca-75b61e27b297 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:32.371707 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02977680-c720-4f3b-96ca-75b61e27b297 None admin] PATH_INFO: `/v3/projects/68ea81c5f7c24dfdae5a0b686d31ba39` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:32.372870 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02977680-c720-4f3b-96ca-75b61e27b297 None admin] RBAC: Authorizing `identity:get_project(project_id=68ea81c5f7c24dfdae5a0b686d31ba39)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:32.374404 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02977680-c720-4f3b-96ca-75b61e27b297 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:32.376107 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 228/451] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:36:32 2022] GET /identity/v3/projects/68ea81c5f7c24dfdae5a0b686d31ba39 => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:32.376874 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02977680-c720-4f3b-96ca-75b61e27b297 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:32.406474 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:32.466776 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b1959-2ced-4112-93f5-5783f3619a7b None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:32.478947 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02977680-c720-4f3b-96ca-75b61e27b297 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:32.488378 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:32.501768 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5aa40c-a954-410d-a157-d962e20bbf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:32.502708 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5aa40c-a954-410d-a157-d962e20bbf16 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:32.502993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5aa40c-a954-410d-a157-d962e20bbf16 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:32.503265 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5aa40c-a954-410d-a157-d962e20bbf16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:32.504003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5aa40c-a954-410d-a157-d962e20bbf16 None admin] RBAC: Adding query filter params (group.id=c75cff3c8b414b43abcb2e2cc91236ae, role.id=3c2269f848184abd93ef97d02f6553e4, scope.project.id=33beb4c6e7a44d5a823b242c69b5c231) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:32.504312 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5aa40c-a954-410d-a157-d962e20bbf16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:32.505870 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5aa40c-a954-410d-a157-d962e20bbf16 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:32.512401 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 224/452] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Aug 24 04:36:32 2022] GET /identity/v3/role_assignments?group.id=c75cff3c8b414b43abcb2e2cc91236ae&scope.project.id=33beb4c6e7a44d5a823b242c69b5c231&role.id=3c2269f848184abd93ef97d02f6553e4 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:32.513223 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5aa40c-a954-410d-a157-d962e20bbf16 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:32.514576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc24f3-c4d0-46ca-b424-e111a28b1721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:32.515197 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc24f3-c4d0-46ca-b424-e111a28b1721 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:32.515471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc24f3-c4d0-46ca-b424-e111a28b1721 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:32.515735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc24f3-c4d0-46ca-b424-e111a28b1721 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:32.516586 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc24f3-c4d0-46ca-b424-e111a28b1721 None admin] RBAC: Adding query filter params (group.id=c75cff3c8b414b43abcb2e2cc91236ae, role.id=3c2269f848184abd93ef97d02f6553e4, scope.project.id=b74b66f35e054f368691db7e9bc5c219) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:32.516816 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc24f3-c4d0-46ca-b424-e111a28b1721 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:32.518486 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc24f3-c4d0-46ca-b424-e111a28b1721 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:32.535846 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 229/453] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Aug 24 04:36:32 2022] GET /identity/v3/role_assignments?group.id=c75cff3c8b414b43abcb2e2cc91236ae&scope.project.id=b74b66f35e054f368691db7e9bc5c219&role.id=3c2269f848184abd93ef97d02f6553e4 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:32.655651 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5aa40c-a954-410d-a157-d962e20bbf16 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:32.664582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:32.698526 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1140f1-ab33-4aa7-90f8-0156f87d19cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:32.699175 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1140f1-ab33-4aa7-90f8-0156f87d19cb None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:32.699448 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1140f1-ab33-4aa7-90f8-0156f87d19cb None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:32.699715 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1140f1-ab33-4aa7-90f8-0156f87d19cb None admin] PATH_INFO: `/v3/groups/98b2a03dcaf242e6841a57e6059f1a3b` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:32.700840 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1140f1-ab33-4aa7-90f8-0156f87d19cb None admin] RBAC: Authorizing `identity:get_group(group_id=98b2a03dcaf242e6841a57e6059f1a3b)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:32.702324 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1140f1-ab33-4aa7-90f8-0156f87d19cb None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:32.703936 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 225/454] 10.222.0.49 () {56 vars in 1180 bytes} [Wed Aug 24 04:36:32 2022] GET /identity/v3/groups/98b2a03dcaf242e6841a57e6059f1a3b => generated 229 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:32.710237 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc24f3-c4d0-46ca-b424-e111a28b1721 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:32.823825 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc24f3-c4d0-46ca-b424-e111a28b1721 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:32.859871 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c768f-45f4-45b9-a4cb-6a0a8ff75030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:32.860549 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c768f-45f4-45b9-a4cb-6a0a8ff75030 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:32.860828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c768f-45f4-45b9-a4cb-6a0a8ff75030 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:32.861101 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c768f-45f4-45b9-a4cb-6a0a8ff75030 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:32.861970 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c768f-45f4-45b9-a4cb-6a0a8ff75030 None admin] RBAC: Adding query filter params (group.id=98b2a03dcaf242e6841a57e6059f1a3b, role.id=74ce7b72bcc94a8a8ad65c3db928e6ac, scope.project.id=68ea81c5f7c24dfdae5a0b686d31ba39) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:32.862271 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c768f-45f4-45b9-a4cb-6a0a8ff75030 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:32.863713 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c768f-45f4-45b9-a4cb-6a0a8ff75030 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:32.870263 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 230/455] 10.222.0.49 () {56 vars in 1376 bytes} [Wed Aug 24 04:36:32 2022] GET /identity/v3/role_assignments?group.id=98b2a03dcaf242e6841a57e6059f1a3b&scope.project.id=68ea81c5f7c24dfdae5a0b686d31ba39&role.id=74ce7b72bcc94a8a8ad65c3db928e6ac => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:35.239723 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be6f80-5c8a-4dc2-b280-219c93bff4c0 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:35.240713 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be6f80-5c8a-4dc2-b280-219c93bff4c0 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:35.241173 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be6f80-5c8a-4dc2-b280-219c93bff4c0 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:35.243030 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 226/456] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:35.249607 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52277e06-c84e-4733-bea8-4698399ac732 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:35.250529 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52277e06-c84e-4733-bea8-4698399ac732 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:35.251009 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52277e06-c84e-4733-bea8-4698399ac732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:35.282538 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-52277e06-c84e-4733-bea8-4698399ac732 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:35.284180 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-52277e06-c84e-4733-bea8-4698399ac732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:35.321657 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:35.369011 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 231/457] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:35.434189 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa562047-2529-4231-85f9-8fe9bad88760 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:35.434807 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa562047-2529-4231-85f9-8fe9bad88760 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:35.435264 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa562047-2529-4231-85f9-8fe9bad88760 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:35.437082 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 227/458] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:35.442390 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5042b6-e1ea-4403-8cff-930d05b4f6aa None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:35.442674 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5042b6-e1ea-4403-8cff-930d05b4f6aa None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:35.442947 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5042b6-e1ea-4403-8cff-930d05b4f6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:35.468117 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-0b5042b6-e1ea-4403-8cff-930d05b4f6aa None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:35.469368 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-0b5042b6-e1ea-4403-8cff-930d05b4f6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:35.555699 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 232/459] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:35.685101 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79deb45a-5afe-4710-ac3f-1b0dbcaa1679 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:35.685101 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79deb45a-5afe-4710-ac3f-1b0dbcaa1679 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:35.685101 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79deb45a-5afe-4710-ac3f-1b0dbcaa1679 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:35.685975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 228/460] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:35.691822 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34d5cb-c7b2-4b57-a94b-c0e7a1c7c705 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:35.692296 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34d5cb-c7b2-4b57-a94b-c0e7a1c7c705 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:35.692580 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34d5cb-c7b2-4b57-a94b-c0e7a1c7c705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:35.726987 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-cd34d5cb-c7b2-4b57-a94b-c0e7a1c7c705 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:35.728252 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-cd34d5cb-c7b2-4b57-a94b-c0e7a1c7c705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:35.753089 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79deb45a-5afe-4710-ac3f-1b0dbcaa1679 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:35.822654 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 233/461] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:35.918494 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34d5cb-c7b2-4b57-a94b-c0e7a1c7c705 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:35.918717 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79deb45a-5afe-4710-ac3f-1b0dbcaa1679 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:35.960529 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:35.962781 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb6660-4f7a-4754-bce1-1a9095a9d063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:35.963505 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb6660-4f7a-4754-bce1-1a9095a9d063 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:35.963988 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb6660-4f7a-4754-bce1-1a9095a9d063 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:35.964351 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb6660-4f7a-4754-bce1-1a9095a9d063 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:35.986304 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb6660-4f7a-4754-bce1-1a9095a9d063 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:35.987777 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bb6660-4f7a-4754-bce1-1a9095a9d063 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:36.017045 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-53bb6660-4f7a-4754-bce1-1a9095a9d063 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:36.017045 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:36.017045 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:36.017045 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:36.017045 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:36.017045 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:36.017045 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:36.017045 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:36.017045 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:36.017045 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:36.017045 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:36.017045 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:36.017045 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:36.017045 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:36.017045 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:36.017045 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:36.018049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:36.018049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:36.018049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:36.018049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:36.018049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:36.018049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:36.018049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:36.018049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:36.018049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:36.018049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:36.018049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:36.018049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:36.018049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:36.018049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:36.018049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:36.018049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:36.018049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:36.018885 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:36.018885 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:36.018885 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:36.022107 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 229/462] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:36.029556 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb6660-4f7a-4754-bce1-1a9095a9d063 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:36.073679 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34d5cb-c7b2-4b57-a94b-c0e7a1c7c705 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:36.086245 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:36.138058 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb525a-870b-4c6a-852d-d3db27abad4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:36.138714 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb525a-870b-4c6a-852d-d3db27abad4a None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:36.138985 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb525a-870b-4c6a-852d-d3db27abad4a None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:36.139244 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb525a-870b-4c6a-852d-d3db27abad4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:36.163750 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb525a-870b-4c6a-852d-d3db27abad4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:36.165269 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fb525a-870b-4c6a-852d-d3db27abad4a None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:36.196884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-d3fb525a-870b-4c6a-852d-d3db27abad4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:36.196884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:36.196884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:36.196884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:36.196884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:36.196884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:36.196884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:36.196884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:36.196884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:36.196884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:36.196884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:36.196884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:36.196884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:36.196884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:36.196884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:36.196884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:36.197851 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:36.197851 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:36.197851 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:36.197851 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:36.197851 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:36.197851 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:36.197851 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:36.197851 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:36.197851 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:36.197851 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:36.197851 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:36.197851 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:36.197851 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:36.197851 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:36.197851 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:36.197851 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:36.197851 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:36.198660 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:36.198660 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:36.198660 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:36.198660 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 234/463] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:36:36.207162 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb525a-870b-4c6a-852d-d3db27abad4a None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:36.228697 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bb6660-4f7a-4754-bce1-1a9095a9d063 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:36.267325 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd3dd26-0047-4715-bc4a-1f8c687989f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:36.268081 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3dd26-0047-4715-bc4a-1f8c687989f8 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:36.268312 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3dd26-0047-4715-bc4a-1f8c687989f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:36.268578 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd3dd26-0047-4715-bc4a-1f8c687989f8 None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:36.269347 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd3dd26-0047-4715-bc4a-1f8c687989f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:36.269645 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd3dd26-0047-4715-bc4a-1f8c687989f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:36.271013 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd3dd26-0047-4715-bc4a-1f8c687989f8 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:36.283904 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 230/464] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:36.285216 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558997a-3f19-4cf9-a676-c804485a2e11 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:36.285518 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558997a-3f19-4cf9-a676-c804485a2e11 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:36.285790 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1558997a-3f19-4cf9-a676-c804485a2e11 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:36.287198 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 231/465] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:36.290158 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558997a-3f19-4cf9-a676-c804485a2e11 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:36.296206 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:36.321187 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb525a-870b-4c6a-852d-d3db27abad4a None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:36.357100 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c87a0-624f-4d82-8269-18e20fef8217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:36.357741 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c87a0-624f-4d82-8269-18e20fef8217 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:36.358014 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c87a0-624f-4d82-8269-18e20fef8217 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:36.358279 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c87a0-624f-4d82-8269-18e20fef8217 None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:36.358945 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c87a0-624f-4d82-8269-18e20fef8217 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:36.359250 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c87a0-624f-4d82-8269-18e20fef8217 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:36.360696 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c87a0-624f-4d82-8269-18e20fef8217 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:36.384131 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 235/466] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:36.384131 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c87a0-624f-4d82-8269-18e20fef8217 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:36.393725 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:36.412505 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1558997a-3f19-4cf9-a676-c804485a2e11 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:36.449083 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5990f9f-b5ab-48f5-ac56-a00454e690e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:36.449720 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5990f9f-b5ab-48f5-ac56-a00454e690e9 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:36.449996 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5990f9f-b5ab-48f5-ac56-a00454e690e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:36.450273 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5990f9f-b5ab-48f5-ac56-a00454e690e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:36.461677 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5990f9f-b5ab-48f5-ac56-a00454e690e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:36.463160 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5990f9f-b5ab-48f5-ac56-a00454e690e9 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:36.478290 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-c5990f9f-b5ab-48f5-ac56-a00454e690e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:36.478290 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:36.478290 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:36.478290 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:36.478290 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:36.478290 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:36.478290 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:36.478290 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:36.478290 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:36.478290 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:36.478290 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:36.478290 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:36.478290 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:36.478290 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:36.478290 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:36.478290 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:36.479289 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:36.479289 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:36.479289 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:36.479289 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:36.479289 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:36.479289 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:36.479289 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:36.479289 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:36.479289 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:36.479289 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:36.479289 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:36.479289 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:36.479289 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:36.479289 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:36.479289 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:36.479289 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:36.479289 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:36.480136 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:36.480136 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:36.480136 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:36.484446 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 232/467] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:36.485683 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd55ddb-3128-4009-8785-3162575227c4 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:36.485987 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd55ddb-3128-4009-8785-3162575227c4 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:36.486264 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd55ddb-3128-4009-8785-3162575227c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:36.494057 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c87a0-624f-4d82-8269-18e20fef8217 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:36.505440 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-1dd55ddb-3128-4009-8785-3162575227c4 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:36.506672 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-1dd55ddb-3128-4009-8785-3162575227c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:36.532612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf30114-7dc9-4295-ab22-e491cb700a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:36.533235 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf30114-7dc9-4295-ab22-e491cb700a57 None admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:36.533543 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf30114-7dc9-4295-ab22-e491cb700a57 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:36.533816 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf30114-7dc9-4295-ab22-e491cb700a57 None admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:36.534629 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf30114-7dc9-4295-ab22-e491cb700a57 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:36.536243 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf30114-7dc9-4295-ab22-e491cb700a57 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:36.548442 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:36.569537 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 236/468] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 24 04:36:36 2022] POST /identity/v3/users => generated 246 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:36:36.570884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf30114-7dc9-4295-ab22-e491cb700a57 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:36.593933 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 233/469] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:36.593933 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd55ddb-3128-4009-8785-3162575227c4 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:36.734526 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:36.768782 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf30114-7dc9-4295-ab22-e491cb700a57 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:36.782707 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd55ddb-3128-4009-8785-3162575227c4 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:36.813685 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd68da-ac13-4e5a-8ffc-c07d0323a1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:36.814785 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd68da-ac13-4e5a-8ffc-c07d0323a1e3 None admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:36.815253 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd68da-ac13-4e5a-8ffc-c07d0323a1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:36.815742 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd68da-ac13-4e5a-8ffc-c07d0323a1e3 None admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:36.816695 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd68da-ac13-4e5a-8ffc-c07d0323a1e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:36.818598 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd68da-ac13-4e5a-8ffc-c07d0323a1e3 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:36.825463 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc658bb-4d30-4f7e-bf37-5c750f95e365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:36.826116 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc658bb-4d30-4f7e-bf37-5c750f95e365 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:36.826449 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc658bb-4d30-4f7e-bf37-5c750f95e365 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:36.826737 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc658bb-4d30-4f7e-bf37-5c750f95e365 None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:36.827383 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc658bb-4d30-4f7e-bf37-5c750f95e365 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:36.827688 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc658bb-4d30-4f7e-bf37-5c750f95e365 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:36.829182 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc658bb-4d30-4f7e-bf37-5c750f95e365 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:36.843213 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 234/470] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:36.846566 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 237/471] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 24 04:36:36 2022] POST /identity/v3/users => generated 248 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:36:36.849766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc658bb-4d30-4f7e-bf37-5c750f95e365 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:36.907139 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd68da-ac13-4e5a-8ffc-c07d0323a1e3 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:36.977237 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:36.985990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc658bb-4d30-4f7e-bf37-5c750f95e365 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:37.027939 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:37.043713 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b739c-2f1d-4d21-9e2a-afc4675d934c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:37.044357 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b739c-2f1d-4d21-9e2a-afc4675d934c None admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:37.044630 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b739c-2f1d-4d21-9e2a-afc4675d934c None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:37.044896 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b739c-2f1d-4d21-9e2a-afc4675d934c None admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:37.045632 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b739c-2f1d-4d21-9e2a-afc4675d934c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:37.047215 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b739c-2f1d-4d21-9e2a-afc4675d934c None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:37.058334 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd68da-ac13-4e5a-8ffc-c07d0323a1e3 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:37.075603 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 235/472] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 24 04:36:36 2022] POST /identity/v3/users => generated 248 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:36:37.076912 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7942a6-05ba-445c-a1d1-e612bd8f7baf None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:37.077198 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7942a6-05ba-445c-a1d1-e612bd8f7baf None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:37.081611 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7942a6-05ba-445c-a1d1-e612bd8f7baf None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:37.083386 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 236/473] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:37.091467 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b35ee-1cf8-48f9-b75c-1d9611ae36ce None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:37.091839 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b35ee-1cf8-48f9-b75c-1d9611ae36ce None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:37.092032 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b35ee-1cf8-48f9-b75c-1d9611ae36ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:37.112501 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9009f9-2b0b-401c-bd50-9477c5612fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:37.112729 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-fa2b35ee-1cf8-48f9-b75c-1d9611ae36ce None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:37.113761 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9009f9-2b0b-401c-bd50-9477c5612fe9 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:37.113866 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-fa2b35ee-1cf8-48f9-b75c-1d9611ae36ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:37.114363 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9009f9-2b0b-401c-bd50-9477c5612fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:37.114821 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9009f9-2b0b-401c-bd50-9477c5612fe9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:37.135940 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9009f9-2b0b-401c-bd50-9477c5612fe9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:37.137970 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9009f9-2b0b-401c-bd50-9477c5612fe9 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:37.162319 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-ff9009f9-2b0b-401c-bd50-9477c5612fe9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:37.162319 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:37.162319 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:37.162319 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:37.162319 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:37.162319 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:37.162319 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:37.162319 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:37.162319 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:37.162319 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:37.162319 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:37.162319 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:37.162319 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:37.162319 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:37.162319 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:37.162319 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:37.163287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:37.163287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:37.163287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:37.163287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:37.163287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:37.163287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:37.163287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:37.163287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:37.163287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:37.163287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:37.163287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:37.163287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:37.163287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:37.163287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:37.163287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:37.163287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:37.163287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:37.164118 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:37.164118 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:37.164118 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:37.166694 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 238/474] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:36:37.173190 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9009f9-2b0b-401c-bd50-9477c5612fe9 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:37.197937 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 237/475] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:36:37.312534 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9009f9-2b0b-401c-bd50-9477c5612fe9 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:37.314218 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:37.355870 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261735a0-4e3a-405f-9612-68ae883c3ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:37.356866 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261735a0-4e3a-405f-9612-68ae883c3ecd None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:37.357368 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261735a0-4e3a-405f-9612-68ae883c3ecd None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:37.357829 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261735a0-4e3a-405f-9612-68ae883c3ecd None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:37.358676 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261735a0-4e3a-405f-9612-68ae883c3ecd None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:37.359295 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261735a0-4e3a-405f-9612-68ae883c3ecd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:37.360891 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261735a0-4e3a-405f-9612-68ae883c3ecd None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:37.376684 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 239/476] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:37.382920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b35ee-1cf8-48f9-b75c-1d9611ae36ce None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:37.492098 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261735a0-4e3a-405f-9612-68ae883c3ecd None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:37.500192 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b35ee-1cf8-48f9-b75c-1d9611ae36ce None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:37.519105 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:37.542714 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b744eff-6f11-4735-a208-14584121e858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:37.543356 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b744eff-6f11-4735-a208-14584121e858 None admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:37.543638 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b744eff-6f11-4735-a208-14584121e858 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:37.543912 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b744eff-6f11-4735-a208-14584121e858 None admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:37.544587 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b744eff-6f11-4735-a208-14584121e858 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:37.546138 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b744eff-6f11-4735-a208-14584121e858 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:37.573796 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 238/477] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 24 04:36:37 2022] POST /identity/v3/users => generated 249 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:36:37.697853 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261735a0-4e3a-405f-9612-68ae883c3ecd None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:37.742559 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d41631-3a61-434f-941f-af2bab6debf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:37.743240 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d41631-3a61-434f-941f-af2bab6debf3 None admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:37.743504 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d41631-3a61-434f-941f-af2bab6debf3 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:37.743781 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d41631-3a61-434f-941f-af2bab6debf3 None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:37.744517 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d41631-3a61-434f-941f-af2bab6debf3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:37.746380 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d41631-3a61-434f-941f-af2bab6debf3 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:37.763224 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.sql.core [None req-12d41631-3a61-434f-941f-af2bab6debf3 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 04:36:37.763224 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 04:36:37.763224 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [parameters: {'id': 'a909248fa2be489e9a93b01840672e3a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 04:36:37.763224 dv-cinder-854265-1-smb devstack@keystone.service[93147]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93147) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 04:36:37.779860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-12d41631-3a61-434f-941f-af2bab6debf3 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 04:36:37.779860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:37.779860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 04:36:37.779860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 04:36:37.779860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 04:36:37.779860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 04:36:37.779860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 04:36:37.779860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 04:36:37.779860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 04:36:37.779860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application conn.query(q) Aug 24 04:36:37.779860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 04:36:37.779860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 04:36:37.779860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 04:36:37.779860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application result.read() Aug 24 04:36:37.779860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 04:36:37.780835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 04:36:37.780835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 04:36:37.780835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 04:36:37.780835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 04:36:37.780835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 04:36:37.780835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 04:36:37.780835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 04:36:37.780835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 04:36:37.780835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:37.780835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 04:36:37.780835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:37.780835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:37.780835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 04:36:37.780835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 04:36:37.780835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 24 04:36:37.780835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return ref.to_dict() Aug 24 04:36:37.780835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 04:36:37.780835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application next(self.gen) Aug 24 04:36:37.781771 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 04:36:37.781771 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application yield resource Aug 24 04:36:37.781771 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 04:36:37.781771 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application next(self.gen) Aug 24 04:36:37.781771 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 04:36:37.781771 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 04:36:37.781771 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 04:36:37.781771 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 04:36:37.781771 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 04:36:37.781771 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise self.value Aug 24 04:36:37.781771 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 04:36:37.781771 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 04:36:37.781771 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 04:36:37.781771 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application session.commit() Aug 24 04:36:37.781771 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 04:36:37.781771 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 04:36:37.781771 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 04:36:37.782641 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 04:36:37.782641 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 04:36:37.782641 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self.session.flush() Aug 24 04:36:37.782641 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 04:36:37.782641 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 04:36:37.782641 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 04:36:37.782641 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 04:36:37.782641 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 04:36:37.782641 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application compat.raise_( Aug 24 04:36:37.782641 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 04:36:37.782641 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception Aug 24 04:36:37.782641 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 04:36:37.782641 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 04:36:37.782641 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 04:36:37.782641 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 04:36:37.782641 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 04:36:37.782641 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 04:36:37.783466 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 04:36:37.783466 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 04:36:37.783466 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 04:36:37.783466 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 04:36:37.783466 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 04:36:37.783466 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 04:36:37.783466 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 04:36:37.783466 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 04:36:37.783466 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 04:36:37.783466 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 04:36:37.783466 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 04:36:37.783466 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 04:36:37.783466 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 04:36:37.783466 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 04:36:37.783466 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 04:36:37.783466 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception Aug 24 04:36:37.784241 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 04:36:37.784241 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 04:36:37.784241 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 04:36:37.784241 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 04:36:37.784241 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 04:36:37.784241 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 04:36:37.784241 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 04:36:37.784241 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application conn.query(q) Aug 24 04:36:37.784241 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 04:36:37.784241 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 04:36:37.784241 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 04:36:37.784241 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application result.read() Aug 24 04:36:37.784241 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 04:36:37.784241 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 04:36:37.784241 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 04:36:37.784241 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 04:36:37.784993 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 04:36:37.784993 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 04:36:37.784993 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 04:36:37.784993 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 04:36:37.784993 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 04:36:37.784993 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 04:36:37.784993 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [parameters: {'id': 'a909248fa2be489e9a93b01840672e3a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 04:36:37.784993 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 04:36:37.784993 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:37.784993 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:36:37.784993 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:37.784993 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:37.784993 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:37.784993 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:37.784993 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:37.784993 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:37.787684 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:37.787684 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:37.787684 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:37.787684 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:37.787684 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:37.787684 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:37.787684 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 24 04:36:37.787684 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 24 04:36:37.787684 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:37.787684 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:37.787684 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 24 04:36:37.787684 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 24 04:36:37.787684 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 04:36:37.787684 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 04:36:37.787684 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 04:36:37.787684 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:37.793917 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 240/478] 10.222.0.49 () {60 vars in 1131 bytes} [Wed Aug 24 04:36:37 2022] POST /identity/v3/roles => generated 144 bytes in 290 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:37.798667 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b744eff-6f11-4735-a208-14584121e858 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:37.920233 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b744eff-6f11-4735-a208-14584121e858 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:37.957417 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc08e5a-5a08-467e-97fa-1901c1b9d463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:37.958148 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc08e5a-5a08-467e-97fa-1901c1b9d463 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:37.958508 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc08e5a-5a08-467e-97fa-1901c1b9d463 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:37.958817 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc08e5a-5a08-467e-97fa-1901c1b9d463 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:37.970574 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc08e5a-5a08-467e-97fa-1901c1b9d463 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:37.975918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-8dc08e5a-5a08-467e-97fa-1901c1b9d463 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:36:37.975918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:37.975918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:37.975918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:37.975918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:37.975918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:37.975918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:37.975918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:37.975918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:37.975918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:37.975918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:37.975918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:37.975918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:37.975918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:37.975918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:37.975918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:37.976759 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:37.976759 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:37.976759 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:37.976759 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:37.976759 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:37.976759 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:37.976759 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:37.976759 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:37.976759 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:37.976759 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:37.976759 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:37.976759 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:37.976759 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:37.976759 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:37.976759 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:37.976759 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:37.977558 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:37.977558 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:37.977558 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:37.977558 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:37.977558 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:37.977558 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:37.977558 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:37.977558 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:37.977558 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:37.977558 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:37.977558 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:36:37.977558 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:37.977558 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 239/479] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 24 04:36:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:37.984411 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d41631-3a61-434f-941f-af2bab6debf3 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:38.016904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:38.161358 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d41631-3a61-434f-941f-af2bab6debf3 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:38.222058 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346f3f1-6d7b-4c6f-8ade-497f8e862106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:38.222872 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346f3f1-6d7b-4c6f-8ade-497f8e862106 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:38.223323 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346f3f1-6d7b-4c6f-8ade-497f8e862106 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:38.223777 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346f3f1-6d7b-4c6f-8ade-497f8e862106 None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:38.225039 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346f3f1-6d7b-4c6f-8ade-497f8e862106 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:38.225581 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346f3f1-6d7b-4c6f-8ade-497f8e862106 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:38.228203 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346f3f1-6d7b-4c6f-8ade-497f8e862106 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:38.248175 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 241/480] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:39.247498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd158bff-4921-46ae-bd5c-f628efebc127 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:39.248129 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd158bff-4921-46ae-bd5c-f628efebc127 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:39.248129 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd158bff-4921-46ae-bd5c-f628efebc127 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:39.250006 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 240/481] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:39.255991 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2993b0f-72fc-455d-9be9-a83e3a8e4ead None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:39.256479 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2993b0f-72fc-455d-9be9-a83e3a8e4ead None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:39.256579 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2993b0f-72fc-455d-9be9-a83e3a8e4ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:39.275856 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-a2993b0f-72fc-455d-9be9-a83e3a8e4ead None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:39.277120 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-a2993b0f-72fc-455d-9be9-a83e3a8e4ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:39.357651 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 242/482] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:39.526082 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107e341-98f2-4286-b6b2-f521d186773b None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:39.526396 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107e341-98f2-4286-b6b2-f521d186773b None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:39.526649 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107e341-98f2-4286-b6b2-f521d186773b None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:39.528388 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 241/483] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:39.533825 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4ec64-cd1a-45c5-b213-d3f1f7cafb37 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:39.534159 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4ec64-cd1a-45c5-b213-d3f1f7cafb37 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:39.534382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4ec64-cd1a-45c5-b213-d3f1f7cafb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:39.562353 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-53b4ec64-cd1a-45c5-b213-d3f1f7cafb37 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:39.563577 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-53b4ec64-cd1a-45c5-b213-d3f1f7cafb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:39.578595 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:39.643796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 243/484] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:39.670116 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960904ee-88b6-494f-92a2-07e52a49b845 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:39.670563 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960904ee-88b6-494f-92a2-07e52a49b845 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:39.670930 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960904ee-88b6-494f-92a2-07e52a49b845 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:39.672679 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 242/485] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:39.677964 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70d7bc-09f6-42e5-9a74-0be5ae58dc9a None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:39.678403 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70d7bc-09f6-42e5-9a74-0be5ae58dc9a None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:39.678828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70d7bc-09f6-42e5-9a74-0be5ae58dc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:39.703882 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-2e70d7bc-09f6-42e5-9a74-0be5ae58dc9a None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:39.705314 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-2e70d7bc-09f6-42e5-9a74-0be5ae58dc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:39.797326 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 244/486] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:39.857136 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960904ee-88b6-494f-92a2-07e52a49b845 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:39.897871 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:39.995567 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960904ee-88b6-494f-92a2-07e52a49b845 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:40.039141 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5aadb-0215-440b-8a6e-fb32143d8614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:40.039779 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5aadb-0215-440b-8a6e-fb32143d8614 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:40.040057 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5aadb-0215-440b-8a6e-fb32143d8614 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:40.040324 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5aadb-0215-440b-8a6e-fb32143d8614 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:40.052616 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf5aadb-0215-440b-8a6e-fb32143d8614 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:40.057444 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-fdf5aadb-0215-440b-8a6e-fb32143d8614 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:36:40.057444 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:40.057444 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:40.057444 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:40.057444 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:40.057444 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:40.057444 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:40.057444 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:40.057444 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:40.057444 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:40.057444 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:40.057444 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:40.057444 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:40.057444 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:40.057444 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:40.057444 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:40.058497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:40.058497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:40.058497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:40.058497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:40.058497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:40.058497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:40.058497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:40.058497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:40.058497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:40.058497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:40.058497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:40.058497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:40.058497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:40.058497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:40.058497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:40.058497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:40.059535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:40.059535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:40.059535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:40.059535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:40.059535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:40.059535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:40.059535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:40.059535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:40.059535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:40.059535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:40.059535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:36:40.059535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:40.059535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 243/487] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 24 04:36:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:40.064675 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70d7bc-09f6-42e5-9a74-0be5ae58dc9a None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:40.075730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5aadb-0215-440b-8a6e-fb32143d8614 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:40.186875 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:40.204456 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:40.211358 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70d7bc-09f6-42e5-9a74-0be5ae58dc9a None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:40.216568 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5aadb-0215-440b-8a6e-fb32143d8614 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:40.246871 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca8a7c-f836-4f42-add3-c39060b6c2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:40.247508 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca8a7c-f836-4f42-add3-c39060b6c2a2 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:40.247772 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca8a7c-f836-4f42-add3-c39060b6c2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:40.248042 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca8a7c-f836-4f42-add3-c39060b6c2a2 None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:40.248698 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca8a7c-f836-4f42-add3-c39060b6c2a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:40.248998 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca8a7c-f836-4f42-add3-c39060b6c2a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:40.250405 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca8a7c-f836-4f42-add3-c39060b6c2a2 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:40.253029 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158ba03-d0df-4aa7-a9b7-1820145d7981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:40.253701 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158ba03-d0df-4aa7-a9b7-1820145d7981 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:40.253980 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158ba03-d0df-4aa7-a9b7-1820145d7981 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:40.254252 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158ba03-d0df-4aa7-a9b7-1820145d7981 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:40.261088 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 245/488] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 24 04:36:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:40.262699 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca8a7c-f836-4f42-add3-c39060b6c2a2 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:40.269844 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c158ba03-d0df-4aa7-a9b7-1820145d7981 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:40.274898 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-c158ba03-d0df-4aa7-a9b7-1820145d7981 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:36:40.274898 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:40.274898 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:40.274898 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:40.274898 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:40.274898 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:40.274898 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:40.274898 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:40.274898 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:40.274898 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:40.274898 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:40.274898 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:40.274898 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:40.274898 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:40.274898 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:40.274898 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:40.275751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:40.275751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:40.275751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:40.275751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:40.275751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:40.275751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:40.275751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:40.275751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:40.275751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:40.275751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:40.275751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:40.275751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:40.275751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:40.275751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:40.275751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:40.275751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:40.276539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:40.276539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:40.276539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:40.276539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:40.276539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:40.276539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:40.276539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:40.276539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:40.276539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:40.276539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:40.276539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:36:40.276539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:40.276539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 244/489] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 24 04:36:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:36:40.278098 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b9fa0-ecaa-461d-885d-15772eecac5c None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:40.278098 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b9fa0-ecaa-461d-885d-15772eecac5c None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:40.278098 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b9fa0-ecaa-461d-885d-15772eecac5c None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:40.279358 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 245/490] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:40.284812 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b9fa0-ecaa-461d-885d-15772eecac5c None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:40.375049 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca8a7c-f836-4f42-add3-c39060b6c2a2 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:40.395481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b9fa0-ecaa-461d-885d-15772eecac5c None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:40.412825 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570b4ef-43c8-41af-aeef-e5ee67baaf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:40.414079 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570b4ef-43c8-41af-aeef-e5ee67baaf67 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:40.414919 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570b4ef-43c8-41af-aeef-e5ee67baaf67 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:40.415409 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570b4ef-43c8-41af-aeef-e5ee67baaf67 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:40.427593 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:40.432499 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440692e8-dd57-4618-9c14-ffdbe2e9d370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:40.432660 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570b4ef-43c8-41af-aeef-e5ee67baaf67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:40.433158 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440692e8-dd57-4618-9c14-ffdbe2e9d370 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:40.433468 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440692e8-dd57-4618-9c14-ffdbe2e9d370 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:40.433719 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440692e8-dd57-4618-9c14-ffdbe2e9d370 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:40.437428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-e570b4ef-43c8-41af-aeef-e5ee67baaf67 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:36:40.437428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:40.437428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:40.437428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:40.437428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:40.437428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:40.437428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:40.437428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:40.437428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:40.437428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:40.437428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:40.437428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:40.437428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:40.437428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:40.437428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:40.437428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:40.438291 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:40.438291 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:40.438291 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:40.438291 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:40.438291 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:40.438291 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:40.438291 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:40.438291 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:40.438291 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:40.438291 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:40.438291 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:40.438291 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:40.438291 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:40.438291 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:40.438291 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:40.438291 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:40.439097 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:40.439097 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:40.439097 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:40.439097 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:40.439097 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:40.439097 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:40.439097 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:40.439097 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:40.439097 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:40.439097 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:40.439097 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:36:40.439097 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:40.439097 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 246/491] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 24 04:36:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:40.439726 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570b4ef-43c8-41af-aeef-e5ee67baaf67 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:40.447264 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440692e8-dd57-4618-9c14-ffdbe2e9d370 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:40.448730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440692e8-dd57-4618-9c14-ffdbe2e9d370 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:40.467394 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-440692e8-dd57-4618-9c14-ffdbe2e9d370 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:40.467394 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:40.467394 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:40.467394 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:40.467394 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:40.467394 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:40.467394 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:40.467394 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:40.467394 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:40.467394 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:40.467394 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:40.467394 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:40.467394 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:40.467394 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:40.467394 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:40.467394 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:40.468415 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:40.468415 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:40.468415 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:40.468415 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:40.468415 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:40.468415 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:40.468415 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:40.468415 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:40.468415 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:40.468415 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:40.468415 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:40.468415 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:40.468415 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:40.468415 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:40.468415 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:40.468415 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:40.468415 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:40.474516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:40.474516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:40.474516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:40.474516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 246/492] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:40.474516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9331c85-734d-4148-a012-debe6173a371 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:40.474516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9331c85-734d-4148-a012-debe6173a371 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:40.474516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9331c85-734d-4148-a012-debe6173a371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:40.480592 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:40.496421 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-e9331c85-734d-4148-a012-debe6173a371 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:40.498181 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-e9331c85-734d-4148-a012-debe6173a371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:40.548218 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570b4ef-43c8-41af-aeef-e5ee67baaf67 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:40.585368 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 247/493] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:40.585368 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9331c85-734d-4148-a012-debe6173a371 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:40.597823 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1688b9-a5ea-4548-9882-7cf46e3090b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:40.598703 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1688b9-a5ea-4548-9882-7cf46e3090b3 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:40.599053 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1688b9-a5ea-4548-9882-7cf46e3090b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:40.599420 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1688b9-a5ea-4548-9882-7cf46e3090b3 None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:40.600244 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1688b9-a5ea-4548-9882-7cf46e3090b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:40.600677 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1688b9-a5ea-4548-9882-7cf46e3090b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:40.602247 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1688b9-a5ea-4548-9882-7cf46e3090b3 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:40.617449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 247/494] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 24 04:36:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:40.618420 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1688b9-a5ea-4548-9882-7cf46e3090b3 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:40.699044 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:40.709728 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9331c85-734d-4148-a012-debe6173a371 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:40.742655 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1688b9-a5ea-4548-9882-7cf46e3090b3 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:40.750457 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:40.758761 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a81f33-48af-4621-b3e6-1d772b1fdfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:40.760348 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a81f33-48af-4621-b3e6-1d772b1fdfc4 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:40.760895 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a81f33-48af-4621-b3e6-1d772b1fdfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:40.761365 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a81f33-48af-4621-b3e6-1d772b1fdfc4 None admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:40.762413 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a81f33-48af-4621-b3e6-1d772b1fdfc4 None admin] RBAC: Adding query filter params (name=service) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:40.762861 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a81f33-48af-4621-b3e6-1d772b1fdfc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:40.764817 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a81f33-48af-4621-b3e6-1d772b1fdfc4 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:40.782077 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 248/495] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 24 04:36:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:40.782077 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a81f33-48af-4621-b3e6-1d772b1fdfc4 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:40.791309 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da27a4-f8f0-4d7a-abb5-0cc1f5501bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:40.792844 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da27a4-f8f0-4d7a-abb5-0cc1f5501bbc None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:40.793494 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da27a4-f8f0-4d7a-abb5-0cc1f5501bbc None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:40.794467 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da27a4-f8f0-4d7a-abb5-0cc1f5501bbc None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:40.795832 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da27a4-f8f0-4d7a-abb5-0cc1f5501bbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:40.796350 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da27a4-f8f0-4d7a-abb5-0cc1f5501bbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:40.799174 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da27a4-f8f0-4d7a-abb5-0cc1f5501bbc None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:40.821378 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 248/496] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:40.822674 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da27a4-f8f0-4d7a-abb5-0cc1f5501bbc None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:40.900081 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a81f33-48af-4621-b3e6-1d772b1fdfc4 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:40.933783 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9b336-c0ef-4dfb-af9b-9d734a4b5a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:40.934398 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9b336-c0ef-4dfb-af9b-9d734a4b5a3b None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:40.934669 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9b336-c0ef-4dfb-af9b-9d734a4b5a3b None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:40.934934 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9b336-c0ef-4dfb-af9b-9d734a4b5a3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:40.945450 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da27a4-f8f0-4d7a-abb5-0cc1f5501bbc None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:40.945983 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9b336-c0ef-4dfb-af9b-9d734a4b5a3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:40.947548 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9b336-c0ef-4dfb-af9b-9d734a4b5a3b None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:40.962463 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-c4a9b336-c0ef-4dfb-af9b-9d734a4b5a3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:40.962463 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:40.962463 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:40.962463 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:40.962463 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:40.962463 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:40.962463 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:40.962463 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:40.962463 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:40.962463 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:40.962463 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:40.962463 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:40.962463 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:40.962463 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:40.962463 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:40.962463 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:40.963462 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:40.963462 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:40.963462 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:40.963462 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:40.963462 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:40.963462 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:40.963462 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:40.963462 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:40.963462 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:40.963462 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:40.963462 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:40.963462 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:40.963462 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:40.963462 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:40.963462 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:40.963462 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:40.963462 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:40.964298 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:40.964298 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:40.964298 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:40.964298 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 249/497] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:40.964298 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9b336-c0ef-4dfb-af9b-9d734a4b5a3b None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:40.971601 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:40.984474 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98422010-fa8a-488f-a332-1d2002136155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:40.985118 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98422010-fa8a-488f-a332-1d2002136155 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:40.985417 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98422010-fa8a-488f-a332-1d2002136155 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:40.985677 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98422010-fa8a-488f-a332-1d2002136155 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:40.996467 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98422010-fa8a-488f-a332-1d2002136155 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:40.997964 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98422010-fa8a-488f-a332-1d2002136155 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:41.013464 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-98422010-fa8a-488f-a332-1d2002136155 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:41.013464 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:41.013464 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:41.013464 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:41.013464 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:41.013464 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:41.013464 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:41.013464 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:41.013464 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:41.013464 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:41.013464 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:41.013464 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:41.013464 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:41.013464 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:41.013464 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:41.013464 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:41.014396 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:41.014396 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:41.014396 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:41.014396 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:41.014396 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:41.014396 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:41.014396 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:41.014396 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:41.014396 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:41.014396 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:41.014396 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:41.014396 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:41.014396 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:41.014396 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:41.014396 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:41.014396 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:41.014396 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:41.015210 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:41.015210 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:41.015210 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:41.015210 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 249/498] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:41.015410 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98422010-fa8a-488f-a332-1d2002136155 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:41.020757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:41.078086 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9b336-c0ef-4dfb-af9b-9d734a4b5a3b None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:41.111360 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da63e2-ebb8-4384-964d-4467ec80198e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:41.111979 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da63e2-ebb8-4384-964d-4467ec80198e None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:41.112252 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da63e2-ebb8-4384-964d-4467ec80198e None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:41.112518 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da63e2-ebb8-4384-964d-4467ec80198e None admin] PATH_INFO: `/v3/users/nova` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:41.113963 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98422010-fa8a-488f-a332-1d2002136155 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:41.120341 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7da63e2-ebb8-4384-964d-4467ec80198e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:41.121872 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7da63e2-ebb8-4384-964d-4467ec80198e None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:41.134025 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-b7da63e2-ebb8-4384-964d-4467ec80198e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:36:41.134025 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:41.134025 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:41.134025 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:41.134025 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:41.134025 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:41.134025 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:41.134025 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:41.134025 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:41.134025 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:41.134025 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:41.134025 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:41.134025 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:36:41.134025 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:36:41.134025 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:36:41.134025 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:36:41.135180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:41.135180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:41.135180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:36:41.135180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:41.135180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:36:41.135180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:41.135180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:41.135180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:41.135180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:41.135180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:41.135180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:41.135180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:41.135180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:41.135180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:41.135180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:41.135180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:41.135180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:41.135180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:41.136303 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:41.136303 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:41.136303 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:36:41.136303 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:36:41.136303 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:36:41.136303 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:36:41.136303 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:36:41.136303 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:36:41.136303 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:36:41.136303 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:41.136303 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 250/499] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Aug 24 04:36:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:41.136303 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0692d-4186-472f-a6d2-add48f851bb2 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:41.137164 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0692d-4186-472f-a6d2-add48f851bb2 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:41.137164 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0692d-4186-472f-a6d2-add48f851bb2 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:41.138158 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 251/500] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:41.138837 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0692d-4186-472f-a6d2-add48f851bb2 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:41.156519 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcebce-506d-4650-baa9-45181b10b305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:41.157287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcebce-506d-4650-baa9-45181b10b305 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:41.157660 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcebce-506d-4650-baa9-45181b10b305 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:41.157882 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcebce-506d-4650-baa9-45181b10b305 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:41.168420 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fcebce-506d-4650-baa9-45181b10b305 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:41.173892 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-04fcebce-506d-4650-baa9-45181b10b305 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:36:41.173892 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:41.173892 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:41.173892 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:41.173892 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:41.173892 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:41.173892 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:41.173892 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:41.173892 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:41.173892 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:41.173892 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:41.173892 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:41.173892 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:41.173892 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:41.173892 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:41.173892 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:41.174835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:41.174835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:41.174835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:41.174835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:41.174835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:41.174835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:41.174835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:41.174835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:41.174835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:41.174835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:41.174835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:41.174835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:41.174835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:41.174835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:41.174835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:41.174835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:41.175925 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:41.175925 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:41.175925 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:41.175925 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:41.175925 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:41.175925 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:41.175925 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:41.175925 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:41.175925 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:41.175925 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:41.175925 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:36:41.175925 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:41.175925 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 250/501] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 24 04:36:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:41.175925 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcebce-506d-4650-baa9-45181b10b305 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:41.211794 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:41.248775 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0692d-4186-472f-a6d2-add48f851bb2 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:41.256212 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:41.283976 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcebce-506d-4650-baa9-45181b10b305 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:41.286241 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85266b4-68f1-46be-a8f8-730145fb4acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:41.286917 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85266b4-68f1-46be-a8f8-730145fb4acb None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:41.287196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85266b4-68f1-46be-a8f8-730145fb4acb None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:41.287463 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85266b4-68f1-46be-a8f8-730145fb4acb None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:41.288100 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85266b4-68f1-46be-a8f8-730145fb4acb None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:41.288401 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85266b4-68f1-46be-a8f8-730145fb4acb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:41.289823 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85266b4-68f1-46be-a8f8-730145fb4acb None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:41.301757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 252/502] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:41.302548 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85266b4-68f1-46be-a8f8-730145fb4acb None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:41.321926 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3865e46b-ec5f-42aa-bfd1-83df796df6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:41.322529 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865e46b-ec5f-42aa-bfd1-83df796df6ef None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:41.322804 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865e46b-ec5f-42aa-bfd1-83df796df6ef None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:41.323073 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865e46b-ec5f-42aa-bfd1-83df796df6ef None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:41.323755 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3865e46b-ec5f-42aa-bfd1-83df796df6ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:41.324090 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3865e46b-ec5f-42aa-bfd1-83df796df6ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:41.325539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3865e46b-ec5f-42aa-bfd1-83df796df6ef None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:41.337305 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 251/503] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:41.338471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f740c88-6b6b-4d52-a6a4-b671b4c37959 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:41.338755 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f740c88-6b6b-4d52-a6a4-b671b4c37959 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:41.339020 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f740c88-6b6b-4d52-a6a4-b671b4c37959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:41.357224 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-0f740c88-6b6b-4d52-a6a4-b671b4c37959 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:41.358526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-0f740c88-6b6b-4d52-a6a4-b671b4c37959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:41.403747 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85266b4-68f1-46be-a8f8-730145fb4acb None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:41.427757 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 252/504] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:41.428620 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f740c88-6b6b-4d52-a6a4-b671b4c37959 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:41.438516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2f165-2a2d-4a4d-b463-a2199bf38ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:41.439360 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2f165-2a2d-4a4d-b463-a2199bf38ac6 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:41.439647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2f165-2a2d-4a4d-b463-a2199bf38ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:41.439913 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2f165-2a2d-4a4d-b463-a2199bf38ac6 None admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:41.440644 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2f165-2a2d-4a4d-b463-a2199bf38ac6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:41.440944 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2f165-2a2d-4a4d-b463-a2199bf38ac6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:41.442448 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2f165-2a2d-4a4d-b463-a2199bf38ac6 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:41.474405 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:41.485219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 253/505] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Aug 24 04:36:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:41.486713 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2f165-2a2d-4a4d-b463-a2199bf38ac6 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:41.513914 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:41.554273 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f740c88-6b6b-4d52-a6a4-b671b4c37959 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:41.596768 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2f165-2a2d-4a4d-b463-a2199bf38ac6 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:41.602275 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed995cac-e3e4-41ce-bb69-273876e9a325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:41.603316 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed995cac-e3e4-41ce-bb69-273876e9a325 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:41.603814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed995cac-e3e4-41ce-bb69-273876e9a325 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:41.604298 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed995cac-e3e4-41ce-bb69-273876e9a325 None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:41.605737 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed995cac-e3e4-41ce-bb69-273876e9a325 None admin] RBAC: Adding query filter params (name=service) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:41.606433 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed995cac-e3e4-41ce-bb69-273876e9a325 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:41.609031 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed995cac-e3e4-41ce-bb69-273876e9a325 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:41.628044 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 253/506] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 24 04:36:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:41.628044 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed995cac-e3e4-41ce-bb69-273876e9a325 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:41.638636 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4d8ae-7e01-4c92-b16b-3cc7ef180242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:41.639339 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4d8ae-7e01-4c92-b16b-3cc7ef180242 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:41.639586 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4d8ae-7e01-4c92-b16b-3cc7ef180242 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:41.639853 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4d8ae-7e01-4c92-b16b-3cc7ef180242 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:41.647884 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a4d8ae-7e01-4c92-b16b-3cc7ef180242 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:41.649432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a4d8ae-7e01-4c92-b16b-3cc7ef180242 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:41.661637 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-d3a4d8ae-7e01-4c92-b16b-3cc7ef180242 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:36:41.661637 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:41.661637 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:41.661637 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:41.661637 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:41.661637 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:41.661637 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:41.661637 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:41.661637 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:41.661637 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:41.661637 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:41.661637 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:41.661637 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:36:41.661637 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:36:41.661637 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:36:41.661637 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:36:41.662516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:41.662516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:41.662516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:36:41.662516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:41.662516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:36:41.662516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:41.662516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:41.662516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:41.662516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:41.662516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:41.662516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:41.662516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:41.662516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:41.662516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:41.662516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:41.662516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:41.662516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:41.662516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:41.663395 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:41.663395 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:41.663395 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:36:41.663395 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:36:41.663395 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:36:41.663395 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:36:41.663395 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:36:41.663395 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:36:41.663395 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:36:41.663395 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:41.663395 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 254/507] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:36:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:41.663969 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4d8ae-7e01-4c92-b16b-3cc7ef180242 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:41.732415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:41.747645 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed995cac-e3e4-41ce-bb69-273876e9a325 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:41.754016 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:41.770373 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4d8ae-7e01-4c92-b16b-3cc7ef180242 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:41.781710 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087de5bb-ee1e-4a7b-8a87-8a8b740cf83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:41.782353 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087de5bb-ee1e-4a7b-8a87-8a8b740cf83c None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:41.782635 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087de5bb-ee1e-4a7b-8a87-8a8b740cf83c None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:41.782902 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087de5bb-ee1e-4a7b-8a87-8a8b740cf83c None admin] PATH_INFO: `/v3/users/glance` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:41.790435 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087de5bb-ee1e-4a7b-8a87-8a8b740cf83c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:41.791917 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087de5bb-ee1e-4a7b-8a87-8a8b740cf83c None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:41.802159 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bafe93-ec04-4e44-ae62-cefcd6bd9e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:41.802762 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bafe93-ec04-4e44-ae62-cefcd6bd9e23 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:41.803035 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bafe93-ec04-4e44-ae62-cefcd6bd9e23 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:41.803300 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bafe93-ec04-4e44-ae62-cefcd6bd9e23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:41.804160 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-087de5bb-ee1e-4a7b-8a87-8a8b740cf83c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 04:36:41.804160 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:41.804160 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:41.804160 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:41.804160 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:41.804160 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:41.804160 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:41.804160 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:41.804160 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:41.804160 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:41.804160 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:41.804160 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:41.804160 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:36:41.804160 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:36:41.804160 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:36:41.804160 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:36:41.805206 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:41.805206 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:41.805206 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:36:41.805206 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:41.805206 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:36:41.805206 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:41.805206 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:41.805206 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:41.805206 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:41.805206 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:41.805206 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:41.805206 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:41.805206 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:41.805206 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:41.805206 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:41.805206 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:41.805206 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:41.805206 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:41.806193 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:41.806193 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:41.806193 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:36:41.806193 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:36:41.806193 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:36:41.806193 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:36:41.806193 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:36:41.806193 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:36:41.806193 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 04:36:41.806193 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:41.809988 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 254/508] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:36:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:41.810831 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087de5bb-ee1e-4a7b-8a87-8a8b740cf83c None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:41.871610 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bafe93-ec04-4e44-ae62-cefcd6bd9e23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:41.873082 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bafe93-ec04-4e44-ae62-cefcd6bd9e23 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:41.912884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087de5bb-ee1e-4a7b-8a87-8a8b740cf83c None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:41.947695 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b09c5-19c5-4843-83b7-f9972311fad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:41.948651 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b09c5-19c5-4843-83b7-f9972311fad2 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:41.948925 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b09c5-19c5-4843-83b7-f9972311fad2 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:41.949196 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b09c5-19c5-4843-83b7-f9972311fad2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:41.953958 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:41.960237 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b09c5-19c5-4843-83b7-f9972311fad2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:41.961737 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b09c5-19c5-4843-83b7-f9972311fad2 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:41.968254 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:41.976613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 255/509] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:36:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:36:41.976613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bafe93-ec04-4e44-ae62-cefcd6bd9e23 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:41.977047 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-791b09c5-19c5-4843-83b7-f9972311fad2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:41.977047 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:41.977047 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:41.977047 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:41.977047 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:41.977047 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:41.977047 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:41.977047 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:41.977047 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:41.977047 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:41.977047 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:41.977047 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:41.977047 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:41.977047 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:41.977047 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:41.977047 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:41.978082 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:41.978082 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:41.978082 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:41.978082 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:41.978082 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:41.978082 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:41.978082 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:41.978082 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:41.978082 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:41.978082 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:41.978082 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:41.978082 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:41.978082 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:41.978082 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:41.978082 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:41.978082 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:41.978082 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:41.978945 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:41.978945 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:41.978945 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:41.978945 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 255/510] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:41.979173 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b09c5-19c5-4843-83b7-f9972311fad2 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:42.075292 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bafe93-ec04-4e44-ae62-cefcd6bd9e23 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:42.084131 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b09c5-19c5-4843-83b7-f9972311fad2 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:42.108361 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb277a60-9318-4cf8-b157-7174a6d58491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:42.108967 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb277a60-9318-4cf8-b157-7174a6d58491 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:42.109246 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb277a60-9318-4cf8-b157-7174a6d58491 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:42.109553 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb277a60-9318-4cf8-b157-7174a6d58491 None admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:42.110283 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb277a60-9318-4cf8-b157-7174a6d58491 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:42.110588 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb277a60-9318-4cf8-b157-7174a6d58491 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:42.112026 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb277a60-9318-4cf8-b157-7174a6d58491 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:42.117751 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af673c-22aa-4c0b-b234-4885e906a343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:42.118374 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af673c-22aa-4c0b-b234-4885e906a343 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:42.118655 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af673c-22aa-4c0b-b234-4885e906a343 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:42.118924 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af673c-22aa-4c0b-b234-4885e906a343 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:42.129245 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 256/511] 10.222.0.49 () {56 vars in 1137 bytes} [Wed Aug 24 04:36:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:42.130297 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb277a60-9318-4cf8-b157-7174a6d58491 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:42.137491 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af673c-22aa-4c0b-b234-4885e906a343 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:42.139450 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af673c-22aa-4c0b-b234-4885e906a343 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:42.154916 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-71af673c-22aa-4c0b-b234-4885e906a343 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:42.154916 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:42.154916 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:42.154916 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:42.154916 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:42.154916 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:42.154916 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:42.154916 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:42.154916 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:42.154916 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:42.154916 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:42.154916 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:42.154916 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:42.154916 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:42.154916 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:42.154916 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:42.155817 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:42.155817 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:42.155817 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:42.155817 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:42.155817 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:42.155817 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:42.155817 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:42.155817 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:42.155817 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:42.155817 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:42.155817 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:42.155817 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:42.155817 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:42.155817 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:42.155817 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:42.155817 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:42.155817 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:42.157217 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:42.157217 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:42.157217 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:42.157217 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 256/512] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:42.157217 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af673c-22aa-4c0b-b234-4885e906a343 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:42.175620 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:42.208109 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:42.232130 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb277a60-9318-4cf8-b157-7174a6d58491 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:42.258593 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af673c-22aa-4c0b-b234-4885e906a343 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:42.265425 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c552450-e692-4d5f-9861-1536ae9488ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:42.266034 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c552450-e692-4d5f-9861-1536ae9488ae None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:42.266312 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c552450-e692-4d5f-9861-1536ae9488ae None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:42.266581 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c552450-e692-4d5f-9861-1536ae9488ae None admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:42.267314 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c552450-e692-4d5f-9861-1536ae9488ae None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:42.267619 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c552450-e692-4d5f-9861-1536ae9488ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:42.269065 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c552450-e692-4d5f-9861-1536ae9488ae None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:42.287241 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 257/513] 10.222.0.49 () {56 vars in 1137 bytes} [Wed Aug 24 04:36:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:42.287889 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c552450-e692-4d5f-9861-1536ae9488ae None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:42.312488 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9a7ca-de8e-4a9e-866a-51170d84b46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:42.313116 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9a7ca-de8e-4a9e-866a-51170d84b46f None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:42.313409 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9a7ca-de8e-4a9e-866a-51170d84b46f None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:42.313679 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9a7ca-de8e-4a9e-866a-51170d84b46f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:42.324781 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b9a7ca-de8e-4a9e-866a-51170d84b46f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:42.326337 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b9a7ca-de8e-4a9e-866a-51170d84b46f None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:42.340455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-69b9a7ca-de8e-4a9e-866a-51170d84b46f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:42.340455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:42.340455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:42.340455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:42.340455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:42.340455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:42.340455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:42.340455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:42.340455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:42.340455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:42.340455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:42.340455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:42.340455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:42.340455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:42.340455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:42.340455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:42.341567 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:42.341567 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:42.341567 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:42.341567 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:42.341567 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:42.341567 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:42.341567 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:42.341567 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:42.341567 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:42.341567 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:42.341567 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:42.341567 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:42.341567 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:42.341567 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:42.341567 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:42.341567 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:42.341567 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:42.342388 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:42.342388 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:42.342388 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:42.342388 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 257/514] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:42.342388 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9a7ca-de8e-4a9e-866a-51170d84b46f None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:42.396096 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:42.399056 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c552450-e692-4d5f-9861-1536ae9488ae None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:42.434019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7a56b-0b90-46f6-bc68-eb1d3b075ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:42.434609 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7a56b-0b90-46f6-bc68-eb1d3b075ddd None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:42.434887 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7a56b-0b90-46f6-bc68-eb1d3b075ddd None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:42.435165 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7a56b-0b90-46f6-bc68-eb1d3b075ddd None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:42.435803 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7a56b-0b90-46f6-bc68-eb1d3b075ddd None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:42.436105 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7a56b-0b90-46f6-bc68-eb1d3b075ddd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:42.437521 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7a56b-0b90-46f6-bc68-eb1d3b075ddd None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:42.441284 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9a7ca-de8e-4a9e-866a-51170d84b46f None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:42.442847 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:42.448905 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 258/515] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:42.449749 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7a56b-0b90-46f6-bc68-eb1d3b075ddd None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:42.477159 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e82697-38bc-4e5c-8fcc-101e9f8ad494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:42.477797 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e82697-38bc-4e5c-8fcc-101e9f8ad494 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:42.478082 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e82697-38bc-4e5c-8fcc-101e9f8ad494 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:42.478377 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e82697-38bc-4e5c-8fcc-101e9f8ad494 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:42.544374 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e82697-38bc-4e5c-8fcc-101e9f8ad494 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:42.545903 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e82697-38bc-4e5c-8fcc-101e9f8ad494 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:42.550930 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7a56b-0b90-46f6-bc68-eb1d3b075ddd None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:42.583754 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173c04a-97e4-4bc6-be82-3a9df5cda42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:42.584285 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173c04a-97e4-4bc6-be82-3a9df5cda42a None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:42.584565 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173c04a-97e4-4bc6-be82-3a9df5cda42a None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:42.584839 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3173c04a-97e4-4bc6-be82-3a9df5cda42a None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:42.585521 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173c04a-97e4-4bc6-be82-3a9df5cda42a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:42.585825 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173c04a-97e4-4bc6-be82-3a9df5cda42a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:42.587211 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3173c04a-97e4-4bc6-be82-3a9df5cda42a None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:42.599105 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 259/516] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:42.599887 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173c04a-97e4-4bc6-be82-3a9df5cda42a None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:42.626063 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:42.651412 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 258/517] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:36:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:36:42.652291 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e82697-38bc-4e5c-8fcc-101e9f8ad494 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:42.654574 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:42.703076 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3173c04a-97e4-4bc6-be82-3a9df5cda42a None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:42.736260 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd57504-0de0-4fb1-a5e4-caeed4a7e28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:42.736874 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd57504-0de0-4fb1-a5e4-caeed4a7e28b None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:42.737151 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd57504-0de0-4fb1-a5e4-caeed4a7e28b None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:42.737460 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd57504-0de0-4fb1-a5e4-caeed4a7e28b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:42.754177 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e82697-38bc-4e5c-8fcc-101e9f8ad494 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:42.790515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb2d36-9b45-4bba-8bb7-2ab5788855cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:42.791154 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb2d36-9b45-4bba-8bb7-2ab5788855cf None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:42.791453 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb2d36-9b45-4bba-8bb7-2ab5788855cf None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:42.791720 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb2d36-9b45-4bba-8bb7-2ab5788855cf None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:42.792391 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb2d36-9b45-4bba-8bb7-2ab5788855cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:42.792680 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb2d36-9b45-4bba-8bb7-2ab5788855cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:42.794094 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb2d36-9b45-4bba-8bb7-2ab5788855cf None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:42.806360 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 259/518] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:42.806503 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd57504-0de0-4fb1-a5e4-caeed4a7e28b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:42.807112 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb2d36-9b45-4bba-8bb7-2ab5788855cf None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:42.807688 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd57504-0de0-4fb1-a5e4-caeed4a7e28b None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:42.828730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:42.871070 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:42.908447 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 260/519] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:36:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:36:42.909277 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd57504-0de0-4fb1-a5e4-caeed4a7e28b None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:42.910695 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb2d36-9b45-4bba-8bb7-2ab5788855cf None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:42.945233 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05101033-7045-4574-beda-d2bed380bbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:42.945906 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05101033-7045-4574-beda-d2bed380bbbd None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:42.946187 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05101033-7045-4574-beda-d2bed380bbbd None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:42.946457 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05101033-7045-4574-beda-d2bed380bbbd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:42.954194 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05101033-7045-4574-beda-d2bed380bbbd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:42.955676 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05101033-7045-4574-beda-d2bed380bbbd None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:42.967496 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-05101033-7045-4574-beda-d2bed380bbbd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 04:36:42.967496 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:42.967496 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:42.967496 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:42.967496 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:42.967496 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:42.967496 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:42.967496 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:42.967496 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:42.967496 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:42.967496 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:42.967496 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:42.967496 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:36:42.967496 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:36:42.967496 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:36:42.967496 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:36:42.968545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:42.968545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:42.968545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:36:42.968545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:42.968545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:36:42.968545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:42.968545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:42.968545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:42.968545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:42.968545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:42.968545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:42.968545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:42.968545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:42.968545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:42.968545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:42.968545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:42.968545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:42.968545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:42.969449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:42.969449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:42.969449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:36:42.969449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:36:42.969449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:36:42.969449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:36:42.969449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:36:42.969449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:36:42.969449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 04:36:42.969449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:42.969449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 260/520] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 24 04:36:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:42.969978 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05101033-7045-4574-beda-d2bed380bbbd None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:43.012578 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd57504-0de0-4fb1-a5e4-caeed4a7e28b None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:43.032467 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:43.046725 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3dbf3-9395-4bbf-9af5-c61b01ba0c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:43.047285 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3dbf3-9395-4bbf-9af5-c61b01ba0c79 None admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:43.047562 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3dbf3-9395-4bbf-9af5-c61b01ba0c79 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:43.047837 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3dbf3-9395-4bbf-9af5-c61b01ba0c79 None admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:43.048476 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3dbf3-9395-4bbf-9af5-c61b01ba0c79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:43.050018 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3dbf3-9395-4bbf-9af5-c61b01ba0c79 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:43.070232 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05101033-7045-4574-beda-d2bed380bbbd None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:43.071967 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 261/521] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 24 04:36:42 2022] POST /identity/v3/users => generated 247 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:36:43.072776 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3dbf3-9395-4bbf-9af5-c61b01ba0c79 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:43.106021 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:43.119670 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e3255-4929-492f-8fe2-c1dbd6818c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:43.120320 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e3255-4929-492f-8fe2-c1dbd6818c01 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:43.120596 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e3255-4929-492f-8fe2-c1dbd6818c01 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:43.120862 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e3255-4929-492f-8fe2-c1dbd6818c01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:43.133294 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e3255-4929-492f-8fe2-c1dbd6818c01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:43.134824 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e3255-4929-492f-8fe2-c1dbd6818c01 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:43.154084 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-d64e3255-4929-492f-8fe2-c1dbd6818c01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:43.154084 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:43.154084 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:43.154084 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:43.154084 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:43.154084 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:43.154084 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:43.154084 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:43.154084 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:43.154084 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:43.154084 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:43.154084 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:43.154084 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:43.154084 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:43.154084 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:43.154084 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:43.155066 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:43.155066 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:43.155066 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:43.155066 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:43.155066 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:43.155066 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:43.155066 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:43.155066 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:43.155066 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:43.155066 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:43.155066 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:43.155066 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:43.155066 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:43.155066 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:43.155066 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:43.155066 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:43.155066 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:43.155895 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:43.155895 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:43.155895 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:43.164593 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 261/522] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:43.164593 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e3255-4929-492f-8fe2-c1dbd6818c01 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:43.194555 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3dbf3-9395-4bbf-9af5-c61b01ba0c79 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:43.240041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245171b-b962-491d-81cc-3ed44c83eac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:43.241073 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245171b-b962-491d-81cc-3ed44c83eac0 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:43.241366 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245171b-b962-491d-81cc-3ed44c83eac0 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:43.241640 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245171b-b962-491d-81cc-3ed44c83eac0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:43.248974 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245171b-b962-491d-81cc-3ed44c83eac0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:43.250452 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245171b-b962-491d-81cc-3ed44c83eac0 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:43.267524 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-b245171b-b962-491d-81cc-3ed44c83eac0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:43.267524 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:43.267524 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:43.267524 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:43.267524 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:43.267524 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:43.267524 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:43.267524 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:43.267524 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:43.267524 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:43.267524 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:43.267524 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:43.267524 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:36:43.267524 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:36:43.267524 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:36:43.268876 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:36:43.268876 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:43.268876 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:43.268876 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:43.268876 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:43.268876 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:43.268876 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:43.268876 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:43.268876 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:43.268876 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:43.268876 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:43.268876 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:43.268876 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:43.268876 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:43.268876 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:43.268876 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:43.268876 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:43.270315 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:36:43.270315 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:36:43.270315 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:36:43.270315 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:36:43.270315 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:36:43.270315 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:36:43.270315 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:43.270315 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:43.270315 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 262/523] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:43.270315 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245171b-b962-491d-81cc-3ed44c83eac0 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:43.293121 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e3255-4929-492f-8fe2-c1dbd6818c01 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:43.307715 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:43.338625 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72937684-8481-4be8-8a79-579f7329af97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:43.339301 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72937684-8481-4be8-8a79-579f7329af97 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:43.339598 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72937684-8481-4be8-8a79-579f7329af97 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:43.340091 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72937684-8481-4be8-8a79-579f7329af97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:43.351954 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72937684-8481-4be8-8a79-579f7329af97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:43.353504 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72937684-8481-4be8-8a79-579f7329af97 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:43.369105 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-72937684-8481-4be8-8a79-579f7329af97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:43.369105 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:43.369105 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:43.369105 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:43.369105 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:43.369105 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:43.369105 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:43.369105 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:43.369105 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:43.369105 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:43.369105 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:43.369105 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:43.369105 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:43.369105 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:43.369105 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:43.369105 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:43.370271 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:43.370271 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:43.370271 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:43.370271 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:43.370271 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:43.370271 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:43.370271 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:43.370271 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:43.370271 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:43.370271 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:43.370271 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:43.370271 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:43.370271 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:43.370271 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:43.370271 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:43.370271 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:43.370271 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:43.371271 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:43.371271 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:43.371271 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:43.371271 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 262/524] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:43.371271 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72937684-8481-4be8-8a79-579f7329af97 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:43.381396 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245171b-b962-491d-81cc-3ed44c83eac0 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:43.406287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:43.417229 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f1752-8782-4142-96f4-353052a33cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:43.417867 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f1752-8782-4142-96f4-353052a33cca None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:43.418140 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f1752-8782-4142-96f4-353052a33cca None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:43.418405 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f1752-8782-4142-96f4-353052a33cca None admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:43.419182 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f1752-8782-4142-96f4-353052a33cca None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:43.419481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f1752-8782-4142-96f4-353052a33cca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:43.421065 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f1752-8782-4142-96f4-353052a33cca None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:43.438820 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 263/525] 10.222.0.49 () {56 vars in 1139 bytes} [Wed Aug 24 04:36:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:43.438820 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f1752-8782-4142-96f4-353052a33cca None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:43.488903 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72937684-8481-4be8-8a79-579f7329af97 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:43.525360 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965eec9-1833-49ea-9230-6c8cf6ce82b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:43.526128 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965eec9-1833-49ea-9230-6c8cf6ce82b6 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:43.526500 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965eec9-1833-49ea-9230-6c8cf6ce82b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:43.526837 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965eec9-1833-49ea-9230-6c8cf6ce82b6 None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:43.527544 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c965eec9-1833-49ea-9230-6c8cf6ce82b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:43.527903 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c965eec9-1833-49ea-9230-6c8cf6ce82b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:43.529374 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c965eec9-1833-49ea-9230-6c8cf6ce82b6 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:43.538533 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:43.542347 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 263/526] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:43.543365 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965eec9-1833-49ea-9230-6c8cf6ce82b6 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:43.551324 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f1752-8782-4142-96f4-353052a33cca None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:43.591768 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5435af7-ebd3-45a7-8952-ad3c0ea968dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:43.592535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5435af7-ebd3-45a7-8952-ad3c0ea968dd None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:43.592914 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5435af7-ebd3-45a7-8952-ad3c0ea968dd None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:43.593282 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5435af7-ebd3-45a7-8952-ad3c0ea968dd None admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:43.594097 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5435af7-ebd3-45a7-8952-ad3c0ea968dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:43.594498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5435af7-ebd3-45a7-8952-ad3c0ea968dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:43.596041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5435af7-ebd3-45a7-8952-ad3c0ea968dd None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:43.619125 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 264/527] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 24 04:36:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:43.619125 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5435af7-ebd3-45a7-8952-ad3c0ea968dd None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:43.651773 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:43.669431 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965eec9-1833-49ea-9230-6c8cf6ce82b6 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:43.709292 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a074194-95a5-4fee-b69e-1119ee5d5b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:43.709925 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a074194-95a5-4fee-b69e-1119ee5d5b8d None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:43.710194 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a074194-95a5-4fee-b69e-1119ee5d5b8d None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:43.710456 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a074194-95a5-4fee-b69e-1119ee5d5b8d None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:43.711099 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a074194-95a5-4fee-b69e-1119ee5d5b8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:43.711395 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a074194-95a5-4fee-b69e-1119ee5d5b8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:43.712884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a074194-95a5-4fee-b69e-1119ee5d5b8d None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:43.720329 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5435af7-ebd3-45a7-8952-ad3c0ea968dd None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:43.728538 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 264/528] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:43.728538 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a074194-95a5-4fee-b69e-1119ee5d5b8d None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:43.757019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8a649-855f-4e08-b55b-ae78f5fb0898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:43.757928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8a649-855f-4e08-b55b-ae78f5fb0898 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:43.758199 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8a649-855f-4e08-b55b-ae78f5fb0898 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:43.758473 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8a649-855f-4e08-b55b-ae78f5fb0898 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:43.782334 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:43.827264 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb8a649-855f-4e08-b55b-ae78f5fb0898 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:43.828931 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb8a649-855f-4e08-b55b-ae78f5fb0898 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:43.832143 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a074194-95a5-4fee-b69e-1119ee5d5b8d None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:43.867372 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f0094-b3b6-40bf-910c-f5b72a13fd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:43.868100 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f0094-b3b6-40bf-910c-f5b72a13fd95 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:43.868458 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f0094-b3b6-40bf-910c-f5b72a13fd95 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:43.868728 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f0094-b3b6-40bf-910c-f5b72a13fd95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:43.876077 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f0094-b3b6-40bf-910c-f5b72a13fd95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:43.877687 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f0094-b3b6-40bf-910c-f5b72a13fd95 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:43.890260 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-dc7f0094-b3b6-40bf-910c-f5b72a13fd95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:43.890260 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:43.890260 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:43.890260 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:43.890260 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:43.890260 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:43.890260 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:43.890260 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:43.890260 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:43.890260 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:43.890260 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:43.890260 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:43.890260 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:36:43.890260 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:36:43.890260 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:36:43.891315 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:36:43.891315 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:43.891315 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:43.891315 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:43.891315 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:43.891315 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:43.891315 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:43.891315 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:43.891315 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:43.891315 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:43.891315 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:43.891315 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:43.891315 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:43.891315 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:43.891315 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:43.891315 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:43.891315 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:43.892130 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:36:43.892130 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:36:43.892130 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:36:43.892130 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:36:43.892130 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:36:43.892130 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:36:43.892130 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:43.892130 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:43.892130 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 265/529] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:43.892580 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f0094-b3b6-40bf-910c-f5b72a13fd95 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:43.902106 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:43.943187 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 265/530] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:36:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:36:43.944977 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8a649-855f-4e08-b55b-ae78f5fb0898 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:43.999074 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f0094-b3b6-40bf-910c-f5b72a13fd95 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:44.004904 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:44.034443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5bf9c3-1ff2-4ed1-b1b7-7a6e286d5a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:44.035151 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bf9c3-1ff2-4ed1-b1b7-7a6e286d5a3a None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:44.035434 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bf9c3-1ff2-4ed1-b1b7-7a6e286d5a3a None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:44.035706 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bf9c3-1ff2-4ed1-b1b7-7a6e286d5a3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:44.036453 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5bf9c3-1ff2-4ed1-b1b7-7a6e286d5a3a None admin] RBAC: Adding query filter params (role.id=d62916d0c54540b3859985d5d3565718, scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62, user.id=9dc9a3cf381e4a2da36ed82b407a2d94) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:44.036768 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5bf9c3-1ff2-4ed1-b1b7-7a6e286d5a3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:44.038247 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5bf9c3-1ff2-4ed1-b1b7-7a6e286d5a3a None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:44.044143 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 266/531] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:36:43 2022] GET /identity/v3/role_assignments?user.id=9dc9a3cf381e4a2da36ed82b407a2d94&scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62&role.id=d62916d0c54540b3859985d5d3565718 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:44.044954 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5bf9c3-1ff2-4ed1-b1b7-7a6e286d5a3a None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:44.066274 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8a649-855f-4e08-b55b-ae78f5fb0898 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:44.109997 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c3f5f-5986-4181-8b8e-84b451da8fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:44.111107 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c3f5f-5986-4181-8b8e-84b451da8fea None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:44.111385 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c3f5f-5986-4181-8b8e-84b451da8fea None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:44.111653 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c3f5f-5986-4181-8b8e-84b451da8fea None admin] PATH_INFO: `/v3/projects/service` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:44.122111 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c3f5f-5986-4181-8b8e-84b451da8fea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:44.123605 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c3f5f-5986-4181-8b8e-84b451da8fea None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:44.141733 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:44.146890 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-cd5c3f5f-5986-4181-8b8e-84b451da8fea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:44.146890 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:44.146890 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:44.146890 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:44.146890 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:44.146890 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:44.146890 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:44.146890 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:44.146890 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:44.146890 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:44.146890 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:44.146890 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:44.146890 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:36:44.146890 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:36:44.146890 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:36:44.148109 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:36:44.148109 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:44.148109 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:44.148109 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:44.148109 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:44.148109 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:44.148109 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:44.148109 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:44.148109 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:44.148109 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:44.148109 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:44.148109 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:44.148109 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:44.148109 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:44.148109 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:44.148109 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:44.148109 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:44.149300 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:36:44.149300 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:36:44.149300 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:36:44.149300 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:36:44.149300 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:36:44.149300 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:36:44.149300 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:44.149300 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:44.157499 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 266/532] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:44.158681 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c3f5f-5986-4181-8b8e-84b451da8fea None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:44.187055 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5bf9c3-1ff2-4ed1-b1b7-7a6e286d5a3a None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:44.233169 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca2cb6-0b55-4ef4-8111-784272926466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:44.234009 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca2cb6-0b55-4ef4-8111-784272926466 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:44.234288 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca2cb6-0b55-4ef4-8111-784272926466 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:44.234560 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca2cb6-0b55-4ef4-8111-784272926466 None admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:44.235273 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca2cb6-0b55-4ef4-8111-784272926466 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:44.235576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca2cb6-0b55-4ef4-8111-784272926466 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:44.237027 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca2cb6-0b55-4ef4-8111-784272926466 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:44.261080 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 267/533] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 24 04:36:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:44.262205 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca2cb6-0b55-4ef4-8111-784272926466 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:44.298833 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c3f5f-5986-4181-8b8e-84b451da8fea None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:44.318348 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:44.349974 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3206cc3-ca88-436f-a328-25aab135bcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:44.351280 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3206cc3-ca88-436f-a328-25aab135bcf0 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:44.351702 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3206cc3-ca88-436f-a328-25aab135bcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:44.352591 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3206cc3-ca88-436f-a328-25aab135bcf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:44.368666 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3206cc3-ca88-436f-a328-25aab135bcf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:44.370574 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3206cc3-ca88-436f-a328-25aab135bcf0 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:44.376776 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca2cb6-0b55-4ef4-8111-784272926466 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:44.390542 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-c3206cc3-ca88-436f-a328-25aab135bcf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:44.390542 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:44.390542 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:44.390542 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:44.390542 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:44.390542 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:44.390542 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:44.390542 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:44.390542 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:44.390542 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:44.390542 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:44.390542 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:44.390542 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:44.390542 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:44.390542 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:44.390542 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:44.391452 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:44.391452 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:44.391452 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:44.391452 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:44.391452 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:44.391452 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:44.391452 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:44.391452 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:44.391452 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:44.391452 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:44.391452 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:44.391452 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:44.391452 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:44.391452 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:44.391452 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:44.391452 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:44.391452 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:44.392264 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:44.392264 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:44.392264 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:44.395269 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 267/534] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:44.396600 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3206cc3-ca88-436f-a328-25aab135bcf0 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:44.413593 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:44.422798 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd3215-b37d-4e57-a407-3f588d16da7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:44.423781 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd3215-b37d-4e57-a407-3f588d16da7c None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:44.424282 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd3215-b37d-4e57-a407-3f588d16da7c None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:44.424755 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd3215-b37d-4e57-a407-3f588d16da7c None admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:44.426219 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd3215-b37d-4e57-a407-3f588d16da7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:44.426991 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd3215-b37d-4e57-a407-3f588d16da7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:44.429312 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fd3215-b37d-4e57-a407-3f588d16da7c None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:44.452926 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 268/535] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 24 04:36:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:44.453874 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd3215-b37d-4e57-a407-3f588d16da7c None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:44.526985 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3206cc3-ca88-436f-a328-25aab135bcf0 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:44.562159 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd3215-b37d-4e57-a407-3f588d16da7c None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:44.574171 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355eb486-77a5-4a57-ad16-8a597b137f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:44.574842 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355eb486-77a5-4a57-ad16-8a597b137f4d None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:44.575102 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355eb486-77a5-4a57-ad16-8a597b137f4d None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:44.575383 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355eb486-77a5-4a57-ad16-8a597b137f4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:44.576186 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355eb486-77a5-4a57-ad16-8a597b137f4d None admin] RBAC: Adding query filter params (role.id=d62916d0c54540b3859985d5d3565718, scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62, user.id=2a957fc61ff14c35aac0b577c3c1baf5) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:44.576497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355eb486-77a5-4a57-ad16-8a597b137f4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:44.578052 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355eb486-77a5-4a57-ad16-8a597b137f4d None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:44.584325 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 268/536] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:36:44 2022] GET /identity/v3/role_assignments?user.id=2a957fc61ff14c35aac0b577c3c1baf5&scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62&role.id=d62916d0c54540b3859985d5d3565718 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:44.585264 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355eb486-77a5-4a57-ad16-8a597b137f4d None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:44.629799 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31646d6-b8dc-478b-9926-01a10ac1620e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:44.630514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31646d6-b8dc-478b-9926-01a10ac1620e None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:44.630800 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31646d6-b8dc-478b-9926-01a10ac1620e None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:44.631073 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31646d6-b8dc-478b-9926-01a10ac1620e None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:44.632103 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31646d6-b8dc-478b-9926-01a10ac1620e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:44.633795 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31646d6-b8dc-478b-9926-01a10ac1620e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:44.635562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31646d6-b8dc-478b-9926-01a10ac1620e None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:44.655108 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:44.665293 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 269/537] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:44.676663 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31646d6-b8dc-478b-9926-01a10ac1620e None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:44.765645 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:44.811152 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355eb486-77a5-4a57-ad16-8a597b137f4d None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:44.840179 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31646d6-b8dc-478b-9926-01a10ac1620e None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:44.878614 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0d037-a54c-42f7-9bc1-1c08a73eb97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:44.879243 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0d037-a54c-42f7-9bc1-1c08a73eb97c None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:44.879518 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0d037-a54c-42f7-9bc1-1c08a73eb97c None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:44.879784 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0d037-a54c-42f7-9bc1-1c08a73eb97c None admin] PATH_INFO: `/v3/projects/service` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:44.887381 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e0d037-a54c-42f7-9bc1-1c08a73eb97c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:44.888864 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e0d037-a54c-42f7-9bc1-1c08a73eb97c None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:44.900816 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-55e0d037-a54c-42f7-9bc1-1c08a73eb97c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:44.900816 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:44.900816 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:44.900816 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:44.900816 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:44.900816 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:44.900816 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:44.900816 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:44.900816 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:44.900816 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:44.900816 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:44.900816 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:44.900816 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:36:44.900816 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:36:44.900816 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:36:44.901814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:36:44.901814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:44.901814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:44.901814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:44.901814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:44.901814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:44.901814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:44.901814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:44.901814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:44.901814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:44.901814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:44.901814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:44.901814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:44.901814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:44.901814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:44.901814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:44.901814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:44.902659 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:36:44.902659 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:36:44.902659 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:36:44.902659 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:36:44.902659 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:36:44.902659 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:36:44.902659 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:44.902659 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:44.902659 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 270/538] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:44.907269 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8119de3-71bf-4895-9473-aa77b4e9e105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:44.907803 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8119de3-71bf-4895-9473-aa77b4e9e105 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:44.908089 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8119de3-71bf-4895-9473-aa77b4e9e105 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:44.908197 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0d037-a54c-42f7-9bc1-1c08a73eb97c None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:44.908354 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8119de3-71bf-4895-9473-aa77b4e9e105 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:44.909245 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8119de3-71bf-4895-9473-aa77b4e9e105 None admin] RBAC: Adding query filter params (role.id=d62916d0c54540b3859985d5d3565718, scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62, user.id=2be44ea93247420d994e24912a9ac32e) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:44.909578 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8119de3-71bf-4895-9473-aa77b4e9e105 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:44.911151 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8119de3-71bf-4895-9473-aa77b4e9e105 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:44.922288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 269/539] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:36:44 2022] GET /identity/v3/role_assignments?user.id=2be44ea93247420d994e24912a9ac32e&scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62&role.id=d62916d0c54540b3859985d5d3565718 => generated 259 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:45.019960 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0d037-a54c-42f7-9bc1-1c08a73eb97c None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:45.032336 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:45.058256 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ba48d-4809-40ae-b6aa-86a580f6ab7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:45.058930 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ba48d-4809-40ae-b6aa-86a580f6ab7c None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:45.059207 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ba48d-4809-40ae-b6aa-86a580f6ab7c None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:45.059475 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ba48d-4809-40ae-b6aa-86a580f6ab7c None admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:45.060196 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ba48d-4809-40ae-b6aa-86a580f6ab7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:45.060500 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ba48d-4809-40ae-b6aa-86a580f6ab7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:45.062428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615ba48d-4809-40ae-b6aa-86a580f6ab7c None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:45.077391 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 271/540] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 24 04:36:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:45.083634 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8119de3-71bf-4895-9473-aa77b4e9e105 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:45.127125 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4838f-e758-410e-8dbf-9864c25a206a None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:45.127125 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4838f-e758-410e-8dbf-9864c25a206a None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:45.127411 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4838f-e758-410e-8dbf-9864c25a206a None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:45.128876 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 272/541] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:45.135355 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cf1e5-72c5-4f8b-a895-1111f67a77b5 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:45.135549 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cf1e5-72c5-4f8b-a895-1111f67a77b5 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:45.135784 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cf1e5-72c5-4f8b-a895-1111f67a77b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:45.156518 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-956cf1e5-72c5-4f8b-a895-1111f67a77b5 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:45.157839 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-956cf1e5-72c5-4f8b-a895-1111f67a77b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:45.205755 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:45.213140 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8119de3-71bf-4895-9473-aa77b4e9e105 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:45.236832 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 273/542] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:36:45.248898 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a17a9e-6870-46d8-b87f-676b92687927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:45.249542 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a17a9e-6870-46d8-b87f-676b92687927 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:45.249829 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a17a9e-6870-46d8-b87f-676b92687927 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:45.250099 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a17a9e-6870-46d8-b87f-676b92687927 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:45.250843 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a17a9e-6870-46d8-b87f-676b92687927 None admin] RBAC: Adding query filter params (role.id=d62916d0c54540b3859985d5d3565718, scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62, user.id=087c0311906a4987b294729706a08810) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:45.251154 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a17a9e-6870-46d8-b87f-676b92687927 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:45.252637 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a17a9e-6870-46d8-b87f-676b92687927 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:45.259925 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 270/543] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:36:45 2022] GET /identity/v3/role_assignments?user.id=087c0311906a4987b294729706a08810&scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62&role.id=d62916d0c54540b3859985d5d3565718 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:45.640559 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956cf1e5-72c5-4f8b-a895-1111f67a77b5 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:45.742911 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:45.745903 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956cf1e5-72c5-4f8b-a895-1111f67a77b5 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:45.790958 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04231a67-71de-4763-b370-fff5351593c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:45.791607 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04231a67-71de-4763-b370-fff5351593c1 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:45.791883 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04231a67-71de-4763-b370-fff5351593c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:45.792152 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04231a67-71de-4763-b370-fff5351593c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:45.806350 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04231a67-71de-4763-b370-fff5351593c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:45.811157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-04231a67-71de-4763-b370-fff5351593c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:36:45.811157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:45.811157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:45.811157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:45.811157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:45.811157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:45.811157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:45.811157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:45.811157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:45.811157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:45.811157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:45.811157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:45.811157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:45.811157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:45.811157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:45.811157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:45.812008 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:45.812008 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:45.812008 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:45.812008 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:45.812008 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:45.812008 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:45.812008 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:45.812008 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:45.812008 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:45.812008 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:45.812008 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:45.812008 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:45.812008 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:45.812008 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:45.812008 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:45.812008 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:45.812773 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:45.812773 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:45.812773 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:45.812773 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:45.812773 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:45.812773 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:45.812773 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:45.812773 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:45.812773 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:45.812773 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:45.812773 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:36:45.812773 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:45.816831 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 274/544] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 24 04:36:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:45.818201 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a17a9e-6870-46d8-b87f-676b92687927 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:45.977426 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a17a9e-6870-46d8-b87f-676b92687927 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:46.023108 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abeef68-2e64-416e-bf86-cb526850e29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:46.024106 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abeef68-2e64-416e-bf86-cb526850e29f None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:46.024578 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abeef68-2e64-416e-bf86-cb526850e29f None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:46.025038 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abeef68-2e64-416e-bf86-cb526850e29f None admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:46.025943 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abeef68-2e64-416e-bf86-cb526850e29f None admin] RBAC: Adding query filter params (name=service) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:46.026435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abeef68-2e64-416e-bf86-cb526850e29f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:46.028000 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abeef68-2e64-416e-bf86-cb526850e29f None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:46.040630 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 271/545] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 24 04:36:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:46.046586 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04231a67-71de-4763-b370-fff5351593c1 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:46.191278 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04231a67-71de-4763-b370-fff5351593c1 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:46.266578 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a9ef5-e028-46f3-b261-e1958202e0a5 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:46.267035 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a9ef5-e028-46f3-b261-e1958202e0a5 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:46.267542 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a9ef5-e028-46f3-b261-e1958202e0a5 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:46.270593 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 272/546] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:46.273316 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d1cdc-2c3a-4940-bc1f-0e9e0c31b84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:46.274233 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d1cdc-2c3a-4940-bc1f-0e9e0c31b84f None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:46.274704 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d1cdc-2c3a-4940-bc1f-0e9e0c31b84f None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:46.275187 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d1cdc-2c3a-4940-bc1f-0e9e0c31b84f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:46.279114 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af42fa-69f7-4d4f-9404-baa3c2510ab8 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:46.279624 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af42fa-69f7-4d4f-9404-baa3c2510ab8 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:46.280180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af42fa-69f7-4d4f-9404-baa3c2510ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:46.315034 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d1cdc-2c3a-4940-bc1f-0e9e0c31b84f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:46.317861 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d1cdc-2c3a-4940-bc1f-0e9e0c31b84f None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:46.329710 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-58af42fa-69f7-4d4f-9404-baa3c2510ab8 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:46.331862 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-58af42fa-69f7-4d4f-9404-baa3c2510ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:46.369495 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-549d1cdc-2c3a-4940-bc1f-0e9e0c31b84f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:46.369495 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:46.369495 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:46.369495 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:46.369495 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:46.369495 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:46.369495 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:46.369495 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:46.369495 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:46.369495 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:46.369495 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:46.369495 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:46.369495 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:46.369495 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:46.369495 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:46.369495 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:46.370450 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:46.370450 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:46.370450 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:46.370450 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:46.370450 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:46.370450 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:46.370450 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:46.370450 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:46.370450 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:46.370450 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:46.370450 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:46.370450 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:46.370450 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:46.370450 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:46.370450 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:46.370450 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:46.370450 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:46.371276 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:46.371276 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:46.371276 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:46.371881 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 275/547] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:46.378770 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d1cdc-2c3a-4940-bc1f-0e9e0c31b84f None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:46.393731 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:46.409946 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:46.465830 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 273/548] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:46.603314 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d1cdc-2c3a-4940-bc1f-0e9e0c31b84f None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:46.663101 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6242f23-f57d-49d8-aad9-96be4a903a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:46.664172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6242f23-f57d-49d8-aad9-96be4a903a2a None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:46.664682 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6242f23-f57d-49d8-aad9-96be4a903a2a None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:46.665169 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6242f23-f57d-49d8-aad9-96be4a903a2a None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:46.666401 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6242f23-f57d-49d8-aad9-96be4a903a2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:46.666959 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6242f23-f57d-49d8-aad9-96be4a903a2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:46.669664 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6242f23-f57d-49d8-aad9-96be4a903a2a None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:46.698856 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 276/549] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:46.704689 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af42fa-69f7-4d4f-9404-baa3c2510ab8 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:46.744669 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f3200-d451-4e67-b005-90bfa577082e None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:46.745176 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f3200-d451-4e67-b005-90bfa577082e None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:46.745716 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f3200-d451-4e67-b005-90bfa577082e None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:46.748584 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 277/550] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:46.758943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58e734-b3de-4477-9799-4e872506068a None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:46.759221 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58e734-b3de-4477-9799-4e872506068a None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:46.759495 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58e734-b3de-4477-9799-4e872506068a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:46.794431 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-9d58e734-b3de-4477-9799-4e872506068a None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:46.795651 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-9d58e734-b3de-4477-9799-4e872506068a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:46.842992 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af42fa-69f7-4d4f-9404-baa3c2510ab8 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:46.886782 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ddc189-6e4d-4fda-89ba-2edeb2607be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:46.887352 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddc189-6e4d-4fda-89ba-2edeb2607be1 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:46.887634 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddc189-6e4d-4fda-89ba-2edeb2607be1 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:46.887906 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ddc189-6e4d-4fda-89ba-2edeb2607be1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:46.893431 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 278/551] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:36:46.895137 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58e734-b3de-4477-9799-4e872506068a None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:46.902209 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:46.903409 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ddc189-6e4d-4fda-89ba-2edeb2607be1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:46.904905 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ddc189-6e4d-4fda-89ba-2edeb2607be1 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:46.925112 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-45ddc189-6e4d-4fda-89ba-2edeb2607be1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:36:46.925112 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:46.925112 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:46.925112 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:46.925112 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:46.925112 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:46.925112 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:46.925112 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:46.925112 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:46.925112 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:46.925112 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:46.925112 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:46.925112 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:36:46.925112 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:36:46.925112 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:36:46.925112 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:36:46.927005 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:46.927005 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:46.927005 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:36:46.927005 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:46.927005 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:36:46.927005 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:46.927005 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:46.927005 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:46.927005 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:46.927005 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:46.927005 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:46.927005 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:46.927005 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:46.927005 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:46.927005 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:46.927005 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:46.927005 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:46.927005 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:46.928796 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:46.928796 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:46.928796 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:36:46.928796 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:36:46.928796 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:36:46.928796 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:36:46.928796 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:36:46.928796 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:36:46.928796 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:36:46.928796 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:46.929311 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 274/552] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 24 04:36:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:46.932749 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ddc189-6e4d-4fda-89ba-2edeb2607be1 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:46.950542 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:47.026462 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58e734-b3de-4477-9799-4e872506068a None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:47.047803 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ddc189-6e4d-4fda-89ba-2edeb2607be1 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:47.084767 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ff0a4-78ba-4ed6-8599-4ee4d8419a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:47.085789 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ff0a4-78ba-4ed6-8599-4ee4d8419a29 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:47.086264 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ff0a4-78ba-4ed6-8599-4ee4d8419a29 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:47.086835 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ff0a4-78ba-4ed6-8599-4ee4d8419a29 None admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:47.087776 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ff0a4-78ba-4ed6-8599-4ee4d8419a29 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:47.088554 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ff0a4-78ba-4ed6-8599-4ee4d8419a29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:47.090528 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ff0a4-78ba-4ed6-8599-4ee4d8419a29 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:47.096260 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ad277-da85-4f13-b472-48c9f8330ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:47.097539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ad277-da85-4f13-b472-48c9f8330ab9 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:47.098106 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ad277-da85-4f13-b472-48c9f8330ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:47.098732 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ad277-da85-4f13-b472-48c9f8330ab9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:47.113180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 275/553] 10.222.0.49 () {56 vars in 1135 bytes} [Wed Aug 24 04:36:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:47.118765 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ff0a4-78ba-4ed6-8599-4ee4d8419a29 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:47.119446 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ad277-da85-4f13-b472-48c9f8330ab9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:47.129783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-cc3ad277-da85-4f13-b472-48c9f8330ab9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:36:47.129783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:47.129783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:47.129783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:47.129783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:47.129783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:47.129783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:47.129783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:47.129783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:47.129783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:47.129783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:47.129783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:47.129783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:47.129783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:47.129783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:47.129783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:47.130976 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:47.130976 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:47.130976 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:47.130976 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:47.130976 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:47.130976 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:47.130976 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:47.130976 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:47.130976 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:47.130976 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:47.130976 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:47.130976 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:47.130976 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:47.130976 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:47.130976 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:47.130976 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:47.131874 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:47.131874 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:47.131874 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:47.131874 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:47.131874 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:47.131874 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:47.131874 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:47.131874 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:47.131874 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:47.131874 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:47.131874 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:36:47.131874 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:47.132903 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 279/554] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 24 04:36:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:47.142095 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ad277-da85-4f13-b472-48c9f8330ab9 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:47.245704 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:47.276730 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:47.300989 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ff0a4-78ba-4ed6-8599-4ee4d8419a29 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:47.326552 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ad277-da85-4f13-b472-48c9f8330ab9 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:47.339216 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd457ff-fcbd-4138-8718-fc009442a15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:47.340486 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd457ff-fcbd-4138-8718-fc009442a15f None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:47.340668 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd457ff-fcbd-4138-8718-fc009442a15f None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:47.341010 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd457ff-fcbd-4138-8718-fc009442a15f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:47.369901 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3dc4b-33fc-48de-9c12-7412cdab0e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:47.371029 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3dc4b-33fc-48de-9c12-7412cdab0e66 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:47.371474 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3dc4b-33fc-48de-9c12-7412cdab0e66 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:47.371884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3dc4b-33fc-48de-9c12-7412cdab0e66 None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:47.372865 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3dc4b-33fc-48de-9c12-7412cdab0e66 None admin] RBAC: Adding query filter params (name=service) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:47.373643 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3dc4b-33fc-48de-9c12-7412cdab0e66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:47.375738 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3dc4b-33fc-48de-9c12-7412cdab0e66 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:47.390578 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 280/555] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 24 04:36:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:47.390578 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3dc4b-33fc-48de-9c12-7412cdab0e66 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:47.424821 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd457ff-fcbd-4138-8718-fc009442a15f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:47.427089 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd457ff-fcbd-4138-8718-fc009442a15f None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:47.496272 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3dc4b-33fc-48de-9c12-7412cdab0e66 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:47.506674 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:47.523419 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:47.536225 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41fdad3-f341-466c-af10-13078a10998c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:47.536870 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41fdad3-f341-466c-af10-13078a10998c None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:47.537147 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41fdad3-f341-466c-af10-13078a10998c None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:47.537614 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41fdad3-f341-466c-af10-13078a10998c None admin] PATH_INFO: `/v3/roles/service` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:47.549359 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 276/556] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:36:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:36:47.549359 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd457ff-fcbd-4138-8718-fc009442a15f None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:47.554691 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41fdad3-f341-466c-af10-13078a10998c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:47.559901 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-a41fdad3-f341-466c-af10-13078a10998c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:36:47.559901 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:47.559901 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:47.559901 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:47.559901 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:47.559901 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:47.559901 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:47.559901 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:47.559901 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:47.559901 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:47.559901 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:47.559901 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:47.559901 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:47.559901 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:47.559901 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:47.559901 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:47.569483 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:47.569483 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:47.569483 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:47.569483 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:47.569483 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:47.569483 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:47.569483 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:47.569483 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:47.569483 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:47.569483 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:47.569483 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:47.569483 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:47.569483 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:47.569483 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:47.569483 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:47.569483 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:47.570364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:47.570364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:47.570364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:47.570364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:47.570364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:47.570364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:47.570364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:47.570364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:47.570364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:47.570364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:47.570364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:36:47.570364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:47.570364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 281/557] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 24 04:36:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:47.570364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df056f0d-bfac-4cd4-a680-eccd05b42bf1 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:47.571092 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df056f0d-bfac-4cd4-a680-eccd05b42bf1 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:47.571092 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df056f0d-bfac-4cd4-a680-eccd05b42bf1 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:47.571092 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 282/558] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:47.571092 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df056f0d-bfac-4cd4-a680-eccd05b42bf1 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:47.661000 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd457ff-fcbd-4138-8718-fc009442a15f None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:47.682901 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df056f0d-bfac-4cd4-a680-eccd05b42bf1 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:47.696776 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c1ded-55aa-44dc-9547-ee9e3581fbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:47.697635 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c1ded-55aa-44dc-9547-ee9e3581fbf8 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:47.697912 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c1ded-55aa-44dc-9547-ee9e3581fbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:47.698164 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c1ded-55aa-44dc-9547-ee9e3581fbf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:47.712158 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c1ded-55aa-44dc-9547-ee9e3581fbf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:47.713753 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c1ded-55aa-44dc-9547-ee9e3581fbf8 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:47.722189 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7f0cb-baf9-46ce-a243-da8c27628b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:47.722825 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7f0cb-baf9-46ce-a243-da8c27628b62 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:47.723098 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7f0cb-baf9-46ce-a243-da8c27628b62 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:47.723367 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7f0cb-baf9-46ce-a243-da8c27628b62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:47.729497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-a59c1ded-55aa-44dc-9547-ee9e3581fbf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:47.729497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:47.729497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:47.729497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:47.729497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:47.729497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:47.729497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:47.729497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:47.729497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:47.729497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:47.729497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:47.729497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:47.729497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:47.729497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:47.729497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:47.729497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:47.730569 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:47.730569 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:47.730569 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:47.730569 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:47.730569 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:47.730569 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:47.730569 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:47.730569 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:47.730569 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:47.730569 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:47.730569 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:47.730569 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:47.730569 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:47.730569 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:47.730569 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:47.730569 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:47.730569 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:47.731624 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:47.731624 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:47.731624 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:47.733096 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 277/559] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:47.734034 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c1ded-55aa-44dc-9547-ee9e3581fbf8 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:47.740105 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7f0cb-baf9-46ce-a243-da8c27628b62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:47.741723 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7f0cb-baf9-46ce-a243-da8c27628b62 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:47.756558 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-2ab7f0cb-baf9-46ce-a243-da8c27628b62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:47.756558 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:47.756558 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:47.756558 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:47.756558 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:47.756558 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:47.756558 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:47.756558 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:47.756558 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:47.756558 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:47.756558 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:47.756558 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:47.756558 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:47.756558 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:47.756558 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:47.756558 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:47.758153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:47.758153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:47.758153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:47.758153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:47.758153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:47.758153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:47.758153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:47.758153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:47.758153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:47.758153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:47.758153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:47.758153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:47.758153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:47.758153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:47.758153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:47.758153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:47.758153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:47.759383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:47.759383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:47.759383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:47.759383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 283/560] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:47.761272 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:47.764555 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f0ba1-1333-4c4d-999d-6b32e2f2dc17 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:47.764922 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f0ba1-1333-4c4d-999d-6b32e2f2dc17 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:47.765612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f0ba1-1333-4c4d-999d-6b32e2f2dc17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:47.783350 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-815f0ba1-1333-4c4d-999d-6b32e2f2dc17 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:47.784653 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-815f0ba1-1333-4c4d-999d-6b32e2f2dc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:47.814243 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:47.849320 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c1ded-55aa-44dc-9547-ee9e3581fbf8 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:47.853601 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 284/561] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:47.854449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f0ba1-1333-4c4d-999d-6b32e2f2dc17 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:47.884964 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c78dca-28dc-4ae4-824a-8d1413ac5a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:47.885632 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c78dca-28dc-4ae4-824a-8d1413ac5a84 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:47.885936 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c78dca-28dc-4ae4-824a-8d1413ac5a84 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:47.886208 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c78dca-28dc-4ae4-824a-8d1413ac5a84 None admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:47.886880 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c78dca-28dc-4ae4-824a-8d1413ac5a84 None admin] RBAC: Adding query filter params (name=service) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:47.887181 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c78dca-28dc-4ae4-824a-8d1413ac5a84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:47.888627 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c78dca-28dc-4ae4-824a-8d1413ac5a84 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:47.896844 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 278/562] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 24 04:36:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:47.897673 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c78dca-28dc-4ae4-824a-8d1413ac5a84 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:47.972567 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f0ba1-1333-4c4d-999d-6b32e2f2dc17 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:47.984091 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:48.005586 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c78dca-28dc-4ae4-824a-8d1413ac5a84 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:48.014796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b92d22-b121-488e-a4ea-3e40fc77fb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:48.015383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b92d22-b121-488e-a4ea-3e40fc77fb46 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:48.015668 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b92d22-b121-488e-a4ea-3e40fc77fb46 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:48.015940 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b92d22-b121-488e-a4ea-3e40fc77fb46 None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:48.016615 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b92d22-b121-488e-a4ea-3e40fc77fb46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:48.016919 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b92d22-b121-488e-a4ea-3e40fc77fb46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:48.018388 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b92d22-b121-488e-a4ea-3e40fc77fb46 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:48.034084 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 285/563] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:48.034084 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cec3c8-0036-4c41-9bb6-5a86568a2908 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:48.034084 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cec3c8-0036-4c41-9bb6-5a86568a2908 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:48.034084 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cec3c8-0036-4c41-9bb6-5a86568a2908 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:48.034084 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 286/564] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:48.034084 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cec3c8-0036-4c41-9bb6-5a86568a2908 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:48.047888 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c48ad6-40dd-4ab3-8322-ad9ce0f3c70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:48.048522 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c48ad6-40dd-4ab3-8322-ad9ce0f3c70b None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:48.048800 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c48ad6-40dd-4ab3-8322-ad9ce0f3c70b None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:48.049066 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c48ad6-40dd-4ab3-8322-ad9ce0f3c70b None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:48.049758 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c48ad6-40dd-4ab3-8322-ad9ce0f3c70b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:48.050041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c48ad6-40dd-4ab3-8322-ad9ce0f3c70b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:48.051448 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c48ad6-40dd-4ab3-8322-ad9ce0f3c70b None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:48.067811 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 279/565] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:48.067811 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c48ad6-40dd-4ab3-8322-ad9ce0f3c70b None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:48.068478 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:48.151402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cec3c8-0036-4c41-9bb6-5a86568a2908 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:48.171122 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c48ad6-40dd-4ab3-8322-ad9ce0f3c70b None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:48.185656 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d7d24-b952-4f28-a3f0-df4085ee9d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:48.186284 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d7d24-b952-4f28-a3f0-df4085ee9d27 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:48.186559 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d7d24-b952-4f28-a3f0-df4085ee9d27 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:48.186824 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d7d24-b952-4f28-a3f0-df4085ee9d27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:48.197584 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d7d24-b952-4f28-a3f0-df4085ee9d27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:48.199117 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d7d24-b952-4f28-a3f0-df4085ee9d27 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:48.204430 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068700c-a41f-4f80-a94a-0d99550bd9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:48.205078 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068700c-a41f-4f80-a94a-0d99550bd9d3 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:48.205373 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068700c-a41f-4f80-a94a-0d99550bd9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:48.205644 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068700c-a41f-4f80-a94a-0d99550bd9d3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:48.212560 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068700c-a41f-4f80-a94a-0d99550bd9d3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:48.212986 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-b54d7d24-b952-4f28-a3f0-df4085ee9d27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:48.212986 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:48.212986 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:48.212986 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:48.212986 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:48.212986 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:48.212986 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:48.212986 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:48.212986 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:48.212986 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:48.212986 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:48.212986 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:48.212986 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:48.212986 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:48.212986 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:48.212986 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:48.214077 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:48.214077 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:48.214077 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:48.214077 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:48.214077 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:48.214077 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:48.214077 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:48.214077 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:48.214077 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:48.214077 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:48.214077 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:48.214077 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:48.214077 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:48.214077 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:48.214077 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:48.214077 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:48.214077 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:48.219797 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:48.219797 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:48.219797 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:48.219964 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068700c-a41f-4f80-a94a-0d99550bd9d3 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:48.220045 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 287/566] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:48.220045 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72fea0-2d30-4638-9558-986bc0e97cd6 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:48.220045 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72fea0-2d30-4638-9558-986bc0e97cd6 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:48.220045 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de72fea0-2d30-4638-9558-986bc0e97cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:48.225951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-3068700c-a41f-4f80-a94a-0d99550bd9d3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:36:48.225951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:48.225951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:48.225951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:48.225951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:48.225951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:48.225951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:48.225951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:48.225951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:48.225951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:48.225951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:48.225951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:48.225951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:36:48.225951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:36:48.225951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:36:48.225951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:36:48.231721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:48.231721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:48.231721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:36:48.231721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:48.231721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:36:48.231721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:48.231721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:48.231721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:48.231721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:48.231721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:48.231721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:48.231721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:48.231721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:48.231721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:48.231721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:48.231721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:48.231721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:48.231721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:48.232843 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:48.232843 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:48.232843 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:36:48.232843 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:36:48.232843 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:36:48.232843 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:36:48.232843 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:36:48.232843 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:36:48.232843 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:36:48.232843 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:48.232843 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 280/567] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Aug 24 04:36:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:48.232843 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068700c-a41f-4f80-a94a-0d99550bd9d3 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:48.232843 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:48.234468 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-de72fea0-2d30-4638-9558-986bc0e97cd6 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:48.235676 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-de72fea0-2d30-4638-9558-986bc0e97cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:48.303033 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 288/568] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:48.303876 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72fea0-2d30-4638-9558-986bc0e97cd6 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:48.325427 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:48.327927 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068700c-a41f-4f80-a94a-0d99550bd9d3 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:48.362249 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24507bee-7d7c-4cba-afde-a4ca4429ac64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:48.362865 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24507bee-7d7c-4cba-afde-a4ca4429ac64 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:48.363137 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24507bee-7d7c-4cba-afde-a4ca4429ac64 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:48.363402 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24507bee-7d7c-4cba-afde-a4ca4429ac64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:48.370438 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24507bee-7d7c-4cba-afde-a4ca4429ac64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:48.371989 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24507bee-7d7c-4cba-afde-a4ca4429ac64 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:48.383099 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-24507bee-7d7c-4cba-afde-a4ca4429ac64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:48.383099 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:48.383099 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:48.383099 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:48.383099 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:48.383099 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:48.383099 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:48.383099 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:48.383099 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:48.383099 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:48.383099 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:48.383099 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:48.383099 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:36:48.383099 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:36:48.383099 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:36:48.383966 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:36:48.383966 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:48.383966 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:48.383966 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:48.383966 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:48.383966 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:48.383966 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:48.383966 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:48.383966 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:48.383966 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:48.383966 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:48.383966 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:48.383966 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:48.383966 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:48.383966 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:48.383966 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:48.383966 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:48.384899 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:36:48.384899 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:36:48.384899 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:36:48.384899 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:36:48.384899 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:36:48.384899 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:36:48.384899 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:48.384899 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:48.389036 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 281/569] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:48.389916 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24507bee-7d7c-4cba-afde-a4ca4429ac64 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:48.421793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de72fea0-2d30-4638-9558-986bc0e97cd6 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:48.451175 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:48.459168 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f2b48-ba39-4acb-89e5-7ae56d524fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:48.459810 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f2b48-ba39-4acb-89e5-7ae56d524fc4 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:48.460088 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f2b48-ba39-4acb-89e5-7ae56d524fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:48.460359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f2b48-ba39-4acb-89e5-7ae56d524fc4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:48.470560 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f2b48-ba39-4acb-89e5-7ae56d524fc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:48.475213 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-d05f2b48-ba39-4acb-89e5-7ae56d524fc4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:36:48.475213 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:48.475213 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:48.475213 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:48.475213 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:48.475213 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:48.475213 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:48.475213 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:48.475213 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:48.475213 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:48.475213 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:48.475213 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:48.475213 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:48.475213 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:48.475213 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:48.475213 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:48.476156 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:48.476156 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:48.476156 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:48.476156 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:48.476156 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:48.476156 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:48.476156 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:48.476156 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:48.476156 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:48.476156 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:48.476156 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:48.476156 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:48.476156 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:48.476156 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:48.476156 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:48.476156 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:48.482312 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:48.482312 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:48.482312 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:48.482312 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:48.482312 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:48.482312 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:48.482312 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:48.482312 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:48.482312 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:48.482312 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:48.482312 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:36:48.482312 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:48.482312 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 289/570] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 24 04:36:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:48.482312 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f2b48-ba39-4acb-89e5-7ae56d524fc4 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:48.500788 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24507bee-7d7c-4cba-afde-a4ca4429ac64 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:48.535518 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c62f0b-ed35-41b7-84c4-598fe060498b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:48.536213 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c62f0b-ed35-41b7-84c4-598fe060498b None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:48.536746 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c62f0b-ed35-41b7-84c4-598fe060498b None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:48.537071 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c62f0b-ed35-41b7-84c4-598fe060498b None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:48.537820 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c62f0b-ed35-41b7-84c4-598fe060498b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:48.538172 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c62f0b-ed35-41b7-84c4-598fe060498b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:48.539620 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c62f0b-ed35-41b7-84c4-598fe060498b None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:48.546469 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:48.557585 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 282/571] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:48.557585 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c62f0b-ed35-41b7-84c4-598fe060498b None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:48.583709 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f2b48-ba39-4acb-89e5-7ae56d524fc4 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:48.617581 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff41393-1258-4196-b70d-3d432218a908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:48.618397 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff41393-1258-4196-b70d-3d432218a908 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:48.618677 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff41393-1258-4196-b70d-3d432218a908 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:48.618947 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff41393-1258-4196-b70d-3d432218a908 None admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:48.619693 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff41393-1258-4196-b70d-3d432218a908 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:48.619993 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff41393-1258-4196-b70d-3d432218a908 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:48.621462 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff41393-1258-4196-b70d-3d432218a908 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:48.657809 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 290/572] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Aug 24 04:36:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:48.658316 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c62f0b-ed35-41b7-84c4-598fe060498b None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:48.658629 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff41393-1258-4196-b70d-3d432218a908 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:48.681639 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:48.695003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1a587-51bc-4975-a758-698c75e57327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:48.695612 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1a587-51bc-4975-a758-698c75e57327 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:48.695892 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1a587-51bc-4975-a758-698c75e57327 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:48.696161 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1a587-51bc-4975-a758-698c75e57327 None admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:48.696860 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1a587-51bc-4975-a758-698c75e57327 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:48.697163 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1a587-51bc-4975-a758-698c75e57327 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:48.698667 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1a587-51bc-4975-a758-698c75e57327 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:48.710190 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 283/573] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 24 04:36:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:48.711009 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1a587-51bc-4975-a758-698c75e57327 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:48.771751 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff41393-1258-4196-b70d-3d432218a908 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:48.798866 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:48.809072 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eaca69-a009-451e-96b3-06c35899d666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:48.809724 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eaca69-a009-451e-96b3-06c35899d666 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:48.810013 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eaca69-a009-451e-96b3-06c35899d666 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:48.810281 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eaca69-a009-451e-96b3-06c35899d666 None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:48.810957 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eaca69-a009-451e-96b3-06c35899d666 None admin] RBAC: Adding query filter params (name=service) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:48.811255 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eaca69-a009-451e-96b3-06c35899d666 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:48.812187 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1a587-51bc-4975-a758-698c75e57327 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:48.812666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eaca69-a009-451e-96b3-06c35899d666 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:48.821189 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 291/574] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 24 04:36:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:48.822041 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eaca69-a009-451e-96b3-06c35899d666 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:48.844975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08975ca-e0b1-40ba-b198-248870e3abcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:48.845654 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08975ca-e0b1-40ba-b198-248870e3abcb None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:48.845933 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08975ca-e0b1-40ba-b198-248870e3abcb None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:48.846202 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08975ca-e0b1-40ba-b198-248870e3abcb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:48.853454 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08975ca-e0b1-40ba-b198-248870e3abcb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:48.854902 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08975ca-e0b1-40ba-b198-248870e3abcb None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:48.866007 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-a08975ca-e0b1-40ba-b198-248870e3abcb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:36:48.866007 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:48.866007 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:48.866007 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:48.866007 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:48.866007 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:48.866007 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:48.866007 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:48.866007 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:48.866007 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:48.866007 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:48.866007 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:48.866007 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:36:48.866007 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:36:48.866007 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:36:48.866007 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:36:48.866920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:48.866920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:48.866920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:36:48.866920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:48.866920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:36:48.866920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:48.866920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:48.866920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:48.866920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:48.866920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:48.866920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:48.866920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:48.866920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:48.866920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:48.866920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:48.866920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:48.866920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:48.866920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:48.867811 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:48.867811 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:48.867811 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:36:48.867811 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:36:48.867811 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:36:48.867811 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:36:48.867811 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:36:48.867811 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:36:48.867811 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:36:48.867811 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:48.867811 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 284/575] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:36:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:48.868379 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08975ca-e0b1-40ba-b198-248870e3abcb None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:48.913999 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:48.928823 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eaca69-a009-451e-96b3-06c35899d666 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:48.964895 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7d175-2773-496e-afc2-a06de26d9ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:48.965568 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7d175-2773-496e-afc2-a06de26d9ffc None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:48.965833 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7d175-2773-496e-afc2-a06de26d9ffc None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:48.966119 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7d175-2773-496e-afc2-a06de26d9ffc None admin] PATH_INFO: `/v3/roles/service` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:48.974035 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08975ca-e0b1-40ba-b198-248870e3abcb None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:48.981717 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7d175-2773-496e-afc2-a06de26d9ffc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:48.989897 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-27f7d175-2773-496e-afc2-a06de26d9ffc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:36:48.989897 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:48.989897 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:48.989897 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:48.989897 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:48.989897 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:48.989897 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:48.989897 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:48.989897 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:48.989897 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:48.989897 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:48.989897 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:48.989897 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:48.989897 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:48.989897 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:48.989897 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:48.990960 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:48.990960 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:48.990960 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:48.990960 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:48.990960 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:48.990960 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:48.990960 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:48.990960 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:48.990960 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:48.990960 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:48.990960 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:48.990960 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:48.990960 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:48.990960 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:48.990960 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:48.990960 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:48.991818 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:48.991818 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:48.991818 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:48.991818 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:48.991818 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:48.991818 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:48.991818 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:48.991818 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:48.991818 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:48.991818 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:48.991818 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:36:48.991818 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:48.991818 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 292/576] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 24 04:36:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:48.992469 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7d175-2773-496e-afc2-a06de26d9ffc None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:49.017834 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42410d-2d41-43c1-b383-3f1631571adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:49.018694 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42410d-2d41-43c1-b383-3f1631571adf None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:49.018978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42410d-2d41-43c1-b383-3f1631571adf None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:49.019233 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42410d-2d41-43c1-b383-3f1631571adf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:49.029932 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42410d-2d41-43c1-b383-3f1631571adf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:49.031364 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42410d-2d41-43c1-b383-3f1631571adf None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:49.043876 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:49.045384 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-bc42410d-2d41-43c1-b383-3f1631571adf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:49.045384 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:49.045384 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:49.045384 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:49.045384 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:49.045384 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:49.045384 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:49.045384 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:49.045384 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:49.045384 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:49.045384 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:49.045384 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:49.045384 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:49.045384 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:49.045384 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:49.045384 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:49.046910 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:49.046910 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:49.046910 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:49.046910 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:49.046910 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:49.046910 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:49.046910 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:49.046910 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:49.046910 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:49.046910 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:49.046910 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:49.046910 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:49.046910 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:49.046910 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:49.046910 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:49.046910 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:49.046910 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:49.048050 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:49.048050 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:49.048050 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:49.048050 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 285/577] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:49.048050 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42410d-2d41-43c1-b383-3f1631571adf None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:49.096362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7d175-2773-496e-afc2-a06de26d9ffc None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:49.130495 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32857b3b-9bf8-42f4-8285-ebab484b412a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:49.131128 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32857b3b-9bf8-42f4-8285-ebab484b412a None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:49.131405 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32857b3b-9bf8-42f4-8285-ebab484b412a None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:49.131674 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32857b3b-9bf8-42f4-8285-ebab484b412a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:49.132415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32857b3b-9bf8-42f4-8285-ebab484b412a None admin] RBAC: Adding query filter params (role.id=d62916d0c54540b3859985d5d3565718, scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62, user.id=a7ebb5105220438693118d734c9fda70) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:49.132719 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32857b3b-9bf8-42f4-8285-ebab484b412a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:49.134225 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32857b3b-9bf8-42f4-8285-ebab484b412a None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:49.139780 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 293/578] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:36:48 2022] GET /identity/v3/role_assignments?user.id=a7ebb5105220438693118d734c9fda70&scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62&role.id=d62916d0c54540b3859985d5d3565718 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:49.140309 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:49.140545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32857b3b-9bf8-42f4-8285-ebab484b412a None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:49.160748 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42410d-2d41-43c1-b383-3f1631571adf None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:49.198988 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065e9b8-d872-4103-89f4-86d251a8393b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:49.200011 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065e9b8-d872-4103-89f4-86d251a8393b None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:49.200321 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065e9b8-d872-4103-89f4-86d251a8393b None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:49.200751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065e9b8-d872-4103-89f4-86d251a8393b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:49.212810 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065e9b8-d872-4103-89f4-86d251a8393b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:49.214706 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065e9b8-d872-4103-89f4-86d251a8393b None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:49.231529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-c065e9b8-d872-4103-89f4-86d251a8393b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:49.231529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:49.231529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:49.231529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:49.231529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:49.231529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:49.231529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:49.231529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:49.231529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:49.231529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:49.231529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:49.231529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:49.231529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:49.231529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:49.231529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:49.231529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:49.232556 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:49.232556 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:49.232556 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:49.232556 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:49.232556 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:49.232556 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:49.232556 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:49.232556 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:49.232556 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:49.232556 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:49.232556 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:49.232556 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:49.232556 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:49.232556 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:49.232556 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:49.232556 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:49.232556 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:49.233499 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:49.233499 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:49.233499 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:49.237518 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 286/579] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:49.239191 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065e9b8-d872-4103-89f4-86d251a8393b None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:49.261663 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32857b3b-9bf8-42f4-8285-ebab484b412a None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:49.275932 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:49.307909 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0a188-24a1-4a86-8330-6e770faad439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:49.308590 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0a188-24a1-4a86-8330-6e770faad439 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:49.309182 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0a188-24a1-4a86-8330-6e770faad439 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:49.309501 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0a188-24a1-4a86-8330-6e770faad439 None admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:49.310499 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0a188-24a1-4a86-8330-6e770faad439 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:49.310808 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0a188-24a1-4a86-8330-6e770faad439 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:49.312975 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0a188-24a1-4a86-8330-6e770faad439 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:49.340383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 294/580] 10.222.0.49 () {56 vars in 1137 bytes} [Wed Aug 24 04:36:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:49.340383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0a188-24a1-4a86-8330-6e770faad439 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:49.360912 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065e9b8-d872-4103-89f4-86d251a8393b None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:49.397993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63dd14-f894-4c00-99d0-a7c5ce73288d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:49.398602 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63dd14-f894-4c00-99d0-a7c5ce73288d None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:49.398880 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63dd14-f894-4c00-99d0-a7c5ce73288d None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:49.399149 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63dd14-f894-4c00-99d0-a7c5ce73288d None admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:49.399811 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63dd14-f894-4c00-99d0-a7c5ce73288d None admin] RBAC: Adding query filter params (name=service) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:49.400110 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63dd14-f894-4c00-99d0-a7c5ce73288d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:49.401956 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63dd14-f894-4c00-99d0-a7c5ce73288d None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:49.410600 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 287/581] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 24 04:36:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:49.411570 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63dd14-f894-4c00-99d0-a7c5ce73288d None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:49.423061 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:49.455536 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0a188-24a1-4a86-8330-6e770faad439 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:49.492560 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb451e3a-2698-4b50-a967-13eac63a7b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:49.493177 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb451e3a-2698-4b50-a967-13eac63a7b42 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:49.493483 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb451e3a-2698-4b50-a967-13eac63a7b42 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:49.493752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb451e3a-2698-4b50-a967-13eac63a7b42 None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:49.494760 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb451e3a-2698-4b50-a967-13eac63a7b42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:49.495132 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb451e3a-2698-4b50-a967-13eac63a7b42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:49.496759 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb451e3a-2698-4b50-a967-13eac63a7b42 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:49.508800 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 295/582] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:49.513839 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb451e3a-2698-4b50-a967-13eac63a7b42 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:49.516941 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63dd14-f894-4c00-99d0-a7c5ce73288d None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:49.546452 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:49.553655 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b0ec5-2ce3-4c8c-a1e6-93d5e6650e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:49.554271 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b0ec5-2ce3-4c8c-a1e6-93d5e6650e2b None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:49.554548 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b0ec5-2ce3-4c8c-a1e6-93d5e6650e2b None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:49.554815 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b0ec5-2ce3-4c8c-a1e6-93d5e6650e2b None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:49.555470 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b0ec5-2ce3-4c8c-a1e6-93d5e6650e2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:49.555777 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b0ec5-2ce3-4c8c-a1e6-93d5e6650e2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:49.557153 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b0ec5-2ce3-4c8c-a1e6-93d5e6650e2b None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:49.569424 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 288/583] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:49.570179 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b0ec5-2ce3-4c8c-a1e6-93d5e6650e2b None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:49.628509 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb451e3a-2698-4b50-a967-13eac63a7b42 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:49.647177 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:49.668959 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea5fa6-1853-48a3-af9f-17cb110c6fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:49.669627 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea5fa6-1853-48a3-af9f-17cb110c6fe5 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:49.669909 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea5fa6-1853-48a3-af9f-17cb110c6fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:49.670179 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea5fa6-1853-48a3-af9f-17cb110c6fe5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:49.681467 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea5fa6-1853-48a3-af9f-17cb110c6fe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:49.682839 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b0ec5-2ce3-4c8c-a1e6-93d5e6650e2b None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:49.682950 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea5fa6-1853-48a3-af9f-17cb110c6fe5 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:49.698092 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-ecea5fa6-1853-48a3-af9f-17cb110c6fe5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:49.698092 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:49.698092 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:49.698092 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:49.698092 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:49.698092 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:49.698092 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:49.698092 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:49.698092 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:49.698092 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:49.698092 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:49.698092 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:49.698092 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:49.698092 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:49.698092 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:49.698092 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:49.699382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:49.699382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:49.699382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:49.699382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:49.699382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:49.699382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:49.699382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:49.699382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:49.699382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:49.699382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:49.699382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:49.699382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:49.699382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:49.699382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:49.699382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:49.699382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:49.699382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:49.700969 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:49.700969 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:49.700969 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:49.700969 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 296/584] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:49.700969 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea5fa6-1853-48a3-af9f-17cb110c6fe5 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:49.728930 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b4f41-3117-4e88-a425-5446d2e2db51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:49.729936 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b4f41-3117-4e88-a425-5446d2e2db51 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:49.730420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b4f41-3117-4e88-a425-5446d2e2db51 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:49.730693 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b4f41-3117-4e88-a425-5446d2e2db51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:49.742057 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b4f41-3117-4e88-a425-5446d2e2db51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:49.743525 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b4f41-3117-4e88-a425-5446d2e2db51 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:49.758592 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-b79b4f41-3117-4e88-a425-5446d2e2db51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:49.758592 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:49.758592 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:49.758592 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:49.758592 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:49.758592 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:49.758592 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:49.758592 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:49.758592 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:49.758592 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:49.758592 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:49.758592 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:49.758592 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:49.758592 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:49.758592 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:49.758592 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:49.759573 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:49.759573 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:49.759573 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:49.759573 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:49.759573 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:49.759573 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:49.759573 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:49.759573 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:49.759573 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:49.759573 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:49.759573 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:49.759573 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:49.759573 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:49.759573 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:49.759573 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:49.759573 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:49.759573 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:49.760437 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:49.760437 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:49.760437 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:49.760437 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 289/585] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:49.760664 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b4f41-3117-4e88-a425-5446d2e2db51 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:49.805756 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:49.828149 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea5fa6-1853-48a3-af9f-17cb110c6fe5 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:49.866271 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e2d8b-6a1c-4e8a-a052-200c6e5208b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:49.866904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e2d8b-6a1c-4e8a-a052-200c6e5208b9 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:49.867114 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b4f41-3117-4e88-a425-5446d2e2db51 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:49.867565 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e2d8b-6a1c-4e8a-a052-200c6e5208b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:49.867565 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e2d8b-6a1c-4e8a-a052-200c6e5208b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:49.874410 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e2d8b-6a1c-4e8a-a052-200c6e5208b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:49.875864 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e2d8b-6a1c-4e8a-a052-200c6e5208b9 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:49.887251 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-917e2d8b-6a1c-4e8a-a052-200c6e5208b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:49.887251 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:49.887251 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:49.887251 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:49.887251 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:49.887251 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:49.887251 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:49.887251 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:49.887251 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:49.887251 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:49.887251 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:49.887251 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:49.887251 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:36:49.887251 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:36:49.887251 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:36:49.893908 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:36:49.893908 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:49.893908 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:49.893908 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:49.893908 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:49.893908 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:49.893908 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:49.893908 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:49.893908 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:49.893908 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:49.893908 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:49.893908 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:49.893908 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:49.893908 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:49.893908 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:49.893908 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:49.893908 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:49.894791 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:36:49.894791 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:36:49.894791 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:36:49.894791 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:36:49.894791 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:36:49.894791 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:36:49.894791 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:49.894791 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:49.894791 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 297/586] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:49.894791 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e2d8b-6a1c-4e8a-a052-200c6e5208b9 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:49.897263 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:49.909653 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb165e21-2b56-4f21-9afb-122fd5bd2ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:49.910291 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb165e21-2b56-4f21-9afb-122fd5bd2ff1 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:49.910628 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb165e21-2b56-4f21-9afb-122fd5bd2ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:49.910901 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb165e21-2b56-4f21-9afb-122fd5bd2ff1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:49.918764 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb165e21-2b56-4f21-9afb-122fd5bd2ff1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:49.920173 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb165e21-2b56-4f21-9afb-122fd5bd2ff1 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:49.932288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-cb165e21-2b56-4f21-9afb-122fd5bd2ff1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 04:36:49.932288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:49.932288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:49.932288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:49.932288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:49.932288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:49.932288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:49.932288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:49.932288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:49.932288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:49.932288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:49.932288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:49.932288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:36:49.932288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:36:49.932288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:36:49.932288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:36:49.934217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:49.934217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:49.934217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:36:49.934217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:49.934217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:36:49.934217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:49.934217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:49.934217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:49.934217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:49.934217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:49.934217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:49.934217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:49.934217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:49.934217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:49.934217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:49.934217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:49.934217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:49.934217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:49.935396 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:49.935396 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:49.935396 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:36:49.935396 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:36:49.935396 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:36:49.935396 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:36:49.935396 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:36:49.935396 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:36:49.935396 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 04:36:49.935396 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:49.935396 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 290/587] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:36:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:49.935396 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb165e21-2b56-4f21-9afb-122fd5bd2ff1 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:50.003378 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e2d8b-6a1c-4e8a-a052-200c6e5208b9 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:50.043427 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92cc815-8d30-423d-9701-edc362ccbb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:50.044334 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cc815-8d30-423d-9701-edc362ccbb0d None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:50.044334 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cc815-8d30-423d-9701-edc362ccbb0d None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:50.044642 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92cc815-8d30-423d-9701-edc362ccbb0d None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:50.045220 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92cc815-8d30-423d-9701-edc362ccbb0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:50.045611 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92cc815-8d30-423d-9701-edc362ccbb0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:50.046942 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92cc815-8d30-423d-9701-edc362ccbb0d None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:50.053847 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb165e21-2b56-4f21-9afb-122fd5bd2ff1 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:50.064483 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 298/588] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:50.064483 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92cc815-8d30-423d-9701-edc362ccbb0d None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:50.068007 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:50.094556 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032bb65-cd92-4f60-93b7-e99bb9beb32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:50.095225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032bb65-cd92-4f60-93b7-e99bb9beb32f None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:50.095550 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032bb65-cd92-4f60-93b7-e99bb9beb32f None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:50.095817 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032bb65-cd92-4f60-93b7-e99bb9beb32f None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:50.096467 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6032bb65-cd92-4f60-93b7-e99bb9beb32f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:50.096773 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6032bb65-cd92-4f60-93b7-e99bb9beb32f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:50.098289 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6032bb65-cd92-4f60-93b7-e99bb9beb32f None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:50.111133 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 291/589] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:50.111789 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032bb65-cd92-4f60-93b7-e99bb9beb32f None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:50.164271 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:50.181464 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92cc815-8d30-423d-9701-edc362ccbb0d None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:50.219883 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22361c4b-d0fe-4280-a9fe-257b33f1f2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:50.220809 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22361c4b-d0fe-4280-a9fe-257b33f1f2e3 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:50.221361 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22361c4b-d0fe-4280-a9fe-257b33f1f2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:50.221646 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22361c4b-d0fe-4280-a9fe-257b33f1f2e3 None admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:50.222501 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22361c4b-d0fe-4280-a9fe-257b33f1f2e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:50.222888 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22361c4b-d0fe-4280-a9fe-257b33f1f2e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:50.224879 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22361c4b-d0fe-4280-a9fe-257b33f1f2e3 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:50.225978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032bb65-cd92-4f60-93b7-e99bb9beb32f None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:50.239294 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 299/590] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 24 04:36:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:50.240135 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22361c4b-d0fe-4280-a9fe-257b33f1f2e3 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:50.267720 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c63d3f-e4dd-4391-93a2-8f2c60516cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:50.268334 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c63d3f-e4dd-4391-93a2-8f2c60516cbe None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:50.268770 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c63d3f-e4dd-4391-93a2-8f2c60516cbe None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:50.269082 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c63d3f-e4dd-4391-93a2-8f2c60516cbe None admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:50.270428 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c63d3f-e4dd-4391-93a2-8f2c60516cbe None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:50.270745 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c63d3f-e4dd-4391-93a2-8f2c60516cbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:50.272633 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c63d3f-e4dd-4391-93a2-8f2c60516cbe None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:50.299032 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 292/591] 10.222.0.49 () {56 vars in 1137 bytes} [Wed Aug 24 04:36:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:50.299032 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c63d3f-e4dd-4391-93a2-8f2c60516cbe None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:50.301094 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:50.344226 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22361c4b-d0fe-4280-a9fe-257b33f1f2e3 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:50.377620 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b6e4d-627f-4d92-9740-ac05db08a501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:50.378187 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b6e4d-627f-4d92-9740-ac05db08a501 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:50.378469 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b6e4d-627f-4d92-9740-ac05db08a501 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:50.378733 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b6e4d-627f-4d92-9740-ac05db08a501 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:50.385396 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b6e4d-627f-4d92-9740-ac05db08a501 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:50.386881 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b6e4d-627f-4d92-9740-ac05db08a501 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:50.397822 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-ef8b6e4d-627f-4d92-9740-ac05db08a501 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:50.397822 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:50.397822 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:50.397822 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:50.397822 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:50.397822 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:50.397822 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:50.397822 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:50.397822 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:50.397822 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:50.397822 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:50.397822 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:50.397822 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:36:50.397822 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:36:50.397822 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:36:50.398716 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:36:50.398716 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:50.398716 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:50.398716 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:50.398716 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:50.398716 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:50.398716 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:50.398716 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:50.398716 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:50.398716 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:50.398716 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:50.398716 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:50.398716 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:50.398716 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:50.398716 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:50.398716 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:50.398716 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:50.399579 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:36:50.399579 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:36:50.399579 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:36:50.399579 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:36:50.399579 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:36:50.399579 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:36:50.399579 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:50.399579 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:50.399579 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 300/592] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:50.400090 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b6e4d-627f-4d92-9740-ac05db08a501 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:50.406903 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:50.411983 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c63d3f-e4dd-4391-93a2-8f2c60516cbe None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:50.462493 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e9d04-ef1d-413f-862f-5bc70a95486d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:50.463163 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e9d04-ef1d-413f-862f-5bc70a95486d None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:50.463442 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e9d04-ef1d-413f-862f-5bc70a95486d None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:50.463693 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e9d04-ef1d-413f-862f-5bc70a95486d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:50.471793 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e9d04-ef1d-413f-862f-5bc70a95486d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:50.473260 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e9d04-ef1d-413f-862f-5bc70a95486d None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:50.486504 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-727e9d04-ef1d-413f-862f-5bc70a95486d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 04:36:50.486504 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:50.486504 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:50.486504 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:50.486504 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:50.486504 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:50.486504 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:50.486504 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:50.486504 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:50.486504 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:50.486504 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:50.486504 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:50.486504 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:36:50.486504 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:36:50.486504 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:36:50.486504 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:36:50.487838 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:50.487838 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:50.487838 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:36:50.487838 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:50.487838 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:36:50.487838 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:50.487838 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:50.487838 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:50.487838 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:50.487838 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:50.487838 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:50.487838 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:50.487838 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:50.487838 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:50.487838 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:50.487838 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:50.487838 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:50.487838 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:50.488989 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:50.488989 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:50.488989 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:36:50.488989 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:36:50.488989 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:36:50.488989 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:36:50.488989 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:36:50.488989 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:36:50.488989 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 04:36:50.488989 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:50.492635 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 293/593] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 24 04:36:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:50.493545 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e9d04-ef1d-413f-862f-5bc70a95486d None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:50.528016 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b6e4d-627f-4d92-9740-ac05db08a501 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:50.553444 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:50.570098 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4be6b-44a6-459d-89bd-b533658f0e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:50.571073 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4be6b-44a6-459d-89bd-b533658f0e88 None admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:50.571347 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4be6b-44a6-459d-89bd-b533658f0e88 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:50.571612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4be6b-44a6-459d-89bd-b533658f0e88 None admin] PATH_INFO: `/v3/projects/08755f450e6c47dcaaaa754a6aa2ec62/users/9dc9a3cf381e4a2da36ed82b407a2d94/roles/d62916d0c54540b3859985d5d3565718` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:50.587768 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4be6b-44a6-459d-89bd-b533658f0e88 None admin] RBAC: Authorizing `identity:create_grant(project_id=08755f450e6c47dcaaaa754a6aa2ec62, user_id=9dc9a3cf381e4a2da36ed82b407a2d94, role_id=d62916d0c54540b3859985d5d3565718)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:50.589481 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df4be6b-44a6-459d-89bd-b533658f0e88 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:50.604575 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 301/594] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 24 04:36:50 2022] PUT /identity/v3/projects/08755f450e6c47dcaaaa754a6aa2ec62/users/9dc9a3cf381e4a2da36ed82b407a2d94/roles/d62916d0c54540b3859985d5d3565718 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:36:50.605567 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4be6b-44a6-459d-89bd-b533658f0e88 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:50.622914 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e9d04-ef1d-413f-862f-5bc70a95486d None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:50.680846 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27ad81-bbbe-433a-9009-aba6755c405d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:50.682150 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27ad81-bbbe-433a-9009-aba6755c405d None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:50.683160 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27ad81-bbbe-433a-9009-aba6755c405d None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:50.683693 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27ad81-bbbe-433a-9009-aba6755c405d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:50.702490 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be27ad81-bbbe-433a-9009-aba6755c405d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:50.704645 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be27ad81-bbbe-433a-9009-aba6755c405d None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:50.726511 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-be27ad81-bbbe-433a-9009-aba6755c405d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:50.726511 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:50.726511 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:50.726511 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:50.726511 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:50.726511 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:50.726511 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:50.726511 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:50.726511 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:50.726511 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:50.726511 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:50.726511 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:50.726511 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:50.726511 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:50.726511 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:50.726511 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:50.727730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:50.727730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:50.727730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:50.727730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:50.727730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:50.727730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:50.727730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:50.727730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:50.727730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:50.727730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:50.727730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:50.727730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:50.727730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:50.727730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:50.727730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:50.727730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:50.727730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:50.728794 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:50.728794 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:50.728794 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:50.729497 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4be6b-44a6-459d-89bd-b533658f0e88 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:50.730812 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 294/595] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:50.732235 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27ad81-bbbe-433a-9009-aba6755c405d None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:50.753006 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:50.779162 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e148a-8c0a-4c99-9297-7fc81371b0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:50.779982 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e148a-8c0a-4c99-9297-7fc81371b0e2 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:50.780373 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e148a-8c0a-4c99-9297-7fc81371b0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:50.780757 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e148a-8c0a-4c99-9297-7fc81371b0e2 None admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:50.781678 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e148a-8c0a-4c99-9297-7fc81371b0e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:50.782077 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e148a-8c0a-4c99-9297-7fc81371b0e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:50.783615 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e148a-8c0a-4c99-9297-7fc81371b0e2 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:50.796965 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 302/596] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 24 04:36:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:50.798012 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e148a-8c0a-4c99-9297-7fc81371b0e2 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:50.832980 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:50.866949 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27ad81-bbbe-433a-9009-aba6755c405d None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:50.912700 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e148a-8c0a-4c99-9297-7fc81371b0e2 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:50.917062 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98d6e9-82b0-49c0-84ef-2649992d1992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:50.918274 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98d6e9-82b0-49c0-84ef-2649992d1992 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:50.918701 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98d6e9-82b0-49c0-84ef-2649992d1992 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:50.919117 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98d6e9-82b0-49c0-84ef-2649992d1992 None admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:50.920035 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98d6e9-82b0-49c0-84ef-2649992d1992 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:50.920502 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98d6e9-82b0-49c0-84ef-2649992d1992 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:50.922769 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98d6e9-82b0-49c0-84ef-2649992d1992 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:50.952084 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 295/597] 10.222.0.49 () {56 vars in 1139 bytes} [Wed Aug 24 04:36:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:50.953504 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98d6e9-82b0-49c0-84ef-2649992d1992 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:50.971399 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a493ef-a472-4b49-8209-39e5af7ff688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:50.972514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a493ef-a472-4b49-8209-39e5af7ff688 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:50.973081 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a493ef-a472-4b49-8209-39e5af7ff688 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:50.973522 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a493ef-a472-4b49-8209-39e5af7ff688 None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:50.974306 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a493ef-a472-4b49-8209-39e5af7ff688 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:50.974876 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a493ef-a472-4b49-8209-39e5af7ff688 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:50.976220 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a493ef-a472-4b49-8209-39e5af7ff688 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:50.992072 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 303/598] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:50.993231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a493ef-a472-4b49-8209-39e5af7ff688 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:51.050104 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:51.121737 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:51.122379 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98d6e9-82b0-49c0-84ef-2649992d1992 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:51.139263 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a493ef-a472-4b49-8209-39e5af7ff688 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:51.173523 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e638fe-2d26-4f79-adc5-342401552a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:51.173523 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e638fe-2d26-4f79-adc5-342401552a07 None admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:51.173993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e638fe-2d26-4f79-adc5-342401552a07 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:51.174506 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e638fe-2d26-4f79-adc5-342401552a07 None admin] PATH_INFO: `/v3/projects/08755f450e6c47dcaaaa754a6aa2ec62/users/2a957fc61ff14c35aac0b577c3c1baf5/roles/d62916d0c54540b3859985d5d3565718` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:51.191661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e638fe-2d26-4f79-adc5-342401552a07 None admin] RBAC: Authorizing `identity:create_grant(project_id=08755f450e6c47dcaaaa754a6aa2ec62, user_id=2a957fc61ff14c35aac0b577c3c1baf5, role_id=d62916d0c54540b3859985d5d3565718)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:51.193126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e638fe-2d26-4f79-adc5-342401552a07 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:51.200706 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818a5a2-6d6d-4792-8e43-c1e2753cbed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:51.203172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818a5a2-6d6d-4792-8e43-c1e2753cbed9 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:51.203172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818a5a2-6d6d-4792-8e43-c1e2753cbed9 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:51.203172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818a5a2-6d6d-4792-8e43-c1e2753cbed9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:51.216322 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818a5a2-6d6d-4792-8e43-c1e2753cbed9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:51.217027 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 296/599] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 24 04:36:50 2022] PUT /identity/v3/projects/08755f450e6c47dcaaaa754a6aa2ec62/users/2a957fc61ff14c35aac0b577c3c1baf5/roles/d62916d0c54540b3859985d5d3565718 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:36:51.217912 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818a5a2-6d6d-4792-8e43-c1e2753cbed9 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:51.218408 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e638fe-2d26-4f79-adc5-342401552a07 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:51.242818 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-a818a5a2-6d6d-4792-8e43-c1e2753cbed9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:51.242818 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:51.242818 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:51.242818 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:51.242818 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:51.242818 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:51.242818 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:51.242818 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:51.242818 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:51.242818 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:51.242818 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:51.242818 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:51.242818 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:51.242818 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:51.242818 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:51.242818 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:51.243887 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:51.243887 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:51.243887 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:51.243887 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:51.243887 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:51.243887 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:51.243887 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:51.243887 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:51.243887 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:51.243887 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:51.243887 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:51.243887 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:51.243887 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:51.243887 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:51.243887 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:51.243887 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:51.243887 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:51.244757 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:51.244757 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:51.244757 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:51.249623 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 304/600] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:51.251225 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402e2ad-db5e-4b6c-b9c5-a00d0423cd78 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:51.251587 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402e2ad-db5e-4b6c-b9c5-a00d0423cd78 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:51.251938 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402e2ad-db5e-4b6c-b9c5-a00d0423cd78 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:51.254131 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 305/601] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:51.255071 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402e2ad-db5e-4b6c-b9c5-a00d0423cd78 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:51.377491 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e638fe-2d26-4f79-adc5-342401552a07 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:51.397933 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402e2ad-db5e-4b6c-b9c5-a00d0423cd78 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:51.399631 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:51.422616 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b52dc-987b-4039-8f77-e074467b22ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:51.423307 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b52dc-987b-4039-8f77-e074467b22ed None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:51.423588 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b52dc-987b-4039-8f77-e074467b22ed None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:51.423859 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b52dc-987b-4039-8f77-e074467b22ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:51.431605 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b52dc-987b-4039-8f77-e074467b22ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:51.433085 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b52dc-987b-4039-8f77-e074467b22ed None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:51.445195 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-876b52dc-987b-4039-8f77-e074467b22ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:51.445195 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:51.445195 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:51.445195 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:51.445195 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:51.445195 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:51.445195 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:51.445195 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:51.445195 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:51.445195 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:51.445195 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:51.445195 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:51.445195 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:36:51.445195 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:36:51.445195 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:36:51.446386 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:36:51.446386 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:51.446386 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:51.446386 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:51.446386 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:51.446386 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:51.446386 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:51.446386 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:51.446386 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:51.446386 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:51.446386 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:51.446386 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:51.446386 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:51.446386 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:51.446386 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:51.446386 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:51.446386 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:51.447449 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:36:51.447449 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:36:51.447449 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:36:51.447449 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:36:51.447449 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:36:51.447449 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:36:51.447449 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:51.447449 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:51.447449 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 297/602] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:51.447927 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f76247-5f1e-492b-9f70-9a281e5672ee None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:51.447927 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f76247-5f1e-492b-9f70-9a281e5672ee None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:51.449360 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f76247-5f1e-492b-9f70-9a281e5672ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:51.451249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77f27d-4e4a-4ee0-afe6-2e0ed1c5b0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:51.452104 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77f27d-4e4a-4ee0-afe6-2e0ed1c5b0fe None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:51.452385 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77f27d-4e4a-4ee0-afe6-2e0ed1c5b0fe None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:51.452659 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77f27d-4e4a-4ee0-afe6-2e0ed1c5b0fe None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:51.453794 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f77f27d-4e4a-4ee0-afe6-2e0ed1c5b0fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:51.454055 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f77f27d-4e4a-4ee0-afe6-2e0ed1c5b0fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:51.455851 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f77f27d-4e4a-4ee0-afe6-2e0ed1c5b0fe None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:51.467603 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-73f76247-5f1e-492b-9f70-9a281e5672ee None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:51.468922 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-73f76247-5f1e-492b-9f70-9a281e5672ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:51.471007 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 306/603] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:51.473613 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77f27d-4e4a-4ee0-afe6-2e0ed1c5b0fe None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:51.486906 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:51.561488 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 298/604] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:51.562599 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f76247-5f1e-492b-9f70-9a281e5672ee None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:51.615570 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77f27d-4e4a-4ee0-afe6-2e0ed1c5b0fe None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:51.671059 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc691de2-66f6-4f7e-ab84-91a621be8026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:51.672050 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc691de2-66f6-4f7e-ab84-91a621be8026 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:51.672332 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc691de2-66f6-4f7e-ab84-91a621be8026 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:51.672617 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc691de2-66f6-4f7e-ab84-91a621be8026 None admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:51.673382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc691de2-66f6-4f7e-ab84-91a621be8026 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:51.673698 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc691de2-66f6-4f7e-ab84-91a621be8026 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:51.675223 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc691de2-66f6-4f7e-ab84-91a621be8026 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:51.700724 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 307/605] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 24 04:36:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:51.706890 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc691de2-66f6-4f7e-ab84-91a621be8026 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:51.763505 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f76247-5f1e-492b-9f70-9a281e5672ee None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:51.775805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:51.806266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bc20d-96c4-4dfb-9995-89cd1b1f775d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:51.806969 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bc20d-96c4-4dfb-9995-89cd1b1f775d None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:51.807248 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bc20d-96c4-4dfb-9995-89cd1b1f775d None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:51.807524 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bc20d-96c4-4dfb-9995-89cd1b1f775d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:51.816845 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362bc20d-96c4-4dfb-9995-89cd1b1f775d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:51.819348 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362bc20d-96c4-4dfb-9995-89cd1b1f775d None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:51.836468 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-362bc20d-96c4-4dfb-9995-89cd1b1f775d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:51.836468 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:51.836468 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:51.836468 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:51.836468 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:51.836468 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:51.836468 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:51.836468 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:51.836468 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:51.836468 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:51.836468 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:51.836468 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:51.836468 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:36:51.836468 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:36:51.836468 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:36:51.837432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:36:51.837432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:51.837432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:51.837432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:51.837432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:51.837432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:51.837432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:51.837432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:51.837432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:51.837432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:51.837432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:51.837432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:51.837432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:51.837432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:51.837432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:51.837432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:51.837432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:51.838298 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:36:51.838298 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:36:51.838298 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:36:51.838298 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:36:51.838298 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:36:51.838298 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:36:51.838298 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:51.838298 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:51.838298 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 299/606] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:51.846599 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bc20d-96c4-4dfb-9995-89cd1b1f775d None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:51.857114 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:51.916286 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc691de2-66f6-4f7e-ab84-91a621be8026 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:51.957544 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1459de-78cc-486d-814f-b81313db2f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:51.958634 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1459de-78cc-486d-814f-b81313db2f15 None admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:51.959110 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1459de-78cc-486d-814f-b81313db2f15 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:51.959576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1459de-78cc-486d-814f-b81313db2f15 None admin] PATH_INFO: `/v3/projects/08755f450e6c47dcaaaa754a6aa2ec62/users/2be44ea93247420d994e24912a9ac32e/roles/d62916d0c54540b3859985d5d3565718` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:51.977735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1459de-78cc-486d-814f-b81313db2f15 None admin] RBAC: Authorizing `identity:create_grant(project_id=08755f450e6c47dcaaaa754a6aa2ec62, user_id=2be44ea93247420d994e24912a9ac32e, role_id=d62916d0c54540b3859985d5d3565718)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:51.979553 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1459de-78cc-486d-814f-b81313db2f15 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:51.980101 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bc20d-96c4-4dfb-9995-89cd1b1f775d None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:52.005502 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 308/607] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 24 04:36:51 2022] PUT /identity/v3/projects/08755f450e6c47dcaaaa754a6aa2ec62/users/2be44ea93247420d994e24912a9ac32e/roles/d62916d0c54540b3859985d5d3565718 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:36:52.006377 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1459de-78cc-486d-814f-b81313db2f15 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:52.026886 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c6f5c-279f-4190-a5e7-96c8c7659c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:52.028338 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c6f5c-279f-4190-a5e7-96c8c7659c90 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:52.028912 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c6f5c-279f-4190-a5e7-96c8c7659c90 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:52.029428 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c6f5c-279f-4190-a5e7-96c8c7659c90 None admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:52.031284 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c6f5c-279f-4190-a5e7-96c8c7659c90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:52.031930 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c6f5c-279f-4190-a5e7-96c8c7659c90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:52.034623 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c6f5c-279f-4190-a5e7-96c8c7659c90 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:52.052521 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 300/608] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 24 04:36:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:36:52.058863 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c6f5c-279f-4190-a5e7-96c8c7659c90 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:52.099379 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:52.187854 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1459de-78cc-486d-814f-b81313db2f15 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:52.226046 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:52.265361 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c6f5c-279f-4190-a5e7-96c8c7659c90 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:52.282104 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3ba23-21c1-4009-8c98-f9c8567ae3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:52.283023 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3ba23-21c1-4009-8c98-f9c8567ae3af None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:52.283439 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3ba23-21c1-4009-8c98-f9c8567ae3af None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:52.283869 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3ba23-21c1-4009-8c98-f9c8567ae3af None admin] PATH_INFO: `/v3/roles/service` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:52.297909 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a3ba23-21c1-4009-8c98-f9c8567ae3af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:52.304576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-92a3ba23-21c1-4009-8c98-f9c8567ae3af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:36:52.304576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:52.304576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:52.304576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:52.304576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:52.304576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:52.304576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:52.304576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:52.304576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:52.304576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:52.304576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:52.304576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:52.304576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:52.304576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:52.304576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:52.304576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:52.305894 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:52.305894 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:52.305894 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:52.305894 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:52.305894 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:52.305894 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:52.305894 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:52.305894 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:52.305894 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:52.305894 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:52.305894 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:52.305894 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:52.305894 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:52.305894 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:52.305894 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:52.305894 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:52.307390 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:52.307390 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:52.307390 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:52.307390 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:52.307390 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:52.307390 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:52.307390 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:52.307390 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:52.307390 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:52.307390 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:52.307390 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:36:52.307390 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:52.309904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 309/609] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 24 04:36:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:52.321987 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3ba23-21c1-4009-8c98-f9c8567ae3af None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:52.331422 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b33556-4e9c-47bc-a5dd-551b17f78cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:52.332381 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b33556-4e9c-47bc-a5dd-551b17f78cfd None admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:52.332811 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b33556-4e9c-47bc-a5dd-551b17f78cfd None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:52.333219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b33556-4e9c-47bc-a5dd-551b17f78cfd None admin] PATH_INFO: `/v3/projects/08755f450e6c47dcaaaa754a6aa2ec62/users/087c0311906a4987b294729706a08810/roles/d62916d0c54540b3859985d5d3565718` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:52.355117 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b33556-4e9c-47bc-a5dd-551b17f78cfd None admin] RBAC: Authorizing `identity:create_grant(project_id=08755f450e6c47dcaaaa754a6aa2ec62, user_id=087c0311906a4987b294729706a08810, role_id=d62916d0c54540b3859985d5d3565718)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:52.357450 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b33556-4e9c-47bc-a5dd-551b17f78cfd None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:52.395686 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 301/610] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 24 04:36:52 2022] PUT /identity/v3/projects/08755f450e6c47dcaaaa754a6aa2ec62/users/087c0311906a4987b294729706a08810/roles/d62916d0c54540b3859985d5d3565718 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:36:52.466371 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a3ba23-21c1-4009-8c98-f9c8567ae3af None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:52.513139 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75897b9d-bd3d-4aae-b6ba-620ae5ae35ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:52.513719 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75897b9d-bd3d-4aae-b6ba-620ae5ae35ff None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:52.513995 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75897b9d-bd3d-4aae-b6ba-620ae5ae35ff None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:52.514261 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75897b9d-bd3d-4aae-b6ba-620ae5ae35ff None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:52.514960 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75897b9d-bd3d-4aae-b6ba-620ae5ae35ff None admin] RBAC: Adding query filter params (name=service) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:52.515266 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75897b9d-bd3d-4aae-b6ba-620ae5ae35ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:52.516752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75897b9d-bd3d-4aae-b6ba-620ae5ae35ff None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:52.532260 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 310/611] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 24 04:36:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:52.538728 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b33556-4e9c-47bc-a5dd-551b17f78cfd None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:52.675207 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:52.704905 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b33556-4e9c-47bc-a5dd-551b17f78cfd None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:52.746085 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2ade9-cfc5-4b34-a861-af5fbde5f935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:52.746730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2ade9-cfc5-4b34-a861-af5fbde5f935 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:52.747006 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2ade9-cfc5-4b34-a861-af5fbde5f935 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:52.747274 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2ade9-cfc5-4b34-a861-af5fbde5f935 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:52.759205 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb2ade9-cfc5-4b34-a861-af5fbde5f935 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:52.760674 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb2ade9-cfc5-4b34-a861-af5fbde5f935 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:52.784061 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-adb2ade9-cfc5-4b34-a861-af5fbde5f935 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:52.784061 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:52.784061 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:52.784061 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:52.784061 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:52.784061 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:52.784061 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:52.784061 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:52.784061 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:52.784061 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:52.784061 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:52.784061 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:52.784061 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:52.784061 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:52.784061 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:52.784061 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:52.785202 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:52.785202 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:52.785202 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:52.785202 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:52.785202 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:52.785202 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:52.785202 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:52.785202 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:52.785202 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:52.785202 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:52.785202 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:52.785202 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:52.785202 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:52.785202 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:52.785202 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:52.785202 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:52.785202 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:52.786280 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:52.786280 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:52.786280 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:52.786280 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 302/612] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:52.792173 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75897b9d-bd3d-4aae-b6ba-620ae5ae35ff None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:52.839129 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:52.929037 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75897b9d-bd3d-4aae-b6ba-620ae5ae35ff None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:52.947063 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cccb62a-db1a-4509-9c52-633a0f184f19 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:52.947346 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cccb62a-db1a-4509-9c52-633a0f184f19 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:52.947623 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cccb62a-db1a-4509-9c52-633a0f184f19 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:52.949186 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 303/613] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:36:52.954486 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59af8b5-0872-4a32-8391-0fad16baab52 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:52.954765 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59af8b5-0872-4a32-8391-0fad16baab52 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:52.955029 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59af8b5-0872-4a32-8391-0fad16baab52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:52.982187 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-c59af8b5-0872-4a32-8391-0fad16baab52 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:52.984927 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-c59af8b5-0872-4a32-8391-0fad16baab52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:52.985797 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cae567-78fb-465a-a8f1-4ed1e3bf0d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:52.986740 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cae567-78fb-465a-a8f1-4ed1e3bf0d55 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:52.987161 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cae567-78fb-465a-a8f1-4ed1e3bf0d55 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:52.987578 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cae567-78fb-465a-a8f1-4ed1e3bf0d55 None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:52.988413 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cae567-78fb-465a-a8f1-4ed1e3bf0d55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:52.988859 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cae567-78fb-465a-a8f1-4ed1e3bf0d55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:52.990415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cae567-78fb-465a-a8f1-4ed1e3bf0d55 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:53.015441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 311/614] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:53.021138 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cae567-78fb-465a-a8f1-4ed1e3bf0d55 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:53.078357 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 304/615] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:36:53.173643 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:53.179857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cae567-78fb-465a-a8f1-4ed1e3bf0d55 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:53.226840 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec76f8-ce0f-444f-b8a1-2812eed35158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:53.227477 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec76f8-ce0f-444f-b8a1-2812eed35158 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:53.227751 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec76f8-ce0f-444f-b8a1-2812eed35158 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:53.228016 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec76f8-ce0f-444f-b8a1-2812eed35158 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:53.240371 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec76f8-ce0f-444f-b8a1-2812eed35158 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:53.241865 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec76f8-ce0f-444f-b8a1-2812eed35158 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:53.258572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-50ec76f8-ce0f-444f-b8a1-2812eed35158 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:36:53.258572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:53.258572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:53.258572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:53.258572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:53.258572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:53.258572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:53.258572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:53.258572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:53.258572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:53.258572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:53.258572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:53.258572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:36:53.258572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:36:53.258572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:36:53.258572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:36:53.259767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:53.259767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:53.259767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:36:53.259767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:53.259767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:36:53.259767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:53.259767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:53.259767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:53.259767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:53.259767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:53.259767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:53.259767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:53.259767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:53.259767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:53.259767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:53.259767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:53.259767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:53.259767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:53.260926 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:53.260926 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:53.260926 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:36:53.260926 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:36:53.260926 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:36:53.260926 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:36:53.260926 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:36:53.260926 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:36:53.260926 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:36:53.260926 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:53.260926 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 312/616] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 24 04:36:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:53.267396 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59af8b5-0872-4a32-8391-0fad16baab52 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:53.359345 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:53.386485 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec76f8-ce0f-444f-b8a1-2812eed35158 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:53.410943 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59af8b5-0872-4a32-8391-0fad16baab52 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:53.450609 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb38d2-f732-459b-a481-858c8ddd34ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:53.451408 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb38d2-f732-459b-a481-858c8ddd34ce None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:53.451794 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb38d2-f732-459b-a481-858c8ddd34ce None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:53.452363 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb38d2-f732-459b-a481-858c8ddd34ce None admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:53.453901 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb38d2-f732-459b-a481-858c8ddd34ce None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:53.454212 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb38d2-f732-459b-a481-858c8ddd34ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:53.455721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb38d2-f732-459b-a481-858c8ddd34ce None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:53.480477 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 305/617] 10.222.0.49 () {56 vars in 1135 bytes} [Wed Aug 24 04:36:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:53.480477 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbd594-638b-4b02-8332-a87419a55b51 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:53.480477 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbd594-638b-4b02-8332-a87419a55b51 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:53.480477 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbd594-638b-4b02-8332-a87419a55b51 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:53.480477 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 306/618] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:53.486693 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad03ba-5ce7-47f0-82a2-ac2e9e7de73e None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:53.486974 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad03ba-5ce7-47f0-82a2-ac2e9e7de73e None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:53.487244 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad03ba-5ce7-47f0-82a2-ac2e9e7de73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:53.510512 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-8cad03ba-5ce7-47f0-82a2-ac2e9e7de73e None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:53.511774 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-8cad03ba-5ce7-47f0-82a2-ac2e9e7de73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:53.545602 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec76f8-ce0f-444f-b8a1-2812eed35158 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:53.590195 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca058fd-0363-4ec4-83a6-18def52e4049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:53.591261 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca058fd-0363-4ec4-83a6-18def52e4049 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:53.591674 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca058fd-0363-4ec4-83a6-18def52e4049 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:53.592076 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca058fd-0363-4ec4-83a6-18def52e4049 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:53.601463 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 307/619] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:53.602401 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad03ba-5ce7-47f0-82a2-ac2e9e7de73e None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:53.612277 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca058fd-0363-4ec4-83a6-18def52e4049 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:53.625226 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-1ca058fd-0363-4ec4-83a6-18def52e4049 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:36:53.625226 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:53.625226 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:53.625226 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:53.625226 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:53.625226 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:53.625226 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:53.625226 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:53.625226 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:53.625226 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:53.625226 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:53.625226 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:53.625226 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:53.625226 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:53.625226 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:53.625226 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:53.626165 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:53.626165 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:53.626165 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:53.626165 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:53.626165 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:53.626165 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:53.626165 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:53.626165 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:53.626165 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:53.626165 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:53.626165 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:53.626165 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:53.626165 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:53.626165 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:53.626165 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:53.626165 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:53.627137 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:53.627137 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:53.627137 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:53.627137 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:53.627137 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:53.627137 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:53.627137 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:53.627137 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:53.627137 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:53.627137 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:53.627137 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:36:53.627137 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:53.633045 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 313/620] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 24 04:36:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:36:53.633998 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca058fd-0363-4ec4-83a6-18def52e4049 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:53.671073 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:53.708637 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:53.774478 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad03ba-5ce7-47f0-82a2-ac2e9e7de73e None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:53.811174 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368a655-977c-4920-9d1a-efb2c924cb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:53.811836 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368a655-977c-4920-9d1a-efb2c924cb1c None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:53.812114 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368a655-977c-4920-9d1a-efb2c924cb1c None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:53.812386 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368a655-977c-4920-9d1a-efb2c924cb1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:53.823161 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368a655-977c-4920-9d1a-efb2c924cb1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:53.824650 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368a655-977c-4920-9d1a-efb2c924cb1c None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:53.839727 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-e368a655-977c-4920-9d1a-efb2c924cb1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:53.839727 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:53.839727 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:53.839727 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:53.839727 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:53.839727 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:53.839727 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:53.839727 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:53.839727 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:53.839727 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:53.839727 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:53.839727 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:53.839727 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:53.839727 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:53.839727 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:53.839727 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:53.840858 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:53.840858 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:53.840858 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:53.840858 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:53.840858 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:53.840858 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:53.840858 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:53.840858 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:53.840858 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:53.840858 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:53.840858 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:53.840858 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:53.840858 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:53.840858 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:53.840858 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:53.840858 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:53.840858 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:53.842167 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:53.842167 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:53.842167 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:53.842167 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 308/621] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:53.848320 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368a655-977c-4920-9d1a-efb2c924cb1c None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:53.860217 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca058fd-0363-4ec4-83a6-18def52e4049 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:53.936669 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbf212-8681-4bd1-ae96-f9c2f8be772d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:53.937496 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbf212-8681-4bd1-ae96-f9c2f8be772d None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:53.938010 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbf212-8681-4bd1-ae96-f9c2f8be772d None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:53.938285 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbf212-8681-4bd1-ae96-f9c2f8be772d None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:53.938971 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fbf212-8681-4bd1-ae96-f9c2f8be772d None admin] RBAC: Adding query filter params (name=service) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:53.939349 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fbf212-8681-4bd1-ae96-f9c2f8be772d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:53.940776 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fbf212-8681-4bd1-ae96-f9c2f8be772d None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:53.950568 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:53.952773 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 314/622] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 24 04:36:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:53.953651 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbf212-8681-4bd1-ae96-f9c2f8be772d None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:53.958300 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368a655-977c-4920-9d1a-efb2c924cb1c None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:53.995225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb02f9-edd3-4920-b231-f239e775537f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:53.996158 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb02f9-edd3-4920-b231-f239e775537f None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:53.996630 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb02f9-edd3-4920-b231-f239e775537f None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:53.996963 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb02f9-edd3-4920-b231-f239e775537f None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:53.997779 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb02f9-edd3-4920-b231-f239e775537f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:53.998144 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb02f9-edd3-4920-b231-f239e775537f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:53.999598 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb02f9-edd3-4920-b231-f239e775537f None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:54.013295 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 309/623] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:54.014266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb02f9-edd3-4920-b231-f239e775537f None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:54.052458 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:54.082835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbf212-8681-4bd1-ae96-f9c2f8be772d None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:54.128510 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65966a-2c34-4cb8-a150-ab5dc2fbcb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:54.135467 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65966a-2c34-4cb8-a150-ab5dc2fbcb26 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:54.135860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65966a-2c34-4cb8-a150-ab5dc2fbcb26 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:54.136154 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65966a-2c34-4cb8-a150-ab5dc2fbcb26 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:54.150961 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb02f9-edd3-4920-b231-f239e775537f None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:54.156589 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65966a-2c34-4cb8-a150-ab5dc2fbcb26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:54.161913 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-3a65966a-2c34-4cb8-a150-ab5dc2fbcb26 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:36:54.161913 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:54.161913 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:54.161913 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:54.161913 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:54.161913 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:54.161913 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:54.161913 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:54.161913 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:54.161913 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:54.161913 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:54.161913 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:54.161913 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:54.161913 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:54.161913 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:54.161913 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:54.163030 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:54.163030 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:54.163030 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:54.163030 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:54.163030 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:54.163030 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:54.163030 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:54.163030 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:54.163030 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:54.163030 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:54.163030 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:54.163030 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:54.163030 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:54.163030 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:54.163030 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:54.163030 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:54.163994 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:54.163994 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:54.163994 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:54.163994 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:54.163994 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:54.163994 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:54.163994 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:54.163994 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:54.163994 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:54.163994 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:54.163994 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:36:54.163994 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:54.173453 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 315/624] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 24 04:36:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:54.174503 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65966a-2c34-4cb8-a150-ab5dc2fbcb26 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:54.221727 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb903ec9-d2ae-4f15-a7eb-aded2728d830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:54.222014 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb903ec9-d2ae-4f15-a7eb-aded2728d830 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:54.222291 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb903ec9-d2ae-4f15-a7eb-aded2728d830 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:54.222601 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb903ec9-d2ae-4f15-a7eb-aded2728d830 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:54.241277 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb903ec9-d2ae-4f15-a7eb-aded2728d830 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:54.243150 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb903ec9-d2ae-4f15-a7eb-aded2728d830 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:54.261043 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-eb903ec9-d2ae-4f15-a7eb-aded2728d830 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:54.261043 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:54.261043 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:54.261043 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:54.261043 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:54.261043 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:54.261043 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:54.261043 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:54.261043 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:54.261043 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:54.261043 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:54.261043 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:54.261043 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:54.261043 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:54.261043 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:54.261043 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:54.263019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:54.263019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:54.263019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:54.263019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:54.263019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:54.263019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:54.263019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:54.263019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:54.263019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:54.263019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:54.263019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:54.263019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:54.263019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:54.263019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:54.263019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:54.263019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:54.263019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:54.264805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:54.264805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:54.264805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:54.269078 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 310/625] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:54.270027 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb903ec9-d2ae-4f15-a7eb-aded2728d830 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:54.295306 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:54.396500 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65966a-2c34-4cb8-a150-ab5dc2fbcb26 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:54.428701 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb903ec9-d2ae-4f15-a7eb-aded2728d830 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:54.469396 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9fdaa-41b5-42d5-95b1-115e6d793b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:54.470016 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff088288-f51a-419c-b976-3a996bb9ce10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:54.470877 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff088288-f51a-419c-b976-3a996bb9ce10 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:54.471088 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9fdaa-41b5-42d5-95b1-115e6d793b42 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:54.471555 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9fdaa-41b5-42d5-95b1-115e6d793b42 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:54.471848 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff088288-f51a-419c-b976-3a996bb9ce10 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:54.472076 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9fdaa-41b5-42d5-95b1-115e6d793b42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:54.472598 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff088288-f51a-419c-b976-3a996bb9ce10 None admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:54.473578 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff088288-f51a-419c-b976-3a996bb9ce10 None admin] RBAC: Adding query filter params (name=service) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:54.474090 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff088288-f51a-419c-b976-3a996bb9ce10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:54.475674 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff088288-f51a-419c-b976-3a996bb9ce10 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:54.489805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 311/626] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 24 04:36:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:54.490014 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d9fdaa-41b5-42d5-95b1-115e6d793b42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:54.491384 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff088288-f51a-419c-b976-3a996bb9ce10 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:54.491502 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d9fdaa-41b5-42d5-95b1-115e6d793b42 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:54.510316 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:54.522705 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-25d9fdaa-41b5-42d5-95b1-115e6d793b42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:54.522705 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:54.522705 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:54.522705 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:54.522705 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:54.522705 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:54.522705 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:54.522705 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:54.522705 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:54.522705 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:54.522705 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:54.522705 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:54.522705 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:36:54.522705 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:36:54.522705 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:36:54.523709 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:36:54.523709 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:54.523709 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:54.523709 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:54.523709 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:54.523709 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:54.523709 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:54.523709 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:54.523709 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:54.523709 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:54.523709 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:54.523709 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:54.523709 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:54.523709 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:54.523709 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:54.523709 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:54.523709 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:54.524628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:36:54.524628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:36:54.524628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:36:54.524628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:36:54.524628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:36:54.524628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:36:54.524628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:54.524628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:54.524628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 316/627] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:54.525875 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a2fb7-11b0-4bf4-b564-0529f3fbadfa None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:54.525875 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a2fb7-11b0-4bf4-b564-0529f3fbadfa None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:54.526010 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a2fb7-11b0-4bf4-b564-0529f3fbadfa None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:54.529457 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 317/628] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:54.529457 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a2fb7-11b0-4bf4-b564-0529f3fbadfa None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:54.591096 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:54.647328 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff088288-f51a-419c-b976-3a996bb9ce10 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:54.669979 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a2fb7-11b0-4bf4-b564-0529f3fbadfa None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:54.699205 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fc043-e06a-448f-958f-ab63ac09e889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:54.699938 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fc043-e06a-448f-958f-ab63ac09e889 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:54.700220 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fc043-e06a-448f-958f-ab63ac09e889 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:54.700612 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fc043-e06a-448f-958f-ab63ac09e889 None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:54.701284 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2fc043-e06a-448f-958f-ab63ac09e889 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:54.701619 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2fc043-e06a-448f-958f-ab63ac09e889 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:54.703107 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2fc043-e06a-448f-958f-ab63ac09e889 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:54.722350 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 312/629] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:54.723234 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fc043-e06a-448f-958f-ab63ac09e889 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:54.760902 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57d6e5d-0b57-497d-8e1d-3ac2d9c8956f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:54.762763 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d6e5d-0b57-497d-8e1d-3ac2d9c8956f None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:54.763310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d6e5d-0b57-497d-8e1d-3ac2d9c8956f None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:54.763916 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57d6e5d-0b57-497d-8e1d-3ac2d9c8956f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:54.785619 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d6e5d-0b57-497d-8e1d-3ac2d9c8956f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:54.789654 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57d6e5d-0b57-497d-8e1d-3ac2d9c8956f None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:54.816384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-e57d6e5d-0b57-497d-8e1d-3ac2d9c8956f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:54.816384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:54.816384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:54.816384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:54.816384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:54.816384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:54.816384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:54.816384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:54.816384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:54.816384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:54.816384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:54.816384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:54.816384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:54.816384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:54.816384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:54.816384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:54.817470 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:54.817470 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:54.817470 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:54.817470 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:54.817470 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:54.817470 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:54.817470 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:54.817470 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:54.817470 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:54.817470 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:54.817470 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:54.817470 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:54.817470 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:54.817470 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:54.817470 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:54.817470 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:54.817470 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:54.818367 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:54.818367 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:54.818367 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:54.821494 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 318/630] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:54.824105 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f09872-919b-424e-bee9-0025413c617e None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:54.824446 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f09872-919b-424e-bee9-0025413c617e None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:54.824812 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f09872-919b-424e-bee9-0025413c617e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:54.849427 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-a7f09872-919b-424e-bee9-0025413c617e None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:54.851090 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-a7f09872-919b-424e-bee9-0025413c617e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:54.867805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fc043-e06a-448f-958f-ab63ac09e889 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:54.912225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87de44-03d5-4b6e-ac99-212751b1b1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:54.913217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87de44-03d5-4b6e-ac99-212751b1b1b7 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:54.913525 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87de44-03d5-4b6e-ac99-212751b1b1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:54.913794 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e87de44-03d5-4b6e-ac99-212751b1b1b7 None admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:54.914873 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e87de44-03d5-4b6e-ac99-212751b1b1b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:54.915362 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e87de44-03d5-4b6e-ac99-212751b1b1b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:54.916802 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e87de44-03d5-4b6e-ac99-212751b1b1b7 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:54.917260 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:54.918462 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:54.935270 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 313/631] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 24 04:36:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:54.936213 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87de44-03d5-4b6e-ac99-212751b1b1b7 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:54.944275 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 319/632] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:54.945630 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f09872-919b-424e-bee9-0025413c617e None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:55.074815 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e87de44-03d5-4b6e-ac99-212751b1b1b7 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:55.091136 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f09872-919b-424e-bee9-0025413c617e None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:55.112091 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4009ba5-88ed-43cc-8a5d-fcc3353ec6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:55.112724 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4009ba5-88ed-43cc-8a5d-fcc3353ec6bb None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:55.112999 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4009ba5-88ed-43cc-8a5d-fcc3353ec6bb None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:55.113265 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4009ba5-88ed-43cc-8a5d-fcc3353ec6bb None admin] PATH_INFO: `/v3/users/nova` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:55.121795 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4009ba5-88ed-43cc-8a5d-fcc3353ec6bb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:55.124058 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4009ba5-88ed-43cc-8a5d-fcc3353ec6bb None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:55.127982 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a52b4-f44b-4b29-abff-f193164c2eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:55.128611 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a52b4-f44b-4b29-abff-f193164c2eb8 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:55.132024 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a52b4-f44b-4b29-abff-f193164c2eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:55.132024 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a52b4-f44b-4b29-abff-f193164c2eb8 None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:55.132024 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a52b4-f44b-4b29-abff-f193164c2eb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:55.132024 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a52b4-f44b-4b29-abff-f193164c2eb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:55.132024 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2a52b4-f44b-4b29-abff-f193164c2eb8 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:55.142176 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-e4009ba5-88ed-43cc-8a5d-fcc3353ec6bb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:36:55.142176 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:55.142176 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:55.142176 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:55.142176 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:55.142176 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:55.142176 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:55.142176 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:55.142176 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:55.142176 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:55.142176 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:55.142176 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:55.142176 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:36:55.142176 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:36:55.142176 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:36:55.142176 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:36:55.143142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:55.143142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:55.143142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:36:55.143142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:55.143142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:36:55.143142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:55.143142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:55.143142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:55.143142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:55.143142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:55.143142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:55.143142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:55.143142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:55.143142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:55.143142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:55.143142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:55.143142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:55.143142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:55.144092 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:55.144092 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:55.144092 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:36:55.144092 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:36:55.144092 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:36:55.144092 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:36:55.144092 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:36:55.144092 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:36:55.144092 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:36:55.144092 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:55.144092 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 314/633] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Aug 24 04:36:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:55.144680 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b191b3-8f05-4bda-9d68-0768211811ce None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:55.145721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b191b3-8f05-4bda-9d68-0768211811ce None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:55.145721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b191b3-8f05-4bda-9d68-0768211811ce None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:55.146486 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 315/634] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:55.158406 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b191b3-8f05-4bda-9d68-0768211811ce None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:55.158579 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 320/635] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:55.158579 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a52b4-f44b-4b29-abff-f193164c2eb8 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:55.205327 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:55.217228 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:55.274679 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b191b3-8f05-4bda-9d68-0768211811ce None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:55.277982 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2a52b4-f44b-4b29-abff-f193164c2eb8 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:55.315031 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179f0c3-a36a-4679-a035-9bfa3588a43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:55.315700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179f0c3-a36a-4679-a035-9bfa3588a43e None admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:55.315981 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179f0c3-a36a-4679-a035-9bfa3588a43e None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:55.316256 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6179f0c3-a36a-4679-a035-9bfa3588a43e None admin] PATH_INFO: `/v3/projects/08755f450e6c47dcaaaa754a6aa2ec62/users/a7ebb5105220438693118d734c9fda70/roles/d62916d0c54540b3859985d5d3565718` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:55.316837 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ed9c64-9d63-4a6d-b0fe-cedbffcd8ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:55.317484 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed9c64-9d63-4a6d-b0fe-cedbffcd8ff0 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:55.317763 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed9c64-9d63-4a6d-b0fe-cedbffcd8ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:55.318045 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ed9c64-9d63-4a6d-b0fe-cedbffcd8ff0 None admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:55.318797 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed9c64-9d63-4a6d-b0fe-cedbffcd8ff0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:55.319099 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed9c64-9d63-4a6d-b0fe-cedbffcd8ff0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:55.320544 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ed9c64-9d63-4a6d-b0fe-cedbffcd8ff0 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:55.331265 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179f0c3-a36a-4679-a035-9bfa3588a43e None admin] RBAC: Authorizing `identity:create_grant(project_id=08755f450e6c47dcaaaa754a6aa2ec62, user_id=a7ebb5105220438693118d734c9fda70, role_id=d62916d0c54540b3859985d5d3565718)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:55.332677 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6179f0c3-a36a-4679-a035-9bfa3588a43e None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:55.340921 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 321/636] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Aug 24 04:36:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:55.342365 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838743ca-ca20-4c85-93f3-042023ecd07c None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:55.342650 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838743ca-ca20-4c85-93f3-042023ecd07c None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:55.342920 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838743ca-ca20-4c85-93f3-042023ecd07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:55.358116 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 316/637] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 24 04:36:55 2022] PUT /identity/v3/projects/08755f450e6c47dcaaaa754a6aa2ec62/users/a7ebb5105220438693118d734c9fda70/roles/d62916d0c54540b3859985d5d3565718 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:36:55.359121 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179f0c3-a36a-4679-a035-9bfa3588a43e None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:55.390250 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-838743ca-ca20-4c85-93f3-042023ecd07c None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:55.392603 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-838743ca-ca20-4c85-93f3-042023ecd07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:55.521703 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 322/638] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:55.523413 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838743ca-ca20-4c85-93f3-042023ecd07c None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:55.571980 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6179f0c3-a36a-4679-a035-9bfa3588a43e None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:55.577752 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:55.578675 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:55.627105 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c1f17-90e7-4a44-afbb-d397f4d871b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:55.627796 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c1f17-90e7-4a44-afbb-d397f4d871b3 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:55.628081 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c1f17-90e7-4a44-afbb-d397f4d871b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:55.628355 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c1f17-90e7-4a44-afbb-d397f4d871b3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:55.637068 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c1f17-90e7-4a44-afbb-d397f4d871b3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:55.638778 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110c1f17-90e7-4a44-afbb-d397f4d871b3 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:55.659947 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-110c1f17-90e7-4a44-afbb-d397f4d871b3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:36:55.659947 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:55.659947 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:55.659947 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:55.659947 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:55.659947 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:55.659947 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:55.659947 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:55.659947 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:55.659947 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:55.659947 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:55.659947 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:55.659947 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:36:55.659947 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:36:55.659947 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:36:55.659947 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:36:55.662102 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:55.662102 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:55.662102 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:36:55.662102 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:55.662102 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:36:55.662102 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:55.662102 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:55.662102 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:55.662102 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:55.662102 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:55.662102 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:55.662102 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:55.662102 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:55.662102 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:55.662102 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:55.662102 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:55.662102 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:55.662102 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:55.664230 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:55.664230 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:55.664230 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:36:55.664230 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:36:55.664230 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:36:55.664230 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:36:55.664230 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:36:55.664230 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:36:55.664230 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:36:55.664230 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:55.664230 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 317/639] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:36:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:55.664230 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c1f17-90e7-4a44-afbb-d397f4d871b3 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:55.720199 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838743ca-ca20-4c85-93f3-042023ecd07c None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:55.772212 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d98176-0ca1-4a84-97ac-ccb6f3d95dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:55.773022 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d98176-0ca1-4a84-97ac-ccb6f3d95dfc None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:55.773395 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d98176-0ca1-4a84-97ac-ccb6f3d95dfc None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:55.773755 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d98176-0ca1-4a84-97ac-ccb6f3d95dfc None admin] PATH_INFO: `/v3/roles/service` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:55.787320 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c1f17-90e7-4a44-afbb-d397f4d871b3 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:55.788316 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d98176-0ca1-4a84-97ac-ccb6f3d95dfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:55.794268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-96d98176-0ca1-4a84-97ac-ccb6f3d95dfc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:36:55.794268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:55.794268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:55.794268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:55.794268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:55.794268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:55.794268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:55.794268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:55.794268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:55.794268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:55.794268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:55.794268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:55.794268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:55.794268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:55.794268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:55.794268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:55.796402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:55.796402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:55.796402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:55.796402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:55.796402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:55.796402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:55.796402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:55.796402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:55.796402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:55.796402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:55.796402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:55.796402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:55.796402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:55.796402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:55.796402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:55.796402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:55.798453 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:55.798453 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:55.798453 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:55.798453 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:55.798453 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:55.798453 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:55.798453 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:55.798453 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:55.798453 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:55.798453 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:55.798453 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:36:55.798453 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:55.798453 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 323/640] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 24 04:36:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:55.798453 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d98176-0ca1-4a84-97ac-ccb6f3d95dfc None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:55.831525 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101cdb6-aef5-4e40-822e-e83f25e1b4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:55.832319 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101cdb6-aef5-4e40-822e-e83f25e1b4b8 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:55.832632 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101cdb6-aef5-4e40-822e-e83f25e1b4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:55.832976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7101cdb6-aef5-4e40-822e-e83f25e1b4b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:55.871203 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:55.905144 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:55.918578 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7101cdb6-aef5-4e40-822e-e83f25e1b4b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:55.920076 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7101cdb6-aef5-4e40-822e-e83f25e1b4b8 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:55.920917 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d98176-0ca1-4a84-97ac-ccb6f3d95dfc None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:55.968402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1fa17-deea-4de3-85d8-dc497f2f28b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:55.970042 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1fa17-deea-4de3-85d8-dc497f2f28b3 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:55.970536 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1fa17-deea-4de3-85d8-dc497f2f28b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:55.971132 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f1fa17-deea-4de3-85d8-dc497f2f28b3 None admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:55.972515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f1fa17-deea-4de3-85d8-dc497f2f28b3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:55.973252 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f1fa17-deea-4de3-85d8-dc497f2f28b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:55.975393 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f1fa17-deea-4de3-85d8-dc497f2f28b3 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:56.004892 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 324/641] 10.222.0.49 () {56 vars in 1137 bytes} [Wed Aug 24 04:36:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:56.004892 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1fa17-deea-4de3-85d8-dc497f2f28b3 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:56.037695 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 318/642] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:36:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:36:56.038432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101cdb6-aef5-4e40-822e-e83f25e1b4b8 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:56.107460 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:56.132013 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f1fa17-deea-4de3-85d8-dc497f2f28b3 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:56.157476 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7101cdb6-aef5-4e40-822e-e83f25e1b4b8 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:56.175767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b01ecd-263c-4603-b7c8-1d6e8f9c61ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:56.176480 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b01ecd-263c-4603-b7c8-1d6e8f9c61ed None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:56.176820 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b01ecd-263c-4603-b7c8-1d6e8f9c61ed None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:56.177227 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b01ecd-263c-4603-b7c8-1d6e8f9c61ed None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:56.178378 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b01ecd-263c-4603-b7c8-1d6e8f9c61ed None admin] RBAC: Adding query filter params (name=service) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:56.178677 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b01ecd-263c-4603-b7c8-1d6e8f9c61ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:56.180121 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b01ecd-263c-4603-b7c8-1d6e8f9c61ed None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:56.195274 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 325/643] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 24 04:36:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:56.197154 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b01ecd-263c-4603-b7c8-1d6e8f9c61ed None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:56.198931 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5d3e9-9f9a-4381-83b9-8f9b5e712ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:56.199609 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5d3e9-9f9a-4381-83b9-8f9b5e712ee4 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:56.199934 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5d3e9-9f9a-4381-83b9-8f9b5e712ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:56.200210 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5d3e9-9f9a-4381-83b9-8f9b5e712ee4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:56.209970 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:56.211859 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5d3e9-9f9a-4381-83b9-8f9b5e712ee4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:56.216306 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-7dd5d3e9-9f9a-4381-83b9-8f9b5e712ee4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:36:56.216306 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:56.216306 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:56.216306 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:56.216306 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:56.216306 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:56.216306 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:56.216306 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:56.216306 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:56.216306 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:56.216306 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:56.216306 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:56.216306 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:56.216306 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:56.216306 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:56.216306 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:56.217507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:56.217507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:56.217507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:56.217507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:56.217507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:56.217507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:56.217507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:56.217507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:56.217507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:56.217507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:56.217507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:56.217507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:56.217507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:56.217507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:56.217507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:56.217507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:56.218403 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:56.218403 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:56.218403 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:56.218403 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:56.218403 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:56.218403 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:56.218403 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:56.218403 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:56.218403 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:56.218403 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:56.218403 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:36:56.218403 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:56.218403 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 319/644] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 24 04:36:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:56.218403 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5d3e9-9f9a-4381-83b9-8f9b5e712ee4 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:56.324970 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b01ecd-263c-4603-b7c8-1d6e8f9c61ed None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:56.348111 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5d3e9-9f9a-4381-83b9-8f9b5e712ee4 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:56.368708 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4400548-052b-429e-a9ff-c26fd4c62b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:56.369648 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4400548-052b-429e-a9ff-c26fd4c62b02 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:56.370079 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4400548-052b-429e-a9ff-c26fd4c62b02 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:56.370502 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4400548-052b-429e-a9ff-c26fd4c62b02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:56.375542 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:56.388315 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1bb98e-2e50-4f31-9691-5bf4aa93df4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:56.388956 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bb98e-2e50-4f31-9691-5bf4aa93df4e None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:56.389233 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bb98e-2e50-4f31-9691-5bf4aa93df4e None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:56.389537 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1bb98e-2e50-4f31-9691-5bf4aa93df4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:56.401927 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1bb98e-2e50-4f31-9691-5bf4aa93df4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:56.403669 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1bb98e-2e50-4f31-9691-5bf4aa93df4e None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:56.421988 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-ee1bb98e-2e50-4f31-9691-5bf4aa93df4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:56.421988 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:56.421988 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:56.421988 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:56.421988 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:56.421988 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:56.421988 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:56.421988 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:56.421988 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:56.421988 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:56.421988 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:56.421988 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:56.421988 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:56.421988 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:56.421988 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:56.421988 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:56.423041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:56.423041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:56.423041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:56.423041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:56.423041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:56.423041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:56.423041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:56.423041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:56.423041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:56.423041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:56.423041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:56.423041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:56.423041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:56.423041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:56.423041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:56.423041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:56.423041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:56.424131 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:56.424131 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:56.424131 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:56.424131 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 320/645] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:56.424357 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1bb98e-2e50-4f31-9691-5bf4aa93df4e None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:56.452951 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4400548-052b-429e-a9ff-c26fd4c62b02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:56.454587 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4400548-052b-429e-a9ff-c26fd4c62b02 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:56.465693 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:56.558905 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1bb98e-2e50-4f31-9691-5bf4aa93df4e None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:56.583700 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 326/646] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:36:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:36:56.583700 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4400548-052b-429e-a9ff-c26fd4c62b02 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:56.606050 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177d66a-5f22-4e07-bbb6-5ac9585127b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:56.607047 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177d66a-5f22-4e07-bbb6-5ac9585127b2 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:56.607334 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177d66a-5f22-4e07-bbb6-5ac9585127b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:56.607603 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177d66a-5f22-4e07-bbb6-5ac9585127b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:56.620378 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0177d66a-5f22-4e07-bbb6-5ac9585127b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:56.621922 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0177d66a-5f22-4e07-bbb6-5ac9585127b2 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:56.638613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-0177d66a-5f22-4e07-bbb6-5ac9585127b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:56.638613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:56.638613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:56.638613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:56.638613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:56.638613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:56.638613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:56.638613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:56.638613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:56.638613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:56.638613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:56.638613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:56.638613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:56.638613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:56.638613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:56.638613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:56.639640 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:56.639640 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:56.639640 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:56.639640 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:56.639640 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:56.639640 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:56.639640 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:56.639640 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:56.639640 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:56.639640 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:56.639640 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:56.639640 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:56.639640 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:56.639640 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:56.639640 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:56.639640 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:56.639640 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:56.640527 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:56.640527 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:56.640527 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:56.640527 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 321/647] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:56.640754 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177d66a-5f22-4e07-bbb6-5ac9585127b2 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:56.680567 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:56.712471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4400548-052b-429e-a9ff-c26fd4c62b02 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:56.723525 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:56.758119 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44b1f3-6f54-4e3e-a1b4-e041fba037a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:56.759164 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44b1f3-6f54-4e3e-a1b4-e041fba037a9 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:56.759676 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44b1f3-6f54-4e3e-a1b4-e041fba037a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:56.760171 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44b1f3-6f54-4e3e-a1b4-e041fba037a9 None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:56.761026 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa44b1f3-6f54-4e3e-a1b4-e041fba037a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:56.761526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa44b1f3-6f54-4e3e-a1b4-e041fba037a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:56.762160 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177d66a-5f22-4e07-bbb6-5ac9585127b2 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:56.763277 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa44b1f3-6f54-4e3e-a1b4-e041fba037a9 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:56.772880 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 327/648] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 24 04:36:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:56.774518 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44b1f3-6f54-4e3e-a1b4-e041fba037a9 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:56.796413 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd3158-9126-4a19-8981-a81ce080d92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:56.797041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd3158-9126-4a19-8981-a81ce080d92b None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:56.797353 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd3158-9126-4a19-8981-a81ce080d92b None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:56.797630 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd3158-9126-4a19-8981-a81ce080d92b None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:56.798271 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd3158-9126-4a19-8981-a81ce080d92b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:56.798572 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd3158-9126-4a19-8981-a81ce080d92b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:56.799957 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd3158-9126-4a19-8981-a81ce080d92b None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:56.811903 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 322/649] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:56.813076 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd3158-9126-4a19-8981-a81ce080d92b None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:56.887892 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44b1f3-6f54-4e3e-a1b4-e041fba037a9 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:56.905191 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:56.917932 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd3158-9126-4a19-8981-a81ce080d92b None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:56.924703 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22653f4-fc0d-48bc-ac90-11708d8e1fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:56.925357 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22653f4-fc0d-48bc-ac90-11708d8e1fbd None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:56.925730 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22653f4-fc0d-48bc-ac90-11708d8e1fbd None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:56.926004 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22653f4-fc0d-48bc-ac90-11708d8e1fbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:56.938275 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22653f4-fc0d-48bc-ac90-11708d8e1fbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:56.940190 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22653f4-fc0d-48bc-ac90-11708d8e1fbd None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:56.955673 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3413bf2-c5fe-45ee-a3de-53143019921a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:56.955879 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-a22653f4-fc0d-48bc-ac90-11708d8e1fbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:56.955879 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:56.955879 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:56.955879 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:56.955879 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:56.955879 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:56.955879 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:56.955879 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:56.955879 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:56.955879 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:56.955879 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:56.955879 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:56.955879 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:56.955879 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:56.955879 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:56.955879 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:56.956793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:56.956793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:56.956793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:56.956793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:56.956793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:56.956793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:56.956793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:56.956793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:56.956793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:56.956793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:56.956793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:56.956793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:56.956793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:56.956793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:56.956793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:56.956793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:56.956793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:56.958307 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:56.958307 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:56.958307 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:56.958481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3413bf2-c5fe-45ee-a3de-53143019921a None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:56.958481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3413bf2-c5fe-45ee-a3de-53143019921a None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:56.958481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3413bf2-c5fe-45ee-a3de-53143019921a None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:56.958481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3413bf2-c5fe-45ee-a3de-53143019921a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:56.958481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3413bf2-c5fe-45ee-a3de-53143019921a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:56.959194 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3413bf2-c5fe-45ee-a3de-53143019921a None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:56.961738 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 328/650] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:56.962404 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22653f4-fc0d-48bc-ac90-11708d8e1fbd None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:56.976809 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 323/651] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:56.976809 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3413bf2-c5fe-45ee-a3de-53143019921a None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:56.992721 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:57.079782 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3413bf2-c5fe-45ee-a3de-53143019921a None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:57.085512 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22653f4-fc0d-48bc-ac90-11708d8e1fbd None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:57.114396 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a42e94-2dce-4637-a9f6-8d586f8a2673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:57.115040 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a42e94-2dce-4637-a9f6-8d586f8a2673 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:57.115306 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a42e94-2dce-4637-a9f6-8d586f8a2673 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:57.115569 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a42e94-2dce-4637-a9f6-8d586f8a2673 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:57.121182 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc4558-9de4-4671-8a63-fa0ebee82e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:57.121839 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc4558-9de4-4671-8a63-fa0ebee82e60 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:57.122164 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc4558-9de4-4671-8a63-fa0ebee82e60 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:57.122432 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc4558-9de4-4671-8a63-fa0ebee82e60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:57.122689 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a42e94-2dce-4637-a9f6-8d586f8a2673 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:57.124181 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a42e94-2dce-4637-a9f6-8d586f8a2673 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:57.135721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-77a42e94-2dce-4637-a9f6-8d586f8a2673 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:57.135721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:57.135721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:57.135721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:57.135721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:57.135721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:57.135721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:57.135721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:57.135721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:57.135721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:57.135721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:57.135721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:57.135721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:36:57.135721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:36:57.135721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:36:57.136606 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:36:57.136606 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:57.136606 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:57.136606 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:57.136606 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:57.136606 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:57.136606 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:57.136606 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:57.136606 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:57.136606 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:57.136606 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:57.136606 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:57.136606 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:57.136606 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:57.136606 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:57.136606 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:57.136606 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:57.137951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:36:57.137951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:36:57.137951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:36:57.137951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:36:57.137951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:36:57.137951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:36:57.137951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:57.137951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:57.138377 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc4558-9de4-4671-8a63-fa0ebee82e60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:57.138448 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 324/652] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:57.138448 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a42e94-2dce-4637-a9f6-8d586f8a2673 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:57.143003 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc4558-9de4-4671-8a63-fa0ebee82e60 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:57.154263 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:57.160569 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-eddc4558-9de4-4671-8a63-fa0ebee82e60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:57.160569 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:57.160569 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:57.160569 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:57.160569 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:57.160569 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:57.160569 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:57.160569 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:57.160569 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:57.160569 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:57.160569 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:57.160569 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:57.160569 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:57.160569 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:57.160569 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:57.160569 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:57.161784 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:57.161784 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:57.161784 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:57.161784 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:57.161784 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:57.161784 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:57.161784 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:57.161784 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:57.161784 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:57.161784 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:57.161784 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:57.161784 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:57.161784 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:57.161784 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:57.161784 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:57.161784 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:57.161784 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:57.162663 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:57.162663 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:57.162663 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:57.162663 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 329/653] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:57.162890 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc4558-9de4-4671-8a63-fa0ebee82e60 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:57.247760 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:57.279411 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a42e94-2dce-4637-a9f6-8d586f8a2673 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:57.295378 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc4558-9de4-4671-8a63-fa0ebee82e60 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:57.314576 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ade9fa-2e08-4ad8-813a-fb6e2ba55b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:57.315185 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ade9fa-2e08-4ad8-813a-fb6e2ba55b4f None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:57.315464 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ade9fa-2e08-4ad8-813a-fb6e2ba55b4f None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:57.315760 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ade9fa-2e08-4ad8-813a-fb6e2ba55b4f None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:57.316404 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ade9fa-2e08-4ad8-813a-fb6e2ba55b4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:57.316702 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ade9fa-2e08-4ad8-813a-fb6e2ba55b4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:57.318113 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ade9fa-2e08-4ad8-813a-fb6e2ba55b4f None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:57.334306 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b935db-5bfd-485b-bc04-15b564e6fdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:57.334931 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b935db-5bfd-485b-bc04-15b564e6fdb5 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:57.335200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b935db-5bfd-485b-bc04-15b564e6fdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:57.335478 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b935db-5bfd-485b-bc04-15b564e6fdb5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:57.337491 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 325/654] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:57.338582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ade9fa-2e08-4ad8-813a-fb6e2ba55b4f None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:57.355354 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b935db-5bfd-485b-bc04-15b564e6fdb5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:57.357150 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b935db-5bfd-485b-bc04-15b564e6fdb5 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:57.369002 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-92b935db-5bfd-485b-bc04-15b564e6fdb5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 04:36:57.369002 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:57.369002 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:57.369002 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:57.369002 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:57.369002 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:57.369002 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:57.369002 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:57.369002 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:57.369002 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:57.369002 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:57.369002 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:57.369002 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:36:57.369002 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:36:57.369002 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:36:57.369002 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:36:57.370181 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:57.370181 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:57.370181 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:36:57.370181 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:57.370181 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:36:57.370181 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:57.370181 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:57.370181 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:57.370181 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:57.370181 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:57.370181 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:57.370181 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:57.370181 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:57.370181 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:57.370181 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:57.370181 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:57.370181 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:57.370181 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:57.371302 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:57.371302 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:57.371302 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:36:57.371302 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:36:57.371302 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:36:57.371302 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:36:57.371302 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:36:57.371302 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:36:57.371302 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 04:36:57.371302 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:57.371302 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 330/655] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:36:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:57.371302 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b935db-5bfd-485b-bc04-15b564e6fdb5 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:57.426848 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:57.461973 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ade9fa-2e08-4ad8-813a-fb6e2ba55b4f None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:57.486490 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b935db-5bfd-485b-bc04-15b564e6fdb5 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:57.496250 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6908a2-cc69-4e42-884a-42b497777df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:57.496852 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6908a2-cc69-4e42-884a-42b497777df2 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:57.497129 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6908a2-cc69-4e42-884a-42b497777df2 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:57.497432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6908a2-cc69-4e42-884a-42b497777df2 None admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:57.498195 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6908a2-cc69-4e42-884a-42b497777df2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:57.498440 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6908a2-cc69-4e42-884a-42b497777df2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:57.499926 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6908a2-cc69-4e42-884a-42b497777df2 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:57.512339 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 326/656] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 24 04:36:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:57.513137 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6908a2-cc69-4e42-884a-42b497777df2 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:57.522391 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccafd480-8a68-4b58-acc6-a92531ae2b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:57.522969 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafd480-8a68-4b58-acc6-a92531ae2b2b None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:57.523269 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafd480-8a68-4b58-acc6-a92531ae2b2b None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:57.523535 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafd480-8a68-4b58-acc6-a92531ae2b2b None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:57.524186 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccafd480-8a68-4b58-acc6-a92531ae2b2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:57.524489 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccafd480-8a68-4b58-acc6-a92531ae2b2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:57.525948 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccafd480-8a68-4b58-acc6-a92531ae2b2b None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:57.527622 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:57.541304 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 331/657] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:57.542137 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccafd480-8a68-4b58-acc6-a92531ae2b2b None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:57.618152 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6908a2-cc69-4e42-884a-42b497777df2 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:57.643717 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccafd480-8a68-4b58-acc6-a92531ae2b2b None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:57.644678 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:57.652929 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a562ae-e3f4-4193-a287-0396733f5478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:57.653599 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a562ae-e3f4-4193-a287-0396733f5478 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:57.653882 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a562ae-e3f4-4193-a287-0396733f5478 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:57.654148 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a562ae-e3f4-4193-a287-0396733f5478 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:57.660859 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a562ae-e3f4-4193-a287-0396733f5478 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:57.662339 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a562ae-e3f4-4193-a287-0396733f5478 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:57.674141 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-76a562ae-e3f4-4193-a287-0396733f5478 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:57.674141 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:57.674141 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:57.674141 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:57.674141 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:57.674141 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:57.674141 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:57.674141 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:57.674141 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:57.674141 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:57.674141 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:57.674141 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:57.674141 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:36:57.674141 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:36:57.674141 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:36:57.675034 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:36:57.675034 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:57.675034 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:57.675034 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:57.675034 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:57.675034 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:57.675034 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:57.675034 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:57.675034 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:57.675034 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:57.675034 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:57.675034 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:57.675034 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:57.675034 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:57.675034 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:57.675034 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:57.675034 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:57.675922 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:36:57.675922 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:36:57.675922 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:36:57.675922 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:36:57.675922 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:36:57.675922 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:36:57.675922 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:57.675922 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:57.677465 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 327/658] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:57.678451 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8998e-b92b-4d39-9fce-a23bab15e208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:57.678861 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e304a11-84a0-44ae-b6bb-9d5a3f578d58 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:57.679068 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8998e-b92b-4d39-9fce-a23bab15e208 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:57.679173 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e304a11-84a0-44ae-b6bb-9d5a3f578d58 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:57.679349 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8998e-b92b-4d39-9fce-a23bab15e208 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:57.679442 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e304a11-84a0-44ae-b6bb-9d5a3f578d58 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:57.679619 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8998e-b92b-4d39-9fce-a23bab15e208 None admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:57.680358 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e8998e-b92b-4d39-9fce-a23bab15e208 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:57.680671 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 328/659] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:36:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:36:57.680813 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e8998e-b92b-4d39-9fce-a23bab15e208 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:57.681358 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e304a11-84a0-44ae-b6bb-9d5a3f578d58 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:57.682518 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e8998e-b92b-4d39-9fce-a23bab15e208 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:57.703664 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 332/660] 10.222.0.49 () {56 vars in 1137 bytes} [Wed Aug 24 04:36:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:57.704532 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8998e-b92b-4d39-9fce-a23bab15e208 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:57.760830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:57.789576 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e304a11-84a0-44ae-b6bb-9d5a3f578d58 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:57.807592 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8998e-b92b-4d39-9fce-a23bab15e208 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:57.823428 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db0ec4-a0bb-460b-a922-d8457f971a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:57.824042 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db0ec4-a0bb-460b-a922-d8457f971a21 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:57.824362 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db0ec4-a0bb-460b-a922-d8457f971a21 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:57.824603 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db0ec4-a0bb-460b-a922-d8457f971a21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:57.825350 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db0ec4-a0bb-460b-a922-d8457f971a21 None admin] RBAC: Adding query filter params (role.id=d62916d0c54540b3859985d5d3565718, scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62, user.id=9dc9a3cf381e4a2da36ed82b407a2d94) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:57.825736 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db0ec4-a0bb-460b-a922-d8457f971a21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:57.827131 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db0ec4-a0bb-460b-a922-d8457f971a21 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:57.832953 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 329/661] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:36:57 2022] GET /identity/v3/role_assignments?user.id=9dc9a3cf381e4a2da36ed82b407a2d94&scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62&role.id=d62916d0c54540b3859985d5d3565718 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:57.833748 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db0ec4-a0bb-460b-a922-d8457f971a21 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:57.844962 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe27caa-327e-42a4-83f0-19ab6c1d9931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:57.845653 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe27caa-327e-42a4-83f0-19ab6c1d9931 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:57.845924 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe27caa-327e-42a4-83f0-19ab6c1d9931 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:57.846200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe27caa-327e-42a4-83f0-19ab6c1d9931 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:57.854655 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe27caa-327e-42a4-83f0-19ab6c1d9931 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:57.856500 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe27caa-327e-42a4-83f0-19ab6c1d9931 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:57.869758 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-efe27caa-327e-42a4-83f0-19ab6c1d9931 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 04:36:57.869758 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:57.869758 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:57.869758 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:57.869758 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:57.869758 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:57.869758 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:57.869758 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:57.869758 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:57.869758 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:57.869758 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:57.869758 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:57.869758 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:36:57.869758 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:36:57.869758 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:36:57.869758 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:36:57.870772 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:57.870772 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:57.870772 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:36:57.870772 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:57.870772 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:36:57.870772 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:57.870772 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:57.870772 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:57.870772 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:57.870772 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:57.870772 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:57.870772 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:57.870772 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:57.870772 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:57.870772 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:57.870772 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:57.870772 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:57.870772 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:57.871732 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:57.871732 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:57.871732 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:36:57.871732 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:36:57.871732 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:36:57.871732 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:36:57.871732 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:36:57.871732 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:36:57.871732 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 04:36:57.871732 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:57.874480 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 333/662] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 24 04:36:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:57.876546 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a67179-4c11-4e1f-986a-4f8bbc185cfd None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:57.876808 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a67179-4c11-4e1f-986a-4f8bbc185cfd None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:57.877647 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a67179-4c11-4e1f-986a-4f8bbc185cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:57.898969 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-d5a67179-4c11-4e1f-986a-4f8bbc185cfd None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:36:57.900213 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-d5a67179-4c11-4e1f-986a-4f8bbc185cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:36:57.912161 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:57.969068 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db0ec4-a0bb-460b-a922-d8457f971a21 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:57.977965 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 334/663] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:36:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:36:57.978919 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a67179-4c11-4e1f-986a-4f8bbc185cfd None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:58.015467 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9917522-835a-4d38-a116-44f60ad3443a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:58.020433 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9917522-835a-4d38-a116-44f60ad3443a None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:58.020433 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9917522-835a-4d38-a116-44f60ad3443a None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:58.020433 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9917522-835a-4d38-a116-44f60ad3443a None admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:58.021152 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9917522-835a-4d38-a116-44f60ad3443a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:58.021799 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9917522-835a-4d38-a116-44f60ad3443a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:58.024663 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9917522-835a-4d38-a116-44f60ad3443a None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:58.039547 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:58.046263 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 330/664] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 24 04:36:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:58.046263 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9917522-835a-4d38-a116-44f60ad3443a None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:58.116670 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a67179-4c11-4e1f-986a-4f8bbc185cfd None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:58.167607 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd1be7-b687-452d-aa48-a255a7500a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:58.168256 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd1be7-b687-452d-aa48-a255a7500a0d None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:58.168535 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd1be7-b687-452d-aa48-a255a7500a0d None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:58.168812 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd1be7-b687-452d-aa48-a255a7500a0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:58.169913 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9917522-835a-4d38-a116-44f60ad3443a None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:58.191751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:58.218413 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4287de10-b2f4-4c6a-b53d-ee353035e7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:58.218978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287de10-b2f4-4c6a-b53d-ee353035e7b6 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:58.219264 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287de10-b2f4-4c6a-b53d-ee353035e7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:58.219532 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287de10-b2f4-4c6a-b53d-ee353035e7b6 None admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:58.220273 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4287de10-b2f4-4c6a-b53d-ee353035e7b6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:58.220573 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4287de10-b2f4-4c6a-b53d-ee353035e7b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:58.222504 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4287de10-b2f4-4c6a-b53d-ee353035e7b6 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:58.245176 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 331/665] 10.222.0.49 () {56 vars in 1139 bytes} [Wed Aug 24 04:36:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:58.246220 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4287de10-b2f4-4c6a-b53d-ee353035e7b6 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:58.259259 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd1be7-b687-452d-aa48-a255a7500a0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:58.261896 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd1be7-b687-452d-aa48-a255a7500a0d None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:58.309906 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:58.376715 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 335/666] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:36:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:36:58.377456 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd1be7-b687-452d-aa48-a255a7500a0d None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:58.386967 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4287de10-b2f4-4c6a-b53d-ee353035e7b6 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:58.424227 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee4b66-4b40-40c8-9999-d8637c3b5672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:58.424866 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee4b66-4b40-40c8-9999-d8637c3b5672 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:58.425146 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee4b66-4b40-40c8-9999-d8637c3b5672 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:58.425442 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee4b66-4b40-40c8-9999-d8637c3b5672 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:58.426300 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee4b66-4b40-40c8-9999-d8637c3b5672 None admin] RBAC: Adding query filter params (role.id=d62916d0c54540b3859985d5d3565718, scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62, user.id=2a957fc61ff14c35aac0b577c3c1baf5) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:58.426603 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee4b66-4b40-40c8-9999-d8637c3b5672 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:58.428189 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee4b66-4b40-40c8-9999-d8637c3b5672 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:58.441534 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 332/667] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:36:58 2022] GET /identity/v3/role_assignments?user.id=2a957fc61ff14c35aac0b577c3c1baf5&scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62&role.id=d62916d0c54540b3859985d5d3565718 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:58.442982 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee4b66-4b40-40c8-9999-d8637c3b5672 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:58.484940 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd1be7-b687-452d-aa48-a255a7500a0d None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:58.494083 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:58.532445 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da1e18-e16c-4b34-8ccf-89a1bff20cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:58.533449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da1e18-e16c-4b34-8ccf-89a1bff20cf6 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:58.533732 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da1e18-e16c-4b34-8ccf-89a1bff20cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:58.534046 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da1e18-e16c-4b34-8ccf-89a1bff20cf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:58.550428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:58.586887 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee4b66-4b40-40c8-9999-d8637c3b5672 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:58.626023 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51da1e18-e16c-4b34-8ccf-89a1bff20cf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:58.627489 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51da1e18-e16c-4b34-8ccf-89a1bff20cf6 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:58.633273 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3cf65b-e663-4f97-9f58-fab307fb494f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:58.634222 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cf65b-e663-4f97-9f58-fab307fb494f None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:58.634690 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cf65b-e663-4f97-9f58-fab307fb494f None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:58.635161 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cf65b-e663-4f97-9f58-fab307fb494f None admin] PATH_INFO: `/v3/roles/service` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:58.650589 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3cf65b-e663-4f97-9f58-fab307fb494f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:36:58.657446 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-ea3cf65b-e663-4f97-9f58-fab307fb494f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:36:58.657446 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:58.657446 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:58.657446 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:58.657446 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:58.657446 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:58.657446 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:58.657446 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:58.657446 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:58.657446 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:58.657446 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:58.657446 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:58.657446 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:36:58.657446 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:36:58.657446 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:36:58.657446 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:36:58.658400 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:36:58.658400 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:36:58.658400 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:36:58.658400 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:36:58.658400 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:58.658400 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:58.658400 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:58.658400 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:58.658400 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:58.658400 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:58.658400 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:58.658400 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:58.658400 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:58.658400 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:58.658400 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:58.658400 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:58.659421 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:58.659421 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:58.659421 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:58.659421 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:58.659421 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:36:58.659421 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:36:58.659421 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:36:58.659421 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:36:58.659421 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:36:58.659421 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:36:58.659421 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:36:58.659421 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:58.665426 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 333/668] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 24 04:36:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:58.666335 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3cf65b-e663-4f97-9f58-fab307fb494f None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:58.759272 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 336/669] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:36:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:36:58.759272 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da1e18-e16c-4b34-8ccf-89a1bff20cf6 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:58.801030 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:58.810206 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3cf65b-e663-4f97-9f58-fab307fb494f None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:58.813635 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:58.849980 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1581e-603e-456a-868a-4f1a1997a305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:58.850622 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1581e-603e-456a-868a-4f1a1997a305 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:58.850903 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1581e-603e-456a-868a-4f1a1997a305 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:58.851175 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1581e-603e-456a-868a-4f1a1997a305 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:58.862747 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1581e-603e-456a-868a-4f1a1997a305 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:58.864211 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1581e-603e-456a-868a-4f1a1997a305 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:58.878743 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-38a1581e-603e-456a-868a-4f1a1997a305 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:58.878743 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:58.878743 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:58.878743 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:58.878743 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:58.878743 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:58.878743 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:58.878743 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:58.878743 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:58.878743 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:58.878743 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:58.878743 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:58.878743 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:58.878743 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:58.878743 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:58.878743 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:58.879680 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:58.879680 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:58.879680 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:58.879680 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:58.879680 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:58.879680 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:58.879680 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:58.879680 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:58.879680 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:58.879680 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:58.879680 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:58.879680 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:58.879680 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:58.879680 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:58.879680 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:58.879680 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:58.879680 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:58.880988 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:58.880988 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:58.880988 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:58.884569 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 334/670] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:58.885153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da1e18-e16c-4b34-8ccf-89a1bff20cf6 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:58.885470 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1581e-603e-456a-868a-4f1a1997a305 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:58.923513 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5bb7f-6b36-4ed9-bb60-799b70fcc829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:58.924503 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5bb7f-6b36-4ed9-bb60-799b70fcc829 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:58.924983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5bb7f-6b36-4ed9-bb60-799b70fcc829 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:58.925481 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5bb7f-6b36-4ed9-bb60-799b70fcc829 None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:58.926361 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5bb7f-6b36-4ed9-bb60-799b70fcc829 None admin] RBAC: Adding query filter params (name=service) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:58.926953 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5bb7f-6b36-4ed9-bb60-799b70fcc829 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:58.928622 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5bb7f-6b36-4ed9-bb60-799b70fcc829 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:58.942805 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 337/671] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 24 04:36:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:58.944042 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5bb7f-6b36-4ed9-bb60-799b70fcc829 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:58.992129 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1581e-603e-456a-868a-4f1a1997a305 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:59.028211 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170575b4-feb5-4841-8153-2ccf7ebbd658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:59.028875 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170575b4-feb5-4841-8153-2ccf7ebbd658 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:59.029163 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170575b4-feb5-4841-8153-2ccf7ebbd658 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:59.029470 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170575b4-feb5-4841-8153-2ccf7ebbd658 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:59.041659 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170575b4-feb5-4841-8153-2ccf7ebbd658 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:59.043142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170575b4-feb5-4841-8153-2ccf7ebbd658 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:59.050316 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:59.058380 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5bb7f-6b36-4ed9-bb60-799b70fcc829 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:59.060613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-170575b4-feb5-4841-8153-2ccf7ebbd658 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:59.060613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:59.060613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:59.060613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:59.060613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:59.060613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:59.060613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:59.060613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:59.060613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:59.060613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:59.060613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:59.060613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:59.060613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:59.060613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:59.060613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:59.060613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:59.061781 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:59.061781 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:59.061781 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:59.061781 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:59.061781 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:59.061781 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:59.061781 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:59.061781 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:59.061781 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:59.061781 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:59.061781 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:59.061781 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:59.061781 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:59.061781 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:59.061781 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:59.061781 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:59.061781 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:59.062949 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:59.062949 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:59.062949 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:59.064232 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:59.064854 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 335/672] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:59.065868 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170575b4-feb5-4841-8153-2ccf7ebbd658 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:59.114087 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6650228-5ac9-4155-b453-08797b4b62ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:59.114834 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6650228-5ac9-4155-b453-08797b4b62ea None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:59.115375 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6650228-5ac9-4155-b453-08797b4b62ea None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:59.115528 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6650228-5ac9-4155-b453-08797b4b62ea None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:59.116300 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6650228-5ac9-4155-b453-08797b4b62ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:59.116690 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6650228-5ac9-4155-b453-08797b4b62ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:59.118256 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6650228-5ac9-4155-b453-08797b4b62ea None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:59.136571 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 338/673] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:59.136571 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6650228-5ac9-4155-b453-08797b4b62ea None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:59.183899 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170575b4-feb5-4841-8153-2ccf7ebbd658 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:59.220651 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c239c36-e071-4f52-8322-3c5c3f8bc1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:59.221688 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c239c36-e071-4f52-8322-3c5c3f8bc1ea None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:59.222138 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c239c36-e071-4f52-8322-3c5c3f8bc1ea None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:59.222558 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c239c36-e071-4f52-8322-3c5c3f8bc1ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:59.235169 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c239c36-e071-4f52-8322-3c5c3f8bc1ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:59.236901 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c239c36-e071-4f52-8322-3c5c3f8bc1ea None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:59.243408 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6650228-5ac9-4155-b453-08797b4b62ea None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:59.252862 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-2c239c36-e071-4f52-8322-3c5c3f8bc1ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:59.252862 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:59.252862 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:59.252862 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:59.252862 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:59.252862 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:59.252862 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:59.252862 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:59.252862 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:59.252862 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:59.252862 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:59.252862 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:59.252862 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:36:59.252862 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:36:59.252862 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:36:59.252862 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:36:59.254098 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:59.254098 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:59.254098 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:59.254098 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:59.254098 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:59.254098 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:59.254098 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:59.254098 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:59.254098 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:59.254098 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:59.254098 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:59.254098 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:59.254098 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:59.254098 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:59.254098 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:59.254098 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:59.254098 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:36:59.255209 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:36:59.255209 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:36:59.255209 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:59.256778 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 336/674] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:36:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:59.257773 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c239c36-e071-4f52-8322-3c5c3f8bc1ea None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:59.286455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a2900-27ce-48f6-a055-9f4fa19ab778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:59.287238 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a2900-27ce-48f6-a055-9f4fa19ab778 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:59.287605 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a2900-27ce-48f6-a055-9f4fa19ab778 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:59.287973 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a2900-27ce-48f6-a055-9f4fa19ab778 None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:59.288709 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a2900-27ce-48f6-a055-9f4fa19ab778 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:59.289103 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a2900-27ce-48f6-a055-9f4fa19ab778 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:59.290623 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a2900-27ce-48f6-a055-9f4fa19ab778 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:59.306948 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 339/675] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:59.307961 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a2900-27ce-48f6-a055-9f4fa19ab778 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:59.314605 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:59.334617 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:59.377449 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c239c36-e071-4f52-8322-3c5c3f8bc1ea None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:59.412400 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a2900-27ce-48f6-a055-9f4fa19ab778 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:59.418572 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2646a-6847-400d-af3f-e260e4eb632c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:59.419510 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2646a-6847-400d-af3f-e260e4eb632c None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:59.419937 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2646a-6847-400d-af3f-e260e4eb632c None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:59.420462 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2646a-6847-400d-af3f-e260e4eb632c None admin] PATH_INFO: `/v3/projects/service` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:59.429014 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d2646a-6847-400d-af3f-e260e4eb632c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:59.432522 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d2646a-6847-400d-af3f-e260e4eb632c None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:59.448435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-24d2646a-6847-400d-af3f-e260e4eb632c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:59.448435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:59.448435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:59.448435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:59.448435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:59.448435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:59.448435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:59.448435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:59.448435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:59.448435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:59.448435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:59.448435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:59.448435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:36:59.448435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:36:59.448435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:36:59.449535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:36:59.449535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:59.449535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:59.449535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:59.449535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:59.449535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:59.449535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:59.449535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:59.449535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:59.449535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:59.449535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:59.449535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:59.449535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:59.449535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:59.449535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:59.449535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:59.449535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:59.450977 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:36:59.450977 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:36:59.450977 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:36:59.450977 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:36:59.450977 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:36:59.450977 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:36:59.450977 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:59.450977 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:59.451545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0151a75-7db9-4aa8-bfbe-32de64990365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:59.451545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0151a75-7db9-4aa8-bfbe-32de64990365 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:59.451545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0151a75-7db9-4aa8-bfbe-32de64990365 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:59.451545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0151a75-7db9-4aa8-bfbe-32de64990365 None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:59.451924 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0151a75-7db9-4aa8-bfbe-32de64990365 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:59.451924 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0151a75-7db9-4aa8-bfbe-32de64990365 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:59.452817 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0151a75-7db9-4aa8-bfbe-32de64990365 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:59.460277 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 337/676] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:59.461518 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2646a-6847-400d-af3f-e260e4eb632c None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:59.470640 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 340/677] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:59.471576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0151a75-7db9-4aa8-bfbe-32de64990365 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:59.560188 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:59.576845 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0151a75-7db9-4aa8-bfbe-32de64990365 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:59.590135 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2646a-6847-400d-af3f-e260e4eb632c None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:59.603439 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:59.614406 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2bd9e7-5776-49c7-8893-7e5cb7018774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:59.615045 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2bd9e7-5776-49c7-8893-7e5cb7018774 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:59.615319 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2bd9e7-5776-49c7-8893-7e5cb7018774 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:59.615588 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2bd9e7-5776-49c7-8893-7e5cb7018774 None admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:59.616290 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2bd9e7-5776-49c7-8893-7e5cb7018774 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:59.616604 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2bd9e7-5776-49c7-8893-7e5cb7018774 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:59.618141 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2bd9e7-5776-49c7-8893-7e5cb7018774 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:59.636421 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835c6a6-abd7-4383-bb63-67a57bf1a962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:59.637064 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 341/678] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 24 04:36:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:59.637686 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835c6a6-abd7-4383-bb63-67a57bf1a962 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:59.638163 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2bd9e7-5776-49c7-8893-7e5cb7018774 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:59.638412 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835c6a6-abd7-4383-bb63-67a57bf1a962 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:59.638964 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835c6a6-abd7-4383-bb63-67a57bf1a962 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:59.648108 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835c6a6-abd7-4383-bb63-67a57bf1a962 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:59.650345 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835c6a6-abd7-4383-bb63-67a57bf1a962 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:59.663870 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-d835c6a6-abd7-4383-bb63-67a57bf1a962 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:59.663870 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:59.663870 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:59.663870 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:59.663870 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:59.663870 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:59.663870 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:59.663870 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:59.663870 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:59.663870 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:59.663870 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:59.663870 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:59.663870 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:36:59.663870 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:36:59.663870 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:36:59.664766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:36:59.664766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:59.664766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:59.664766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:59.664766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:59.664766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:59.664766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:59.664766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:59.664766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:59.664766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:59.664766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:59.664766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:59.664766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:59.664766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:59.664766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:59.664766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:59.664766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:59.665686 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:36:59.665686 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:36:59.665686 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:36:59.665686 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:36:59.665686 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:36:59.665686 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:36:59.665686 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:36:59.665686 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:36:59.668569 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 338/679] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:36:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:59.669736 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835c6a6-abd7-4383-bb63-67a57bf1a962 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:59.748623 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2bd9e7-5776-49c7-8893-7e5cb7018774 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:59.782789 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df069ad0-2def-4744-95c0-8ee7b6f43d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:59.783428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df069ad0-2def-4744-95c0-8ee7b6f43d4e None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:59.783748 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df069ad0-2def-4744-95c0-8ee7b6f43d4e None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:59.784020 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df069ad0-2def-4744-95c0-8ee7b6f43d4e None admin] PATH_INFO: `/v3/users/swift` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:59.792111 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df069ad0-2def-4744-95c0-8ee7b6f43d4e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:59.793700 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df069ad0-2def-4744-95c0-8ee7b6f43d4e None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:59.798458 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835c6a6-abd7-4383-bb63-67a57bf1a962 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:59.805899 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-df069ad0-2def-4744-95c0-8ee7b6f43d4e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:36:59.805899 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:36:59.805899 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:36:59.805899 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:36:59.805899 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:36:59.805899 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:36:59.805899 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:36:59.805899 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:36:59.805899 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:36:59.805899 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:36:59.805899 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:36:59.805899 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:36:59.805899 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:36:59.805899 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:36:59.805899 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:36:59.805899 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:36:59.806867 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:36:59.806867 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:36:59.806867 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:36:59.806867 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:59.806867 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:36:59.806867 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:36:59.806867 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:36:59.806867 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:36:59.806867 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:36:59.806867 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:36:59.806867 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:36:59.806867 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:36:59.806867 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:36:59.806867 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:36:59.806867 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:36:59.806867 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:36:59.806867 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:36:59.806867 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:36:59.807767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:36:59.807767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:36:59.807767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:36:59.807767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:36:59.807767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:36:59.807767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:36:59.807767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:36:59.807767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:36:59.807767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:36:59.807767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:36:59.812031 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 342/680] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 24 04:36:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:36:59.812914 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df069ad0-2def-4744-95c0-8ee7b6f43d4e None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:59.816958 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:59.842145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f7676-8f78-4639-95d8-9e9d15dce6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:36:59.843303 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f7676-8f78-4639-95d8-9e9d15dce6af None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:36:59.843806 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f7676-8f78-4639-95d8-9e9d15dce6af None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:36:59.844305 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f7676-8f78-4639-95d8-9e9d15dce6af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:36:59.845353 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f7676-8f78-4639-95d8-9e9d15dce6af None admin] RBAC: Adding query filter params (role.id=d62916d0c54540b3859985d5d3565718, scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62, user.id=2be44ea93247420d994e24912a9ac32e) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:36:59.846215 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f7676-8f78-4639-95d8-9e9d15dce6af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:36:59.847965 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f7676-8f78-4639-95d8-9e9d15dce6af None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:36:59.855946 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 339/681] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:36:59 2022] GET /identity/v3/role_assignments?user.id=2be44ea93247420d994e24912a9ac32e&scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62&role.id=d62916d0c54540b3859985d5d3565718 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:36:59.857172 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f7676-8f78-4639-95d8-9e9d15dce6af None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:36:59.897527 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:36:59.981173 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f7676-8f78-4639-95d8-9e9d15dce6af None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:36:59.981410 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df069ad0-2def-4744-95c0-8ee7b6f43d4e None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:00.023225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103826e7-32ab-4857-b857-02aa29005814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:00.024438 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103826e7-32ab-4857-b857-02aa29005814 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:00.025464 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103826e7-32ab-4857-b857-02aa29005814 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:00.025954 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103826e7-32ab-4857-b857-02aa29005814 None admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:00.026178 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115d12fa-7430-4033-8554-1bdfb69b20ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:00.026823 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d12fa-7430-4033-8554-1bdfb69b20ce None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:00.027110 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d12fa-7430-4033-8554-1bdfb69b20ce None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:00.027385 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115d12fa-7430-4033-8554-1bdfb69b20ce None admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:00.027778 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103826e7-32ab-4857-b857-02aa29005814 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:00.028097 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d12fa-7430-4033-8554-1bdfb69b20ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:00.028402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d12fa-7430-4033-8554-1bdfb69b20ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:00.028720 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103826e7-32ab-4857-b857-02aa29005814 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:00.030005 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115d12fa-7430-4033-8554-1bdfb69b20ce None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:00.030772 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103826e7-32ab-4857-b857-02aa29005814 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:00.045411 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 343/682] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 24 04:36:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:00.046806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39dd0d-1c0d-45d3-8e74-a5c2d0bf8829 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:00.047074 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39dd0d-1c0d-45d3-8e74-a5c2d0bf8829 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:00.047348 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39dd0d-1c0d-45d3-8e74-a5c2d0bf8829 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:00.052980 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 340/683] 10.222.0.49 () {56 vars in 1135 bytes} [Wed Aug 24 04:36:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:00.053686 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 344/684] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:00 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:00.054522 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103826e7-32ab-4857-b857-02aa29005814 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:00.054931 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d035d471-ccd2-4833-bf88-7107700ae559 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:00.055212 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d035d471-ccd2-4833-bf88-7107700ae559 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:00.055483 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d035d471-ccd2-4833-bf88-7107700ae559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:00.075040 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-d035d471-ccd2-4833-bf88-7107700ae559 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:00.076273 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-d035d471-ccd2-4833-bf88-7107700ae559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:00.168735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:00.172005 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:00.179441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 345/685] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:37:00.180408 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d035d471-ccd2-4833-bf88-7107700ae559 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:00.187579 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103826e7-32ab-4857-b857-02aa29005814 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:00.226160 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa277b1-93d4-4f0e-9890-751f5b009c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:00.227293 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa277b1-93d4-4f0e-9890-751f5b009c0f None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:00.227765 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa277b1-93d4-4f0e-9890-751f5b009c0f None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:00.228965 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa277b1-93d4-4f0e-9890-751f5b009c0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:00.230033 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa277b1-93d4-4f0e-9890-751f5b009c0f None admin] RBAC: Adding query filter params (role.id=d62916d0c54540b3859985d5d3565718, scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62, user.id=087c0311906a4987b294729706a08810) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:00.230967 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa277b1-93d4-4f0e-9890-751f5b009c0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:00.232688 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa277b1-93d4-4f0e-9890-751f5b009c0f None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:00.245478 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 341/686] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:37:00 2022] GET /identity/v3/role_assignments?user.id=087c0311906a4987b294729706a08810&scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62&role.id=d62916d0c54540b3859985d5d3565718 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:00.293583 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d035d471-ccd2-4833-bf88-7107700ae559 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:00.351211 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f318c-6e4d-4c91-9b58-3a989b1ea7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:00.351858 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f318c-6e4d-4c91-9b58-3a989b1ea7e8 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:00.352198 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f318c-6e4d-4c91-9b58-3a989b1ea7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:00.352469 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f318c-6e4d-4c91-9b58-3a989b1ea7e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:00.440055 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:00.448250 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f318c-6e4d-4c91-9b58-3a989b1ea7e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:00.450064 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f318c-6e4d-4c91-9b58-3a989b1ea7e8 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:00.499277 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa277b1-93d4-4f0e-9890-751f5b009c0f None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:00.580614 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 346/687] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:37:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:37:00.587437 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f318c-6e4d-4c91-9b58-3a989b1ea7e8 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:00.636999 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa277b1-93d4-4f0e-9890-751f5b009c0f None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:00.678401 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8beaa6-a0e8-4c92-a13e-4be47f53b15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:00.679729 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8beaa6-a0e8-4c92-a13e-4be47f53b15d None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:00.680208 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8beaa6-a0e8-4c92-a13e-4be47f53b15d None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:00.680689 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8beaa6-a0e8-4c92-a13e-4be47f53b15d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:00.694604 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8beaa6-a0e8-4c92-a13e-4be47f53b15d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:37:00.703390 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-1b8beaa6-a0e8-4c92-a13e-4be47f53b15d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:37:00.703390 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:00.703390 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:00.703390 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:00.703390 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:00.703390 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:00.703390 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:00.703390 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:00.703390 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:00.703390 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:00.703390 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:00.703390 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:00.703390 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:37:00.703390 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:37:00.703390 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:37:00.703390 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:37:00.704343 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:37:00.704343 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:37:00.704343 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:37:00.704343 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:37:00.704343 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:00.704343 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:00.704343 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:00.704343 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:00.704343 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:00.704343 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:00.704343 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:00.704343 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:00.704343 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:00.704343 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:00.704343 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:00.704343 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:00.705178 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:00.705178 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:00.705178 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:00.705178 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:00.705178 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:37:00.705178 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:37:00.705178 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:37:00.705178 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:37:00.705178 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:37:00.705178 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:37:00.705178 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:37:00.705178 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:00.708329 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 342/688] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 24 04:37:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:37:00.710159 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535859d1-1d75-496d-abcb-c5ad40d77c27 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:00.710667 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535859d1-1d75-496d-abcb-c5ad40d77c27 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:00.711138 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535859d1-1d75-496d-abcb-c5ad40d77c27 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:00.713169 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 343/689] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:00.714083 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535859d1-1d75-496d-abcb-c5ad40d77c27 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:00.745781 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f318c-6e4d-4c91-9b58-3a989b1ea7e8 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:00.749689 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:00.756582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:00.788223 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24737c-b5b9-4518-a79d-358426f0f0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:00.788973 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24737c-b5b9-4518-a79d-358426f0f0d2 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:00.789317 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24737c-b5b9-4518-a79d-358426f0f0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:00.789919 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24737c-b5b9-4518-a79d-358426f0f0d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:00.802310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24737c-b5b9-4518-a79d-358426f0f0d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:00.803562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24737c-b5b9-4518-a79d-358426f0f0d2 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:00.821904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-5a24737c-b5b9-4518-a79d-358426f0f0d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:00.821904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:00.821904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:00.821904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:00.821904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:00.821904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:00.821904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:00.821904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:00.821904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:00.821904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:00.821904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:00.821904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:00.821904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:37:00.821904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:37:00.821904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:37:00.821904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:37:00.822885 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:00.822885 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:00.822885 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:00.822885 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:00.822885 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:00.822885 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:00.822885 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:00.822885 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:00.822885 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:00.822885 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:00.822885 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:00.822885 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:00.822885 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:00.822885 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:00.822885 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:00.822885 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:00.822885 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:37:00.823749 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:37:00.823749 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:00.823749 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:00.828121 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 347/690] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:00.829572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fbb78-e6d9-46ca-a4f4-be3bffca50fd None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:00.829924 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fbb78-e6d9-46ca-a4f4-be3bffca50fd None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:00.830266 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fbb78-e6d9-46ca-a4f4-be3bffca50fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:00.844851 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535859d1-1d75-496d-abcb-c5ad40d77c27 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:00.849925 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-8d4fbb78-e6d9-46ca-a4f4-be3bffca50fd None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:00.851214 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-8d4fbb78-e6d9-46ca-a4f4-be3bffca50fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:00.893996 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e39ca-f6c9-4149-833a-96518f130640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:00.894966 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e39ca-f6c9-4149-833a-96518f130640 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:00.895417 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e39ca-f6c9-4149-833a-96518f130640 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:00.895886 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e39ca-f6c9-4149-833a-96518f130640 None admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:00.897245 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e39ca-f6c9-4149-833a-96518f130640 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:00.897771 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e39ca-f6c9-4149-833a-96518f130640 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:00.899809 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e39ca-f6c9-4149-833a-96518f130640 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:00.910762 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 344/691] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:37:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:00.911798 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e39ca-f6c9-4149-833a-96518f130640 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:00.932248 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 348/692] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:37:00.933450 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4fbb78-e6d9-46ca-a4f4-be3bffca50fd None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:01.026525 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:01.054483 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4fbb78-e6d9-46ca-a4f4-be3bffca50fd None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:01.074636 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:01.103650 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f5d3e-39c1-46c5-9075-0eec2ea09506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:01.104298 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f5d3e-39c1-46c5-9075-0eec2ea09506 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:01.104586 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f5d3e-39c1-46c5-9075-0eec2ea09506 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:01.105210 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f5d3e-39c1-46c5-9075-0eec2ea09506 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:01.113142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e39ca-f6c9-4149-833a-96518f130640 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:01.131834 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f5d3e-39c1-46c5-9075-0eec2ea09506 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:01.133466 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f5d3e-39c1-46c5-9075-0eec2ea09506 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:01.152007 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5752b-107a-49c4-94a8-c2482204dfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:01.152973 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5752b-107a-49c4-94a8-c2482204dfc0 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:01.153472 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5752b-107a-49c4-94a8-c2482204dfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:01.155689 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5752b-107a-49c4-94a8-c2482204dfc0 None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:01.157418 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec5752b-107a-49c4-94a8-c2482204dfc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:01.158189 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec5752b-107a-49c4-94a8-c2482204dfc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:01.162368 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec5752b-107a-49c4-94a8-c2482204dfc0 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:01.166443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-ce0f5d3e-39c1-46c5-9075-0eec2ea09506 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:01.166443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:01.166443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:01.166443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:01.166443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:01.166443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:01.166443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:01.166443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:01.166443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:01.166443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:01.166443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:01.166443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:01.166443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:37:01.166443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:37:01.166443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:37:01.166443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:37:01.167359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:01.167359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:01.167359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:01.167359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:01.167359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:01.167359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:01.167359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:01.167359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:01.167359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:01.167359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:01.167359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:01.167359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:01.167359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:01.167359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:01.167359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:01.167359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:01.167359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:37:01.168247 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:37:01.168247 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:01.168247 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:01.168247 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 349/693] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:01.173821 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f5d3e-39c1-46c5-9075-0eec2ea09506 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:01.190124 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 345/694] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:01.195420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5752b-107a-49c4-94a8-c2482204dfc0 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:01.346087 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5752b-107a-49c4-94a8-c2482204dfc0 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:01.352724 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f5d3e-39c1-46c5-9075-0eec2ea09506 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:01.389413 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:01.393687 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f40410-a9d4-4ef7-83de-529e77f15a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:01.394332 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f40410-a9d4-4ef7-83de-529e77f15a23 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:01.394608 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f40410-a9d4-4ef7-83de-529e77f15a23 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:01.394872 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f40410-a9d4-4ef7-83de-529e77f15a23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:01.402944 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f40410-a9d4-4ef7-83de-529e77f15a23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:01.403107 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f9e71-17dc-4230-8404-a16b36915b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:01.403645 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f9e71-17dc-4230-8404-a16b36915b0a None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:01.403928 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f9e71-17dc-4230-8404-a16b36915b0a None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:01.404205 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f9e71-17dc-4230-8404-a16b36915b0a None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:01.404464 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f40410-a9d4-4ef7-83de-529e77f15a23 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:01.405138 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f9e71-17dc-4230-8404-a16b36915b0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:01.405478 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f9e71-17dc-4230-8404-a16b36915b0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:01.406399 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:01.408415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f9e71-17dc-4230-8404-a16b36915b0a None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:01.417600 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-24f40410-a9d4-4ef7-83de-529e77f15a23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:37:01.417600 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:01.417600 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:01.417600 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:01.417600 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:01.417600 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:01.417600 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:01.417600 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:01.417600 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:01.417600 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:01.417600 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:01.417600 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:01.417600 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:37:01.417600 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:37:01.417600 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:37:01.418539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:37:01.418539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:01.418539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:01.418539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:01.418539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:01.418539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:01.418539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:01.418539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:01.418539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:01.418539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:01.418539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:01.418539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:01.418539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:01.418539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:01.418539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:01.418539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:01.418539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:01.419398 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:37:01.419398 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:37:01.419398 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:37:01.419398 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:37:01.419398 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:37:01.419398 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:37:01.419398 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:37:01.419398 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:01.423522 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 350/696] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:01.423733 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 346/696] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:37:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:01.424427 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f9e71-17dc-4230-8404-a16b36915b0a None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:01.425326 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f40410-a9d4-4ef7-83de-529e77f15a23 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:01.545182 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f40410-a9d4-4ef7-83de-529e77f15a23 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:01.578312 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f9e71-17dc-4230-8404-a16b36915b0a None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:01.582794 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cbf50-7ebb-4c11-8913-3672b3cdffab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:01.583589 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cbf50-7ebb-4c11-8913-3672b3cdffab None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:01.583964 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cbf50-7ebb-4c11-8913-3672b3cdffab None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:01.584353 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cbf50-7ebb-4c11-8913-3672b3cdffab None admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:01.585155 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073cbf50-7ebb-4c11-8913-3672b3cdffab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:01.585604 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073cbf50-7ebb-4c11-8913-3672b3cdffab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:01.587151 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073cbf50-7ebb-4c11-8913-3672b3cdffab None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:01.608057 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 347/697] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 24 04:37:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:01.609071 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cbf50-7ebb-4c11-8913-3672b3cdffab None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:01.619300 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49771cf0-bc2d-43ad-8ddc-56e48f2e95c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:01.620125 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49771cf0-bc2d-43ad-8ddc-56e48f2e95c1 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:01.620519 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49771cf0-bc2d-43ad-8ddc-56e48f2e95c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:01.620884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49771cf0-bc2d-43ad-8ddc-56e48f2e95c1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:01.621627 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49771cf0-bc2d-43ad-8ddc-56e48f2e95c1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:01.623213 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49771cf0-bc2d-43ad-8ddc-56e48f2e95c1 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:01.634521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-49771cf0-bc2d-43ad-8ddc-56e48f2e95c1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:37:01.634521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:01.634521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:37:01.634521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:37:01.634521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:37:01.634521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:37:01.634521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:37:01.634521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:01.634521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:37:01.634521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:01.634521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:37:01.634521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:01.634521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:01.634521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:01.634521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:01.634521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:01.634521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:01.635959 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:01.635959 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:01.635959 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:01.635959 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:01.635959 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:01.635959 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:01.635959 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:37:01.635959 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:37:01.635959 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:37:01.635959 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:37:01.635959 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:01.635959 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:01.635959 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:01.635959 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:01.635959 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:01.635959 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:01.637783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:01.637783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:01.637783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:01.637783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:01.637783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:01.637783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:01.637783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:01.637783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:01.637783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:01.637783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:01.637783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:37:01.637783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:01.637783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:37:01.637783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:01.637783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 351/698] 10.222.0.49 () {56 vars in 1129 bytes} [Wed Aug 24 04:37:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:01.639362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49771cf0-bc2d-43ad-8ddc-56e48f2e95c1 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:01.683047 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:01.707308 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:01.730083 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cbf50-7ebb-4c11-8913-3672b3cdffab None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:01.763208 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49771cf0-bc2d-43ad-8ddc-56e48f2e95c1 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:01.778097 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af13d4-3728-441d-8561-76e5fab0e6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:01.778771 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af13d4-3728-441d-8561-76e5fab0e6f2 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:01.779049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af13d4-3728-441d-8561-76e5fab0e6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:01.779353 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af13d4-3728-441d-8561-76e5fab0e6f2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:01.789097 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af13d4-3728-441d-8561-76e5fab0e6f2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:01.791316 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af13d4-3728-441d-8561-76e5fab0e6f2 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:01.802587 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7d777-ebd1-413c-9aad-00c97e565309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:01.803527 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7d777-ebd1-413c-9aad-00c97e565309 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:01.804000 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7d777-ebd1-413c-9aad-00c97e565309 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:01.804462 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7d777-ebd1-413c-9aad-00c97e565309 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:01.805427 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7d777-ebd1-413c-9aad-00c97e565309 None admin] RBAC: Adding query filter params (role.id=d62916d0c54540b3859985d5d3565718, scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62, user.id=a7ebb5105220438693118d734c9fda70) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:01.805958 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7d777-ebd1-413c-9aad-00c97e565309 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:01.806062 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-76af13d4-3728-441d-8561-76e5fab0e6f2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:37:01.806062 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:01.806062 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:01.806062 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:01.806062 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:01.806062 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:01.806062 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:01.806062 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:01.806062 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:01.806062 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:01.806062 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:01.806062 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:01.806062 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:37:01.806062 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:37:01.806062 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:37:01.806062 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:37:01.806895 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:01.806895 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:01.806895 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:37:01.806895 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:37:01.806895 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:37:01.806895 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:37:01.806895 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:01.806895 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:01.806895 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:01.806895 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:01.806895 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:01.806895 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:01.806895 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:01.806895 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:01.806895 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:01.806895 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:01.806895 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:01.806895 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:01.808410 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:01.808410 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:01.808410 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:37:01.808410 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:37:01.808410 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:37:01.808410 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:37:01.808410 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:37:01.808410 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:37:01.808410 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:37:01.808410 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:01.808410 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 348/699] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Aug 24 04:37:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:01.808410 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af13d4-3728-441d-8561-76e5fab0e6f2 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:01.810942 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7d777-ebd1-413c-9aad-00c97e565309 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:01.825682 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 352/700] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:37:01 2022] GET /identity/v3/role_assignments?user.id=a7ebb5105220438693118d734c9fda70&scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62&role.id=d62916d0c54540b3859985d5d3565718 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:01.827158 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7d777-ebd1-413c-9aad-00c97e565309 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:01.970641 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7d777-ebd1-413c-9aad-00c97e565309 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:01.989817 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:02.018579 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2b436-b452-47c6-b93d-7b09b7596e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:02.019201 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2b436-b452-47c6-b93d-7b09b7596e87 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:02.019490 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2b436-b452-47c6-b93d-7b09b7596e87 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:02.019767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2b436-b452-47c6-b93d-7b09b7596e87 None admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:02.020513 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2b436-b452-47c6-b93d-7b09b7596e87 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:02.020695 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af13d4-3728-441d-8561-76e5fab0e6f2 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:02.020881 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2b436-b452-47c6-b93d-7b09b7596e87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:02.022311 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2b436-b452-47c6-b93d-7b09b7596e87 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:02.041971 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 353/701] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Aug 24 04:37:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:02.042272 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:02.050592 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2b436-b452-47c6-b93d-7b09b7596e87 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:02.074364 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e0e8d-8313-4b8d-8989-863bfe010b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:02.074995 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e0e8d-8313-4b8d-8989-863bfe010b9d None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:02.075532 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e0e8d-8313-4b8d-8989-863bfe010b9d None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:02.075810 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e0e8d-8313-4b8d-8989-863bfe010b9d None admin] PATH_INFO: `/v3/services` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:02.077090 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e0e8d-8313-4b8d-8989-863bfe010b9d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:02.077422 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e0e8d-8313-4b8d-8989-863bfe010b9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:02.078843 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e0e8d-8313-4b8d-8989-863bfe010b9d None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:02.085820 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 349/702] 10.222.0.49 () {56 vars in 1124 bytes} [Wed Aug 24 04:37:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:02.091565 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e0e8d-8313-4b8d-8989-863bfe010b9d None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:02.185576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2b436-b452-47c6-b93d-7b09b7596e87 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:02.225076 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e0e8d-8313-4b8d-8989-863bfe010b9d None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:02.233708 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef4b3c-7dd3-48b4-a920-b189429cf5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:02.234350 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef4b3c-7dd3-48b4-a920-b189429cf5b1 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:02.234633 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef4b3c-7dd3-48b4-a920-b189429cf5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:02.235238 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef4b3c-7dd3-48b4-a920-b189429cf5b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:02.264024 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69b2af-5dd1-49d0-b452-9eb9f1e0f778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:02.264942 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69b2af-5dd1-49d0-b452-9eb9f1e0f778 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:02.264942 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69b2af-5dd1-49d0-b452-9eb9f1e0f778 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:02.265151 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69b2af-5dd1-49d0-b452-9eb9f1e0f778 None admin] PATH_INFO: `/v3/services` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:02.265831 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69b2af-5dd1-49d0-b452-9eb9f1e0f778 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:02.266165 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69b2af-5dd1-49d0-b452-9eb9f1e0f778 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:02.267541 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69b2af-5dd1-49d0-b452-9eb9f1e0f778 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:02.279154 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 350/703] 10.222.0.49 () {56 vars in 1124 bytes} [Wed Aug 24 04:37:02 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:02.279154 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba755e-1a8d-4161-826d-1c3b055e14a3 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:02.279154 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba755e-1a8d-4161-826d-1c3b055e14a3 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:02.279154 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba755e-1a8d-4161-826d-1c3b055e14a3 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:02.279154 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 351/704] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:02.282851 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf771b46-1524-4bb5-82b7-e7318c23c1a7 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:02.283137 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf771b46-1524-4bb5-82b7-e7318c23c1a7 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:02.283424 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf771b46-1524-4bb5-82b7-e7318c23c1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:02.296302 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:02.305816 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-bf771b46-1524-4bb5-82b7-e7318c23c1a7 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:02.307086 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-bf771b46-1524-4bb5-82b7-e7318c23c1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:02.344344 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef4b3c-7dd3-48b4-a920-b189429cf5b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:02.346733 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef4b3c-7dd3-48b4-a920-b189429cf5b1 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:02.372081 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:02.416037 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 352/705] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:37:02.417132 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ced93-0443-419c-a7d1-ff2099fb7d8b None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:02.417457 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ced93-0443-419c-a7d1-ff2099fb7d8b None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:02.417727 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ced93-0443-419c-a7d1-ff2099fb7d8b None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:02.419345 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 353/706] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:02.425648 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b61150-2de0-43e2-aee5-acdecdaa6519 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:02.425937 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b61150-2de0-43e2-aee5-acdecdaa6519 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:02.426209 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b61150-2de0-43e2-aee5-acdecdaa6519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:02.445772 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-d2b61150-2de0-43e2-aee5-acdecdaa6519 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:02.447052 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-d2b61150-2de0-43e2-aee5-acdecdaa6519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:02.512224 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 354/707] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:37:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 04:37:02.518035 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef4b3c-7dd3-48b4-a920-b189429cf5b1 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:02.538203 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 354/708] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:37:02.598339 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:02.623198 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef4b3c-7dd3-48b4-a920-b189429cf5b1 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:02.658613 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250766a-8ba6-46a1-b656-8c7353984c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:02.659257 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250766a-8ba6-46a1-b656-8c7353984c63 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:02.659538 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250766a-8ba6-46a1-b656-8c7353984c63 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:02.659812 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250766a-8ba6-46a1-b656-8c7353984c63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:02.670633 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250766a-8ba6-46a1-b656-8c7353984c63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:02.672103 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250766a-8ba6-46a1-b656-8c7353984c63 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:02.687200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-e250766a-8ba6-46a1-b656-8c7353984c63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:02.687200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:02.687200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:02.687200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:02.687200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:02.687200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:02.687200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:02.687200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:02.687200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:02.687200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:02.687200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:02.687200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:02.687200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:37:02.687200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:37:02.687200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:37:02.687200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:37:02.688125 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:02.688125 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:02.688125 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:02.688125 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:02.688125 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:02.688125 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:02.688125 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:02.688125 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:02.688125 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:02.688125 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:02.688125 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:02.688125 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:02.688125 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:02.688125 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:02.688125 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:02.688125 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:02.688125 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:37:02.690010 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:37:02.690010 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:02.690010 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:02.690010 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 355/709] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:02.694218 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b61150-2de0-43e2-aee5-acdecdaa6519 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:02.733961 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250766a-8ba6-46a1-b656-8c7353984c63 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:02.807664 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b61150-2de0-43e2-aee5-acdecdaa6519 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:02.816486 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:02.857070 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929e14e-4413-45f5-bdb3-f777243f138c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:02.858200 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929e14e-4413-45f5-bdb3-f777243f138c None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:02.858578 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929e14e-4413-45f5-bdb3-f777243f138c None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:02.859377 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929e14e-4413-45f5-bdb3-f777243f138c None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:02.860418 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929e14e-4413-45f5-bdb3-f777243f138c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:02.860814 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929e14e-4413-45f5-bdb3-f777243f138c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:02.862987 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929e14e-4413-45f5-bdb3-f777243f138c None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:02.879778 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 355/710] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:02.881777 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929e14e-4413-45f5-bdb3-f777243f138c None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:02.909237 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250766a-8ba6-46a1-b656-8c7353984c63 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:02.936149 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:02.946045 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c631d2-6d13-46d8-9f9f-c476a09831c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:02.946906 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c631d2-6d13-46d8-9f9f-c476a09831c6 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:02.947314 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c631d2-6d13-46d8-9f9f-c476a09831c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:02.947730 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c631d2-6d13-46d8-9f9f-c476a09831c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:02.959646 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c631d2-6d13-46d8-9f9f-c476a09831c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:02.961447 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c631d2-6d13-46d8-9f9f-c476a09831c6 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:02.976498 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-b3c631d2-6d13-46d8-9f9f-c476a09831c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:02.976498 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:02.976498 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:02.976498 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:02.976498 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:02.976498 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:02.976498 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:02.976498 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:02.976498 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:02.976498 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:02.976498 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:02.976498 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:02.976498 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:37:02.976498 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:37:02.976498 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:37:02.976498 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:37:02.977550 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:02.977550 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:02.977550 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:02.977550 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:02.977550 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:02.977550 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:02.977550 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:02.977550 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:02.977550 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:02.977550 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:02.977550 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:02.977550 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:02.977550 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:02.977550 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:02.977550 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:02.977550 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:02.977550 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:37:02.978434 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:37:02.978434 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:02.978434 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:02.980769 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 356/711] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:37:02.981776 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c631d2-6d13-46d8-9f9f-c476a09831c6 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:03.005141 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929e14e-4413-45f5-bdb3-f777243f138c None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:03.041937 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8385675-0cc0-476c-91cb-8cbf329d9b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:03.042757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8385675-0cc0-476c-91cb-8cbf329d9b6e None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:03.043404 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8385675-0cc0-476c-91cb-8cbf329d9b6e None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:03.043777 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8385675-0cc0-476c-91cb-8cbf329d9b6e None admin] PATH_INFO: `/v3/services/network` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:03.045045 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8385675-0cc0-476c-91cb-8cbf329d9b6e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:03.047058 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8385675-0cc0-476c-91cb-8cbf329d9b6e None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:03.062420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-b8385675-0cc0-476c-91cb-8cbf329d9b6e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:37:03.062420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:03.062420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:37:03.062420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:37:03.062420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:37:03.062420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:37:03.062420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:37:03.062420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:03.062420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:37:03.062420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:03.062420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:37:03.062420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:03.062420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:03.062420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:03.062420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:03.062420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:03.062420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:03.063647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:03.063647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:03.063647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:03.063647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:03.063647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:03.063647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:03.063647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:37:03.063647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:37:03.063647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:37:03.063647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:37:03.063647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:03.063647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:03.063647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:03.063647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:03.063647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:03.063647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:03.064498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:03.064498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:03.064498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:03.064498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:03.064498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:03.064498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:03.064498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:03.064498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:03.064498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:03.064498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:03.064498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:37:03.064498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:03.064498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:37:03.064498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:03.069861 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 356/712] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:37:02 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:03.070760 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8385675-0cc0-476c-91cb-8cbf329d9b6e None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:03.097513 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c631d2-6d13-46d8-9f9f-c476a09831c6 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:03.110882 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:03.142534 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce4513-c5d0-40d2-8762-f87b1c2985d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:03.143665 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce4513-c5d0-40d2-8762-f87b1c2985d2 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:03.144004 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce4513-c5d0-40d2-8762-f87b1c2985d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:03.144339 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce4513-c5d0-40d2-8762-f87b1c2985d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:03.151773 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce4513-c5d0-40d2-8762-f87b1c2985d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:03.153470 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ce4513-c5d0-40d2-8762-f87b1c2985d2 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:03.174891 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-62ce4513-c5d0-40d2-8762-f87b1c2985d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:37:03.174891 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:03.174891 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:03.174891 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:03.174891 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:03.174891 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:03.174891 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:03.174891 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:03.174891 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:03.174891 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:03.174891 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:03.174891 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:03.174891 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:37:03.174891 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:37:03.174891 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:37:03.175806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:37:03.175806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:03.175806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:03.175806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:03.175806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:03.175806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:03.175806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:03.175806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:03.175806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:03.175806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:03.175806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:03.175806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:03.175806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:03.175806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:03.175806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:03.175806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:03.175806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:03.176657 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:37:03.176657 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:37:03.176657 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:37:03.176657 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:37:03.176657 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:37:03.176657 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:37:03.176657 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:37:03.176657 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:03.179246 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 357/713] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:37:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:03.180409 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce4513-c5d0-40d2-8762-f87b1c2985d2 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:03.207262 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8385675-0cc0-476c-91cb-8cbf329d9b6e None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:03.225634 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:03.256307 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8cbbf-8f88-47c1-b279-c77da8bff0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:03.257226 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8cbbf-8f88-47c1-b279-c77da8bff0c9 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:03.257535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8cbbf-8f88-47c1-b279-c77da8bff0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:03.258696 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8cbbf-8f88-47c1-b279-c77da8bff0c9 None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:03.259368 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8cbbf-8f88-47c1-b279-c77da8bff0c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:03.259675 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8cbbf-8f88-47c1-b279-c77da8bff0c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:03.261078 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8cbbf-8f88-47c1-b279-c77da8bff0c9 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:03.289424 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 357/714] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:03.290330 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8cbbf-8f88-47c1-b279-c77da8bff0c9 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:03.296443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ce4513-c5d0-40d2-8762-f87b1c2985d2 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:03.336980 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d0072-3ff8-4106-b1c8-517fd6a4e590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:03.337546 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d0072-3ff8-4106-b1c8-517fd6a4e590 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:03.337824 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d0072-3ff8-4106-b1c8-517fd6a4e590 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:03.338092 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d0072-3ff8-4106-b1c8-517fd6a4e590 None admin] PATH_INFO: `/v3/services` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:03.338744 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d0072-3ff8-4106-b1c8-517fd6a4e590 None admin] RBAC: Adding query filter params (name=network) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:03.339043 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d0072-3ff8-4106-b1c8-517fd6a4e590 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:03.340596 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d0072-3ff8-4106-b1c8-517fd6a4e590 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:03.346269 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 358/715] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 24 04:37:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:03.347193 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d0072-3ff8-4106-b1c8-517fd6a4e590 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:03.414805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:03.427359 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8cbbf-8f88-47c1-b279-c77da8bff0c9 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:03.452587 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d0072-3ff8-4106-b1c8-517fd6a4e590 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:03.455024 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:03.484561 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64147e-297d-4462-b158-853c66717e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:03.485730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64147e-297d-4462-b158-853c66717e31 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:03.486581 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64147e-297d-4462-b158-853c66717e31 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:03.487011 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64147e-297d-4462-b158-853c66717e31 None admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:03.488104 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d64147e-297d-4462-b158-853c66717e31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:03.488802 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d64147e-297d-4462-b158-853c66717e31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:03.491343 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d64147e-297d-4462-b158-853c66717e31 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:03.494508 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc91f0-2f55-4d6c-8517-3bbb26b9b4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:03.495348 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc91f0-2f55-4d6c-8517-3bbb26b9b4f4 None admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:03.495469 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc91f0-2f55-4d6c-8517-3bbb26b9b4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:03.495709 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dc91f0-2f55-4d6c-8517-3bbb26b9b4f4 None admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:03.496463 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc91f0-2f55-4d6c-8517-3bbb26b9b4f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:03.498238 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dc91f0-2f55-4d6c-8517-3bbb26b9b4f4 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:03.507212 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 358/716] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 24 04:37:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:03.509547 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64147e-297d-4462-b158-853c66717e31 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:03.529358 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 359/717] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 24 04:37:03 2022] POST /identity/v3/users => generated 254 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:37:03.529358 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc91f0-2f55-4d6c-8517-3bbb26b9b4f4 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:03.659685 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dc91f0-2f55-4d6c-8517-3bbb26b9b4f4 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:03.700837 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1315591-b18a-43dd-b278-aad5b3e27064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:03.701804 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1315591-b18a-43dd-b278-aad5b3e27064 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:03.702183 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1315591-b18a-43dd-b278-aad5b3e27064 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:03.702543 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1315591-b18a-43dd-b278-aad5b3e27064 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:03.703393 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1315591-b18a-43dd-b278-aad5b3e27064 None admin] RBAC: Adding query filter params (role.id=74ce7b72bcc94a8a8ad65c3db928e6ac, scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62, user.id=9dc9a3cf381e4a2da36ed82b407a2d94) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:03.703825 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1315591-b18a-43dd-b278-aad5b3e27064 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:03.705828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1315591-b18a-43dd-b278-aad5b3e27064 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:03.712122 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 360/718] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:37:03 2022] GET /identity/v3/role_assignments?user.id=9dc9a3cf381e4a2da36ed82b407a2d94&scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62&role.id=74ce7b72bcc94a8a8ad65c3db928e6ac => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:03.734691 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64147e-297d-4462-b158-853c66717e31 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:03.773736 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96cbcf4-710a-4993-a7a7-779ca613fa18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:03.774752 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cbcf4-710a-4993-a7a7-779ca613fa18 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:03.775270 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cbcf4-710a-4993-a7a7-779ca613fa18 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:03.775763 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cbcf4-710a-4993-a7a7-779ca613fa18 None admin] PATH_INFO: `/v3/services` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:03.776680 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96cbcf4-710a-4993-a7a7-779ca613fa18 None admin] RBAC: Adding query filter params (type=network) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:03.777219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96cbcf4-710a-4993-a7a7-779ca613fa18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:03.779011 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96cbcf4-710a-4993-a7a7-779ca613fa18 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:03.785090 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 359/719] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 24 04:37:03 2022] GET /identity/v3/services?type=network => generated 124 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:04.514797 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7259f26-b0fa-477e-83a5-8f76ec20ad11 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:04.515323 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7259f26-b0fa-477e-83a5-8f76ec20ad11 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:04.515323 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7259f26-b0fa-477e-83a5-8f76ec20ad11 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:04.516925 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 361/720] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:04.522459 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f818d1-2c50-4126-99f4-24967ec773d3 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:04.522986 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f818d1-2c50-4126-99f4-24967ec773d3 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:04.522986 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f818d1-2c50-4126-99f4-24967ec773d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:04.547031 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-80f818d1-2c50-4126-99f4-24967ec773d3 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:04.548609 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-80f818d1-2c50-4126-99f4-24967ec773d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:04.571507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:04.664944 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 360/721] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:37:04.856753 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39a6cb-b670-4a3a-b837-c1db9c222f1b None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:04.857157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39a6cb-b670-4a3a-b837-c1db9c222f1b None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:04.857354 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39a6cb-b670-4a3a-b837-c1db9c222f1b None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:04.859002 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 362/722] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:04.864072 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa62f5-c630-43e9-8ee2-e161b31438f2 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:04.864356 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa62f5-c630-43e9-8ee2-e161b31438f2 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:04.864616 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa62f5-c630-43e9-8ee2-e161b31438f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:04.887193 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-fffa62f5-c630-43e9-8ee2-e161b31438f2 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:04.888474 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-fffa62f5-c630-43e9-8ee2-e161b31438f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:04.958141 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 361/723] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:37:05.116312 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39a6cb-b670-4a3a-b837-c1db9c222f1b None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:05.149724 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:05.270073 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39a6cb-b670-4a3a-b837-c1db9c222f1b None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:05.318362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2337f-e0ed-4b86-8f87-cb833881e4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:05.319407 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2337f-e0ed-4b86-8f87-cb833881e4b3 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:05.319909 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2337f-e0ed-4b86-8f87-cb833881e4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:05.320376 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f2337f-e0ed-4b86-8f87-cb833881e4b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:05.332817 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa62f5-c630-43e9-8ee2-e161b31438f2 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:05.347315 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f2337f-e0ed-4b86-8f87-cb833881e4b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:37:05.352785 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-98f2337f-e0ed-4b86-8f87-cb833881e4b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:37:05.352785 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:05.352785 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:05.352785 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:05.352785 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:05.352785 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:05.352785 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:05.352785 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:05.352785 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:05.352785 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:05.352785 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:05.352785 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:05.352785 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:37:05.352785 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:37:05.352785 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:37:05.352785 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:37:05.354303 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:37:05.354303 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:37:05.354303 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:37:05.354303 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:37:05.354303 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:05.354303 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:05.354303 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:05.354303 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:05.354303 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:05.354303 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:05.354303 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:05.354303 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:05.354303 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:05.354303 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:05.354303 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:05.354303 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:05.355118 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:05.355118 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:05.355118 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:05.355118 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:05.355118 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:37:05.355118 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:37:05.355118 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:37:05.355118 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:37:05.355118 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:37:05.355118 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:37:05.355118 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:37:05.355118 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:05.359980 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 363/724] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 24 04:37:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:37:05.364553 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2337f-e0ed-4b86-8f87-cb833881e4b3 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:05.451592 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:05.499715 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa62f5-c630-43e9-8ee2-e161b31438f2 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:05.537728 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:05.573536 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a4425-e644-442b-a4c5-08fc8427b09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:05.574982 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a4425-e644-442b-a4c5-08fc8427b09d None admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:05.576026 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a4425-e644-442b-a4c5-08fc8427b09d None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:05.576492 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a4425-e644-442b-a4c5-08fc8427b09d None admin] PATH_INFO: `/v3/services` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:05.577526 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a4425-e644-442b-a4c5-08fc8427b09d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:05.579607 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f2337f-e0ed-4b86-8f87-cb833881e4b3 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:05.581361 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a4425-e644-442b-a4c5-08fc8427b09d None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:05.611304 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 362/725] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 24 04:37:05 2022] POST /identity/v3/services => generated 251 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:37:05.652540 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2126b0a-1f99-4d8f-803f-eaf60f9a1e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:05.653609 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2126b0a-1f99-4d8f-803f-eaf60f9a1e77 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:05.654172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2126b0a-1f99-4d8f-803f-eaf60f9a1e77 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:05.654632 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2126b0a-1f99-4d8f-803f-eaf60f9a1e77 None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:05.655512 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2126b0a-1f99-4d8f-803f-eaf60f9a1e77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:05.656013 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2126b0a-1f99-4d8f-803f-eaf60f9a1e77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:05.657668 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2126b0a-1f99-4d8f-803f-eaf60f9a1e77 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:05.676594 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 364/726] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:37:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:05.682625 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a4425-e644-442b-a4c5-08fc8427b09d None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:05.823327 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a4425-e644-442b-a4c5-08fc8427b09d None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:05.859417 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384735f1-03a1-47a1-8131-2a1e21c79cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:05.860069 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384735f1-03a1-47a1-8131-2a1e21c79cbc None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:05.860346 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384735f1-03a1-47a1-8131-2a1e21c79cbc None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:05.860627 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384735f1-03a1-47a1-8131-2a1e21c79cbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:05.862770 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:05.874976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384735f1-03a1-47a1-8131-2a1e21c79cbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:05.876487 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384735f1-03a1-47a1-8131-2a1e21c79cbc None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:05.892429 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-384735f1-03a1-47a1-8131-2a1e21c79cbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:05.892429 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:05.892429 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:05.892429 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:05.892429 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:05.892429 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:05.892429 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:05.892429 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:05.892429 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:05.892429 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:05.892429 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:05.892429 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:05.892429 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:37:05.892429 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:37:05.892429 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:37:05.892429 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:37:05.893432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:05.893432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:05.893432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:05.893432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:05.893432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:05.893432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:05.893432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:05.893432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:05.893432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:05.893432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:05.893432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:05.893432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:05.893432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:05.893432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:05.893432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:05.893432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:05.893432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:37:05.894301 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:37:05.894301 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:05.894301 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:05.894301 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 363/727] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:37:05.900021 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2126b0a-1f99-4d8f-803f-eaf60f9a1e77 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:06.012013 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2126b0a-1f99-4d8f-803f-eaf60f9a1e77 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:06.050935 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d3f70-fd75-4ce9-9392-38e073a76866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:06.051706 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d3f70-fd75-4ce9-9392-38e073a76866 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:06.051992 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d3f70-fd75-4ce9-9392-38e073a76866 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:06.052265 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d3f70-fd75-4ce9-9392-38e073a76866 None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:06.052986 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d3f70-fd75-4ce9-9392-38e073a76866 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:06.053294 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d3f70-fd75-4ce9-9392-38e073a76866 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:06.054765 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d3f70-fd75-4ce9-9392-38e073a76866 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:06.064752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:06.068247 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 365/728] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:06.074085 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384735f1-03a1-47a1-8131-2a1e21c79cbc None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:06.176751 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d08bdf-7f78-439c-9729-70c4bab623d5 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:06.177081 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d08bdf-7f78-439c-9729-70c4bab623d5 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:06.177306 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d08bdf-7f78-439c-9729-70c4bab623d5 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:06.178941 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 366/729] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:06.184334 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f32666-a04d-4822-b584-82d455d9e4c4 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:06.184614 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f32666-a04d-4822-b584-82d455d9e4c4 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:06.184888 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f32666-a04d-4822-b584-82d455d9e4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:06.203368 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-d7f32666-a04d-4822-b584-82d455d9e4c4 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:06.204784 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-d7f32666-a04d-4822-b584-82d455d9e4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:06.213944 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384735f1-03a1-47a1-8131-2a1e21c79cbc None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:06.259028 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab60f29-28fd-4e82-aa26-000197d400c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:06.259867 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab60f29-28fd-4e82-aa26-000197d400c5 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:06.260217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab60f29-28fd-4e82-aa26-000197d400c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:06.260217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab60f29-28fd-4e82-aa26-000197d400c5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:06.270405 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab60f29-28fd-4e82-aa26-000197d400c5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:06.273056 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab60f29-28fd-4e82-aa26-000197d400c5 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:06.285976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-fab60f29-28fd-4e82-aa26-000197d400c5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:37:06.285976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:06.285976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:06.285976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:06.285976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:06.285976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:06.285976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:06.285976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:06.285976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:06.285976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:06.285976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:06.285976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:06.285976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:37:06.285976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:37:06.285976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:37:06.285976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:37:06.286963 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:06.286963 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:06.286963 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:37:06.286963 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:37:06.286963 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:37:06.286963 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:37:06.286963 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:06.286963 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:06.286963 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:06.286963 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:06.286963 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:06.286963 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:06.286963 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:06.286963 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:06.286963 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:06.286963 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:06.286963 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:06.286963 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:06.287873 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:06.287873 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:06.287873 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:37:06.287873 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:37:06.287873 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:37:06.287873 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:37:06.287873 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:37:06.287873 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:37:06.287873 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:37:06.287873 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:06.287873 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 364/730] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 24 04:37:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:06.289550 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15edae-d4ff-480b-8530-25c25be66ff1 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:06.290011 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15edae-d4ff-480b-8530-25c25be66ff1 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:06.290450 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15edae-d4ff-480b-8530-25c25be66ff1 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:06.292222 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 365/731] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:06.298098 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15edae-d4ff-480b-8530-25c25be66ff1 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:06.341449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 367/732] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:06 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:37:06.341449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938ae73-e162-4a7f-951b-1308c8808682 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:06.341449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938ae73-e162-4a7f-951b-1308c8808682 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:06.341449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938ae73-e162-4a7f-951b-1308c8808682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:06.379832 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-9938ae73-e162-4a7f-951b-1308c8808682 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:06.381380 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-9938ae73-e162-4a7f-951b-1308c8808682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:06.394943 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:06.470384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 368/733] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:06 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:37:06.472336 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211a3a0-2c86-436f-9b27-8b71be9d4589 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:06.472828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211a3a0-2c86-436f-9b27-8b71be9d4589 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:06.473281 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211a3a0-2c86-436f-9b27-8b71be9d4589 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:06.479151 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 369/734] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:06.482518 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fe93c-8bed-4bba-8b54-335a4ce357c1 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:06.482843 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fe93c-8bed-4bba-8b54-335a4ce357c1 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:06.483129 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39fe93c-8bed-4bba-8b54-335a4ce357c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:06.492293 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15edae-d4ff-480b-8530-25c25be66ff1 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:06.537610 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f00827-03bf-4ead-888c-7f457ff9d2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:06.538534 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-f39fe93c-8bed-4bba-8b54-335a4ce357c1 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:06.539709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f00827-03bf-4ead-888c-7f457ff9d2e0 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:06.539867 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-f39fe93c-8bed-4bba-8b54-335a4ce357c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:06.540475 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f00827-03bf-4ead-888c-7f457ff9d2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:06.540980 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f00827-03bf-4ead-888c-7f457ff9d2e0 None admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:06.541990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f00827-03bf-4ead-888c-7f457ff9d2e0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:06.542538 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f00827-03bf-4ead-888c-7f457ff9d2e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:06.544314 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f00827-03bf-4ead-888c-7f457ff9d2e0 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:06.568331 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 366/735] 10.222.0.49 () {56 vars in 1135 bytes} [Wed Aug 24 04:37:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:06.574766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f00827-03bf-4ead-888c-7f457ff9d2e0 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:06.677914 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:06.706329 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f00827-03bf-4ead-888c-7f457ff9d2e0 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:06.707486 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 370/736] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:06 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:37:06.710084 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:06.738331 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fe93c-8bed-4bba-8b54-335a4ce357c1 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:06.750481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4279c-95a9-4ead-a3bd-36e78c4d76de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:06.751458 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4279c-95a9-4ead-a3bd-36e78c4d76de None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:06.751972 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4279c-95a9-4ead-a3bd-36e78c4d76de None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:06.752445 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4279c-95a9-4ead-a3bd-36e78c4d76de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:06.878993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4279c-95a9-4ead-a3bd-36e78c4d76de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:06.880468 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4279c-95a9-4ead-a3bd-36e78c4d76de None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:06.919609 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39fe93c-8bed-4bba-8b54-335a4ce357c1 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:06.966019 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be809738-9e63-40c1-bfaa-ef9912a4bcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:06.966851 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be809738-9e63-40c1-bfaa-ef9912a4bcc6 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:06.967162 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be809738-9e63-40c1-bfaa-ef9912a4bcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:06.967935 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be809738-9e63-40c1-bfaa-ef9912a4bcc6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:06.980618 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be809738-9e63-40c1-bfaa-ef9912a4bcc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:37:06.985534 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-be809738-9e63-40c1-bfaa-ef9912a4bcc6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:37:06.985534 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:06.985534 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:06.985534 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:06.985534 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:06.985534 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:06.985534 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:06.985534 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:06.985534 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:06.985534 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:06.985534 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:06.985534 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:06.985534 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:37:06.985534 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:37:06.985534 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:37:06.985534 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:37:06.986452 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:37:06.986452 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:37:06.986452 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:37:06.986452 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:37:06.986452 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:06.986452 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:06.986452 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:06.986452 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:06.986452 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:06.986452 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:06.986452 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:06.986452 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:06.986452 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:06.986452 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:06.986452 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:06.986452 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:06.987278 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:06.987278 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:06.987278 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:06.987278 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:06.987278 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:37:06.987278 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:37:06.987278 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:37:06.987278 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:37:06.987278 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:37:06.987278 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:37:06.987278 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:37:06.987278 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:06.987278 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 371/737] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 24 04:37:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:37:06.988731 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be809738-9e63-40c1-bfaa-ef9912a4bcc6 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:06.992019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 367/738] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:37:06 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:37:06.993955 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4279c-95a9-4ead-a3bd-36e78c4d76de None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:06.997875 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:07.055234 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:07.107763 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4279c-95a9-4ead-a3bd-36e78c4d76de None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:07.117033 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be809738-9e63-40c1-bfaa-ef9912a4bcc6 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:07.150338 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da0451-652e-4656-a9f1-ecb18e35ae7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:07.154562 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da0451-652e-4656-a9f1-ecb18e35ae7d None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:07.155119 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da0451-652e-4656-a9f1-ecb18e35ae7d None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:07.155119 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da0451-652e-4656-a9f1-ecb18e35ae7d None admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:07.155861 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da0451-652e-4656-a9f1-ecb18e35ae7d None admin] RBAC: Adding query filter params (name=service) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:07.156104 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da0451-652e-4656-a9f1-ecb18e35ae7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:07.157534 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da0451-652e-4656-a9f1-ecb18e35ae7d None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:07.159598 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf76b9-2bd4-45a7-a46c-e89886167649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:07.160257 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf76b9-2bd4-45a7-a46c-e89886167649 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:07.160533 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf76b9-2bd4-45a7-a46c-e89886167649 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:07.160799 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf76b9-2bd4-45a7-a46c-e89886167649 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:07.167424 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 368/739] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 24 04:37:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:07.168453 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da0451-652e-4656-a9f1-ecb18e35ae7d None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:07.177851 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf76b9-2bd4-45a7-a46c-e89886167649 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:37:07.182802 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-5dcf76b9-2bd4-45a7-a46c-e89886167649 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:37:07.182802 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:07.182802 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:07.182802 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:07.182802 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:07.182802 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:07.182802 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:07.182802 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:07.182802 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:07.182802 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:07.182802 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:07.182802 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:07.182802 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:37:07.182802 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:37:07.182802 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:37:07.182802 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:37:07.183830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:37:07.183830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:37:07.183830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:37:07.183830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:37:07.183830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:07.183830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:07.183830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:07.183830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:07.183830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:07.183830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:07.183830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:07.183830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:07.183830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:07.183830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:07.183830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:07.183830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:07.184675 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:07.184675 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:07.184675 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:07.184675 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:07.184675 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:37:07.184675 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:37:07.184675 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:37:07.184675 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:37:07.184675 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:37:07.184675 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:37:07.184675 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:37:07.184675 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:07.189073 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 372/740] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 24 04:37:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:07.189989 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf76b9-2bd4-45a7-a46c-e89886167649 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:07.245800 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:07.281982 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da0451-652e-4656-a9f1-ecb18e35ae7d None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:07.298819 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf76b9-2bd4-45a7-a46c-e89886167649 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:07.310532 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:07.324353 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0578af-8b33-4827-81f8-36b711792811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:07.325003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0578af-8b33-4827-81f8-36b711792811 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:07.325274 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0578af-8b33-4827-81f8-36b711792811 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:07.325568 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0578af-8b33-4827-81f8-36b711792811 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:07.337532 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0578af-8b33-4827-81f8-36b711792811 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:07.339018 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0578af-8b33-4827-81f8-36b711792811 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:07.351332 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524d41d-0f1f-4dc7-9d34-fb25c4756158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:07.351995 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524d41d-0f1f-4dc7-9d34-fb25c4756158 None admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:07.352295 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524d41d-0f1f-4dc7-9d34-fb25c4756158 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:07.352893 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524d41d-0f1f-4dc7-9d34-fb25c4756158 None admin] PATH_INFO: `/v3/services` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:07.353597 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524d41d-0f1f-4dc7-9d34-fb25c4756158 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:07.354745 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-fa0578af-8b33-4827-81f8-36b711792811 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:07.354745 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:07.354745 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:07.354745 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:07.354745 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:07.354745 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:07.354745 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:07.354745 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:07.354745 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:07.354745 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:07.354745 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:07.354745 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:07.354745 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:37:07.354745 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:37:07.354745 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:37:07.354745 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:37:07.355662 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:07.355662 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:07.355662 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:07.355662 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:07.355662 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:07.355662 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:07.355662 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:07.355662 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:07.355662 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:07.355662 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:07.355662 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:07.355662 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:07.355662 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:07.355662 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:07.355662 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:07.355662 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:07.355662 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:37:07.356533 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:37:07.356533 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:07.356533 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:07.356705 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524d41d-0f1f-4dc7-9d34-fb25c4756158 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:07.356772 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 369/741] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:07.357356 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0578af-8b33-4827-81f8-36b711792811 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:07.377813 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 373/742] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 24 04:37:07 2022] POST /identity/v3/services => generated 240 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:37:07.378721 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524d41d-0f1f-4dc7-9d34-fb25c4756158 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:07.500758 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0578af-8b33-4827-81f8-36b711792811 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:07.519908 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524d41d-0f1f-4dc7-9d34-fb25c4756158 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:07.526044 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:07.547789 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4528d3-5913-4afa-a684-cfa3bf98e9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:07.548918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4528d3-5913-4afa-a684-cfa3bf98e9a1 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:07.549430 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4528d3-5913-4afa-a684-cfa3bf98e9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:07.549893 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4528d3-5913-4afa-a684-cfa3bf98e9a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:07.561723 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5659962-21e2-4684-88af-204f4b842296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:07.562384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5659962-21e2-4684-88af-204f4b842296 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:07.562621 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5659962-21e2-4684-88af-204f4b842296 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:07.562896 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5659962-21e2-4684-88af-204f4b842296 None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:07.563579 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5659962-21e2-4684-88af-204f4b842296 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:07.563881 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5659962-21e2-4684-88af-204f4b842296 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:07.564019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4528d3-5913-4afa-a684-cfa3bf98e9a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:07.565324 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5659962-21e2-4684-88af-204f4b842296 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:07.565459 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4528d3-5913-4afa-a684-cfa3bf98e9a1 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:07.575999 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 374/743] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:37:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:07.576858 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5659962-21e2-4684-88af-204f4b842296 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:07.580337 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-3f4528d3-5913-4afa-a684-cfa3bf98e9a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:07.580337 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:07.580337 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:07.580337 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:07.580337 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:07.580337 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:07.580337 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:07.580337 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:07.580337 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:07.580337 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:07.580337 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:07.580337 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:07.580337 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:37:07.580337 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:37:07.580337 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:37:07.580337 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:37:07.581575 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:07.581575 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:07.581575 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:07.581575 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:07.581575 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:07.581575 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:07.581575 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:07.581575 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:07.581575 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:07.581575 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:07.581575 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:07.581575 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:07.581575 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:07.581575 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:07.581575 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:07.581575 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:07.581575 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:37:07.582553 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:37:07.582553 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:07.582553 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:07.582553 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 370/744] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:07.584851 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4528d3-5913-4afa-a684-cfa3bf98e9a1 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:07.613766 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:07.696972 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4528d3-5913-4afa-a684-cfa3bf98e9a1 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:07.698415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5659962-21e2-4684-88af-204f4b842296 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:07.732003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386ece1-7d59-4991-ad62-bee4ef4b27d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:07.732640 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386ece1-7d59-4991-ad62-bee4ef4b27d2 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:07.732919 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386ece1-7d59-4991-ad62-bee4ef4b27d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:07.733187 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386ece1-7d59-4991-ad62-bee4ef4b27d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:07.737880 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187a047-7d0a-4c61-9894-938f0a91ce06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:07.738690 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187a047-7d0a-4c61-9894-938f0a91ce06 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:07.739108 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187a047-7d0a-4c61-9894-938f0a91ce06 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:07.739515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187a047-7d0a-4c61-9894-938f0a91ce06 None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:07.740440 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187a047-7d0a-4c61-9894-938f0a91ce06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:07.740989 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187a047-7d0a-4c61-9894-938f0a91ce06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:07.742719 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1187a047-7d0a-4c61-9894-938f0a91ce06 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:07.744433 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2386ece1-7d59-4991-ad62-bee4ef4b27d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:07.745909 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2386ece1-7d59-4991-ad62-bee4ef4b27d2 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:07.756629 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 375/745] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:07.757757 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187a047-7d0a-4c61-9894-938f0a91ce06 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:07.760832 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-2386ece1-7d59-4991-ad62-bee4ef4b27d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:07.760832 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:07.760832 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:07.760832 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:07.760832 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:07.760832 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:07.760832 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:07.760832 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:07.760832 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:07.760832 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:07.760832 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:07.760832 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:07.760832 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:37:07.760832 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:37:07.760832 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:37:07.760832 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:37:07.762019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:07.762019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:07.762019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:07.762019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:07.762019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:07.762019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:07.762019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:07.762019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:07.762019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:07.762019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:07.762019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:07.762019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:07.762019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:07.762019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:07.762019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:07.762019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:07.762019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:37:07.762988 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:37:07.762988 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:07.762988 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:07.762988 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 371/746] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:07.763217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386ece1-7d59-4991-ad62-bee4ef4b27d2 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:07.792454 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:07.860799 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:07.869710 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386ece1-7d59-4991-ad62-bee4ef4b27d2 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:07.876284 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187a047-7d0a-4c61-9894-938f0a91ce06 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:07.904216 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b77f9-3629-45db-933f-f3f15d9c814b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:07.904846 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b77f9-3629-45db-933f-f3f15d9c814b None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:07.905123 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b77f9-3629-45db-933f-f3f15d9c814b None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:07.905416 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b77f9-3629-45db-933f-f3f15d9c814b None admin] PATH_INFO: `/v3/projects/service` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:07.912597 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b77f9-3629-45db-933f-f3f15d9c814b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:07.914079 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b77f9-3629-45db-933f-f3f15d9c814b None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:07.915305 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16fc3c-29af-4aef-bf38-3063d3945347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:07.916191 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16fc3c-29af-4aef-bf38-3063d3945347 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:07.916743 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16fc3c-29af-4aef-bf38-3063d3945347 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:07.917148 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16fc3c-29af-4aef-bf38-3063d3945347 None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:07.918121 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16fc3c-29af-4aef-bf38-3063d3945347 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:07.918567 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16fc3c-29af-4aef-bf38-3063d3945347 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:07.920091 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16fc3c-29af-4aef-bf38-3063d3945347 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:07.925970 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-d99b77f9-3629-45db-933f-f3f15d9c814b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:37:07.925970 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:07.925970 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:07.925970 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:07.925970 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:07.925970 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:07.925970 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:07.925970 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:07.925970 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:07.925970 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:07.925970 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:07.925970 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:07.925970 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:37:07.925970 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:37:07.925970 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:37:07.927060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:37:07.927060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:07.927060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:07.927060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:07.927060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:07.927060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:07.927060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:07.927060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:07.927060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:07.927060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:07.927060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:07.927060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:07.927060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:07.927060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:07.927060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:07.927060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:07.927060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:07.928126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:37:07.928126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:37:07.928126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:37:07.928126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:37:07.928126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:37:07.928126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:37:07.928126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:37:07.928126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:07.928126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 372/747] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:37:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:07.928606 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b77f9-3629-45db-933f-f3f15d9c814b None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:07.937606 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 376/748] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:07.938859 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16fc3c-29af-4aef-bf38-3063d3945347 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:08.013187 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:08.035386 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b77f9-3629-45db-933f-f3f15d9c814b None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:08.051711 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16fc3c-29af-4aef-bf38-3063d3945347 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:08.071876 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a43bfb-4f76-40fb-9c5a-7d536da05bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:08.072490 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a43bfb-4f76-40fb-9c5a-7d536da05bb4 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:08.072765 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a43bfb-4f76-40fb-9c5a-7d536da05bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:08.073040 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a43bfb-4f76-40fb-9c5a-7d536da05bb4 None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:08.073739 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a43bfb-4f76-40fb-9c5a-7d536da05bb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:08.074042 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a43bfb-4f76-40fb-9c5a-7d536da05bb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:08.075413 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a43bfb-4f76-40fb-9c5a-7d536da05bb4 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:08.087325 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09362510-f0c9-4b53-a6c3-5133d8e6b051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:08.087531 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 373/749] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:08.088209 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a43bfb-4f76-40fb-9c5a-7d536da05bb4 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:08.088404 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09362510-f0c9-4b53-a6c3-5133d8e6b051 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:08.088809 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09362510-f0c9-4b53-a6c3-5133d8e6b051 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:08.089080 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09362510-f0c9-4b53-a6c3-5133d8e6b051 None admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:08.089878 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09362510-f0c9-4b53-a6c3-5133d8e6b051 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:08.090183 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09362510-f0c9-4b53-a6c3-5133d8e6b051 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:08.091618 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09362510-f0c9-4b53-a6c3-5133d8e6b051 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:08.105980 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 377/750] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 24 04:37:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:08.107237 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641b6b8-9a25-4805-bf6f-3434516a1379 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:08.107501 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641b6b8-9a25-4805-bf6f-3434516a1379 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:08.107769 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641b6b8-9a25-4805-bf6f-3434516a1379 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:08.113381 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 378/751] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:08.113381 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641b6b8-9a25-4805-bf6f-3434516a1379 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:08.122764 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:08.202942 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a43bfb-4f76-40fb-9c5a-7d536da05bb4 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:08.232735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641b6b8-9a25-4805-bf6f-3434516a1379 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:08.238951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d0378-51de-4167-ae78-e4defc3dfd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:08.239590 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d0378-51de-4167-ae78-e4defc3dfd81 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:08.240265 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d0378-51de-4167-ae78-e4defc3dfd81 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:08.240535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d0378-51de-4167-ae78-e4defc3dfd81 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:08.248902 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d0378-51de-4167-ae78-e4defc3dfd81 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:08.250403 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d0378-51de-4167-ae78-e4defc3dfd81 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:08.262367 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-cc8d0378-51de-4167-ae78-e4defc3dfd81 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:37:08.262367 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:08.262367 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:08.262367 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:08.262367 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:08.262367 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:08.262367 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:08.262367 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:08.262367 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:08.262367 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:08.262367 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:08.262367 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:08.262367 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:37:08.262367 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:37:08.262367 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:37:08.262367 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:37:08.263507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:08.263507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:08.263507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:37:08.263507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:37:08.263507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:37:08.263507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:37:08.263507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:08.263507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:08.263507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:08.263507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:08.263507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:08.263507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:08.263507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:08.263507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:08.263507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:08.263507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:08.263507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:08.263507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:08.264630 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:08.264630 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:08.264630 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:37:08.264630 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:37:08.264630 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:37:08.264630 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:37:08.264630 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:37:08.264630 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:37:08.264630 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:37:08.264630 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:08.264630 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 374/752] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Aug 24 04:37:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:08.265212 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d0378-51de-4167-ae78-e4defc3dfd81 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:08.270542 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:08.271321 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d688e-8810-45a9-be0f-0a4e4866d00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:08.272159 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d688e-8810-45a9-be0f-0a4e4866d00a None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:08.272440 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d688e-8810-45a9-be0f-0a4e4866d00a None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:08.272708 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d688e-8810-45a9-be0f-0a4e4866d00a None admin] PATH_INFO: `/v3/users/nova` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:08.280782 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d688e-8810-45a9-be0f-0a4e4866d00a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:08.282271 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503d688e-8810-45a9-be0f-0a4e4866d00a None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:08.293384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-503d688e-8810-45a9-be0f-0a4e4866d00a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:37:08.293384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:08.293384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:08.293384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:08.293384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:08.293384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:08.293384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:08.293384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:08.293384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:08.293384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:08.293384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:08.293384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:08.293384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:37:08.293384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:37:08.293384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:37:08.293384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:37:08.294320 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:08.294320 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:08.294320 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:37:08.294320 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:37:08.294320 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:37:08.294320 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:37:08.294320 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:08.294320 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:08.294320 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:08.294320 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:08.294320 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:08.294320 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:08.294320 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:08.294320 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:08.294320 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:08.294320 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:08.294320 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:08.294320 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:08.295231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:08.295231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:08.295231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:37:08.295231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:37:08.295231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:37:08.295231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:37:08.295231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:37:08.295231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:37:08.295231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:37:08.295231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:08.295231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 379/753] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Aug 24 04:37:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:08.295796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6fac7-e124-43a4-90ac-891feec3be0b None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:08.296200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6fac7-e124-43a4-90ac-891feec3be0b None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:08.296295 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6fac7-e124-43a4-90ac-891feec3be0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:08.315197 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-2bc6fac7-e124-43a4-90ac-891feec3be0b None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:08.316407 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-2bc6fac7-e124-43a4-90ac-891feec3be0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:08.384388 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:08.386052 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d0378-51de-4167-ae78-e4defc3dfd81 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:08.397786 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 380/754] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:08.397786 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6fac7-e124-43a4-90ac-891feec3be0b None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:08.431913 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491565f-d799-49b4-adbd-0230dc2345d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:08.432870 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491565f-d799-49b4-adbd-0230dc2345d5 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:08.433205 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491565f-d799-49b4-adbd-0230dc2345d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:08.433628 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491565f-d799-49b4-adbd-0230dc2345d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:08.434818 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6491565f-d799-49b4-adbd-0230dc2345d5 None admin] RBAC: Adding query filter params (role.id=74ce7b72bcc94a8a8ad65c3db928e6ac, scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62, user.id=a7ebb5105220438693118d734c9fda70) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:08.435135 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6491565f-d799-49b4-adbd-0230dc2345d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:08.436836 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6491565f-d799-49b4-adbd-0230dc2345d5 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:08.453365 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 375/755] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:37:08 2022] GET /identity/v3/role_assignments?user.id=a7ebb5105220438693118d734c9fda70&scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62&role.id=74ce7b72bcc94a8a8ad65c3db928e6ac => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:08.453365 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491565f-d799-49b4-adbd-0230dc2345d5 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:08.589830 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:08.593958 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6fac7-e124-43a4-90ac-891feec3be0b None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:08.656186 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491565f-d799-49b4-adbd-0230dc2345d5 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:08.656670 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba86d3-c04c-45cc-84cc-5f6f647ca113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:08.657292 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba86d3-c04c-45cc-84cc-5f6f647ca113 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:08.657613 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba86d3-c04c-45cc-84cc-5f6f647ca113 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:08.657884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba86d3-c04c-45cc-84cc-5f6f647ca113 None admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:08.658630 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba86d3-c04c-45cc-84cc-5f6f647ca113 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:08.658935 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba86d3-c04c-45cc-84cc-5f6f647ca113 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:08.661023 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba86d3-c04c-45cc-84cc-5f6f647ca113 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:08.685439 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 381/756] 10.222.0.49 () {56 vars in 1149 bytes} [Wed Aug 24 04:37:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:08.685439 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba86d3-c04c-45cc-84cc-5f6f647ca113 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:08.703064 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea144f-3072-4ab0-90b7-a905affe3390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:08.703993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea144f-3072-4ab0-90b7-a905affe3390 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:08.704112 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea144f-3072-4ab0-90b7-a905affe3390 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:08.704320 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea144f-3072-4ab0-90b7-a905affe3390 None admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:08.705190 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea144f-3072-4ab0-90b7-a905affe3390 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:08.705453 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea144f-3072-4ab0-90b7-a905affe3390 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:08.707059 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea144f-3072-4ab0-90b7-a905affe3390 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:08.731699 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 376/757] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Aug 24 04:37:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:08.731699 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea144f-3072-4ab0-90b7-a905affe3390 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:08.750634 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:08.796824 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba86d3-c04c-45cc-84cc-5f6f647ca113 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:08.833780 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d10ed-f8fe-4ee0-9b90-4bfdae228fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:08.834880 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d10ed-f8fe-4ee0-9b90-4bfdae228fd0 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:08.835540 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d10ed-f8fe-4ee0-9b90-4bfdae228fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:08.836014 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d10ed-f8fe-4ee0-9b90-4bfdae228fd0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:08.837087 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d10ed-f8fe-4ee0-9b90-4bfdae228fd0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:08.838757 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d10ed-f8fe-4ee0-9b90-4bfdae228fd0 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:08.841342 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea144f-3072-4ab0-90b7-a905affe3390 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:08.848231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-763d10ed-f8fe-4ee0-9b90-4bfdae228fd0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:37:08.848231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:08.848231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:37:08.848231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:37:08.848231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:37:08.848231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:37:08.848231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:37:08.848231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:08.848231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:37:08.848231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:08.848231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:37:08.848231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:08.848231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:08.848231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:08.848231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:08.848231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:08.848231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:08.849237 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:08.849237 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:08.849237 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:08.849237 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:08.849237 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:08.849237 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:08.849237 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:37:08.849237 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:37:08.849237 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:37:08.849237 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:37:08.849237 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:08.849237 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:08.849237 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:08.849237 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:08.849237 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:08.849237 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:08.850085 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:08.850085 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:08.850085 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:08.850085 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:08.850085 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:08.850085 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:08.850085 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:08.850085 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:08.850085 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:08.850085 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:08.850085 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:37:08.850085 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:08.850085 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:37:08.850085 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:08.858030 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 382/758] 10.222.0.49 () {56 vars in 1129 bytes} [Wed Aug 24 04:37:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:08.859036 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d10ed-f8fe-4ee0-9b90-4bfdae228fd0 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:08.868909 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:08.886545 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db04f7-8681-4e10-91c2-c9199830cbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:08.887780 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db04f7-8681-4e10-91c2-c9199830cbf0 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:08.888691 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db04f7-8681-4e10-91c2-c9199830cbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:08.889433 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db04f7-8681-4e10-91c2-c9199830cbf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:08.974298 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db04f7-8681-4e10-91c2-c9199830cbf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:08.975887 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db04f7-8681-4e10-91c2-c9199830cbf0 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:08.980981 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d10ed-f8fe-4ee0-9b90-4bfdae228fd0 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:09.004168 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:09.021841 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4baf5-edee-4194-90b7-e5dd4e0e158f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:09.022896 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4baf5-edee-4194-90b7-e5dd4e0e158f None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:09.023403 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4baf5-edee-4194-90b7-e5dd4e0e158f None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:09.023867 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4baf5-edee-4194-90b7-e5dd4e0e158f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:09.038073 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f4baf5-edee-4194-90b7-e5dd4e0e158f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:09.040295 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f4baf5-edee-4194-90b7-e5dd4e0e158f None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:09.056728 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-95f4baf5-edee-4194-90b7-e5dd4e0e158f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:09.056728 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:09.056728 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:09.056728 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:09.056728 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:09.056728 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:09.056728 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:09.056728 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:09.056728 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:09.056728 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:09.056728 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:09.056728 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:09.056728 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:37:09.056728 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:37:09.056728 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:37:09.056728 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:37:09.057882 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:09.057882 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:09.057882 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:09.057882 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:09.057882 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:09.057882 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:09.057882 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:09.057882 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:09.057882 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:09.057882 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:09.057882 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:09.057882 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:09.057882 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:09.057882 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:09.057882 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:09.057882 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:09.057882 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:37:09.058761 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:37:09.058761 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:09.058761 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:09.065582 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 383/759] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:09.066955 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4baf5-edee-4194-90b7-e5dd4e0e158f None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:09.183864 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4baf5-edee-4194-90b7-e5dd4e0e158f None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:09.217266 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a221d2-3c58-4766-a4c6-fce1caed435a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:09.217947 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a221d2-3c58-4766-a4c6-fce1caed435a None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:09.218222 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a221d2-3c58-4766-a4c6-fce1caed435a None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:09.218491 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a221d2-3c58-4766-a4c6-fce1caed435a None admin] PATH_INFO: `/v3/services` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:09.219127 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a221d2-3c58-4766-a4c6-fce1caed435a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:09.219422 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a221d2-3c58-4766-a4c6-fce1caed435a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:09.220824 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a221d2-3c58-4766-a4c6-fce1caed435a None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:09.229694 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 384/760] 10.222.0.49 () {56 vars in 1124 bytes} [Wed Aug 24 04:37:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:09.230663 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a221d2-3c58-4766-a4c6-fce1caed435a None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:09.251022 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 377/761] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:37:08 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:37:09.252303 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db04f7-8681-4e10-91c2-c9199830cbf0 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:09.272672 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:09.285700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:09.343356 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a221d2-3c58-4766-a4c6-fce1caed435a None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:09.379079 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cdbbb-af68-4722-9136-67503b2458e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:09.379701 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cdbbb-af68-4722-9136-67503b2458e4 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:09.379977 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cdbbb-af68-4722-9136-67503b2458e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:09.380247 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cdbbb-af68-4722-9136-67503b2458e4 None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:09.380897 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8cdbbb-af68-4722-9136-67503b2458e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:09.381198 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8cdbbb-af68-4722-9136-67503b2458e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:09.382736 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8cdbbb-af68-4722-9136-67503b2458e4 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:09.384500 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db04f7-8681-4e10-91c2-c9199830cbf0 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:09.402200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 385/762] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:09.403222 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cdbbb-af68-4722-9136-67503b2458e4 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:09.426291 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe0300-930e-49c9-90ee-b10e6475b1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:09.426833 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe0300-930e-49c9-90ee-b10e6475b1a9 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:09.427118 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe0300-930e-49c9-90ee-b10e6475b1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:09.427370 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe0300-930e-49c9-90ee-b10e6475b1a9 None admin] PATH_INFO: `/v3/services` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:09.427992 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fe0300-930e-49c9-90ee-b10e6475b1a9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:09.428349 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fe0300-930e-49c9-90ee-b10e6475b1a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:09.429750 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fe0300-930e-49c9-90ee-b10e6475b1a9 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:09.440446 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 378/763] 10.222.0.49 () {56 vars in 1124 bytes} [Wed Aug 24 04:37:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:09.440848 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3da9d-abfa-41ee-aae8-55afb9f482da None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:09.441121 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3da9d-abfa-41ee-aae8-55afb9f482da None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:09.441419 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3da9d-abfa-41ee-aae8-55afb9f482da None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:09.445971 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 379/764] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:09.445971 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3da9d-abfa-41ee-aae8-55afb9f482da None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:09.510495 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:09.518800 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cdbbb-af68-4722-9136-67503b2458e4 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:09.551059 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:09.561785 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f0227-56e6-4107-872a-c0121c2a0abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:09.562783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f0227-56e6-4107-872a-c0121c2a0abf None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:09.563232 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f0227-56e6-4107-872a-c0121c2a0abf None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:09.563513 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f0227-56e6-4107-872a-c0121c2a0abf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:09.565648 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3da9d-abfa-41ee-aae8-55afb9f482da None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:09.574461 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f0227-56e6-4107-872a-c0121c2a0abf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:09.575946 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f0227-56e6-4107-872a-c0121c2a0abf None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:09.591943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-777f0227-56e6-4107-872a-c0121c2a0abf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:09.591943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:09.591943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:09.591943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:09.591943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:09.591943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:09.591943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:09.591943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:09.591943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:09.591943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:09.591943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:09.591943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:09.591943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:37:09.591943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:37:09.591943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:37:09.591943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:37:09.593128 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:09.593128 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:09.593128 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:09.593128 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:09.593128 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:09.593128 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:09.593128 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:09.593128 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:09.593128 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:09.593128 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:09.593128 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:09.593128 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:09.593128 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:09.593128 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:09.593128 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:09.593128 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:09.593128 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:37:09.599348 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:37:09.599348 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:09.599348 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:09.599348 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 386/765] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:09.599348 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f0227-56e6-4107-872a-c0121c2a0abf None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:09.610183 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11004f35-9e30-4232-92ea-d2d270bf4142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:09.610825 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11004f35-9e30-4232-92ea-d2d270bf4142 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:09.611102 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11004f35-9e30-4232-92ea-d2d270bf4142 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:09.611368 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11004f35-9e30-4232-92ea-d2d270bf4142 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:09.618925 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11004f35-9e30-4232-92ea-d2d270bf4142 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:09.620536 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11004f35-9e30-4232-92ea-d2d270bf4142 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:09.633196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-11004f35-9e30-4232-92ea-d2d270bf4142 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:37:09.633196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:09.633196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:09.633196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:09.633196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:09.633196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:09.633196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:09.633196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:09.633196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:09.633196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:09.633196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:09.633196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:09.633196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:37:09.633196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:37:09.633196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:37:09.634326 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:37:09.634326 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:09.634326 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:09.634326 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:09.634326 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:09.634326 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:09.634326 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:09.634326 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:09.634326 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:09.634326 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:09.634326 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:09.634326 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:09.634326 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:09.634326 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:09.634326 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:09.634326 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:09.634326 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:09.635232 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:37:09.635232 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:37:09.635232 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:37:09.635232 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:37:09.635232 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:37:09.635232 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:37:09.635232 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:37:09.635232 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:09.635232 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 380/766] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:37:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:09.635698 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfe6af-7f45-4f3f-b3d1-087f24e9d831 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:09.635765 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfe6af-7f45-4f3f-b3d1-087f24e9d831 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:09.636320 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfe6af-7f45-4f3f-b3d1-087f24e9d831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:09.653500 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-52dfe6af-7f45-4f3f-b3d1-087f24e9d831 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:09.654705 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-52dfe6af-7f45-4f3f-b3d1-087f24e9d831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:09.715909 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f0227-56e6-4107-872a-c0121c2a0abf None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:09.727549 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 381/767] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:09.728215 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dfe6af-7f45-4f3f-b3d1-087f24e9d831 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:09.771426 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6752d-0e7d-4f55-92a0-9e6ff98dc7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:09.772157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6752d-0e7d-4f55-92a0-9e6ff98dc7d0 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:09.772436 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6752d-0e7d-4f55-92a0-9e6ff98dc7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:09.772821 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda6752d-0e7d-4f55-92a0-9e6ff98dc7d0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:09.773564 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6752d-0e7d-4f55-92a0-9e6ff98dc7d0 None admin] RBAC: Adding query filter params (interface=public, service_id=5d621aeb127a4672a48e20dc9e560acf, region_id=RegionOne) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:09.773868 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6752d-0e7d-4f55-92a0-9e6ff98dc7d0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:09.775270 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda6752d-0e7d-4f55-92a0-9e6ff98dc7d0 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:09.783622 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 387/768] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Aug 24 04:37:09 2022] GET /identity/v3/endpoints?service_id=5d621aeb127a4672a48e20dc9e560acf&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:09.784446 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6752d-0e7d-4f55-92a0-9e6ff98dc7d0 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:09.800304 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:09.825551 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:09.850699 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dfe6af-7f45-4f3f-b3d1-087f24e9d831 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:09.887305 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c196d18-6bc7-4223-9404-428869f98209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:09.888065 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c196d18-6bc7-4223-9404-428869f98209 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:09.888455 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c196d18-6bc7-4223-9404-428869f98209 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:09.888900 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c196d18-6bc7-4223-9404-428869f98209 None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:09.889758 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c196d18-6bc7-4223-9404-428869f98209 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:09.890154 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c196d18-6bc7-4223-9404-428869f98209 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:09.891636 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c196d18-6bc7-4223-9404-428869f98209 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:09.892381 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda6752d-0e7d-4f55-92a0-9e6ff98dc7d0 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:09.908796 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 382/769] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:09.910012 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c196d18-6bc7-4223-9404-428869f98209 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:09.928350 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70b318-8114-4c0a-8cad-3f3ee9b632b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:09.928970 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70b318-8114-4c0a-8cad-3f3ee9b632b6 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:09.929355 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70b318-8114-4c0a-8cad-3f3ee9b632b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:09.929651 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70b318-8114-4c0a-8cad-3f3ee9b632b6 None admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:09.930453 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70b318-8114-4c0a-8cad-3f3ee9b632b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:09.930761 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70b318-8114-4c0a-8cad-3f3ee9b632b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:09.932208 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70b318-8114-4c0a-8cad-3f3ee9b632b6 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:09.945549 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 388/770] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 24 04:37:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:09.946494 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70b318-8114-4c0a-8cad-3f3ee9b632b6 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:10.015239 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c196d18-6bc7-4223-9404-428869f98209 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:10.020915 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:10.055855 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70b318-8114-4c0a-8cad-3f3ee9b632b6 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:10.056336 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4407da4-5f51-4171-969e-a1ae2ccfe7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:10.056956 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4407da4-5f51-4171-969e-a1ae2ccfe7b7 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:10.057237 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4407da4-5f51-4171-969e-a1ae2ccfe7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:10.057575 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4407da4-5f51-4171-969e-a1ae2ccfe7b7 None admin] PATH_INFO: `/v3/services` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:10.058190 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4407da4-5f51-4171-969e-a1ae2ccfe7b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:10.059562 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4407da4-5f51-4171-969e-a1ae2ccfe7b7 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:10.065008 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 383/771] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Aug 24 04:37:09 2022] GET /identity/v3/services => generated 772 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:10.065812 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4407da4-5f51-4171-969e-a1ae2ccfe7b7 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:10.074956 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:10.095327 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b20752-46c9-4b9f-8615-5b71130766c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:10.096291 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b20752-46c9-4b9f-8615-5b71130766c5 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:10.096291 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b20752-46c9-4b9f-8615-5b71130766c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:10.096608 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b20752-46c9-4b9f-8615-5b71130766c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:10.106055 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b20752-46c9-4b9f-8615-5b71130766c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:10.107592 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b20752-46c9-4b9f-8615-5b71130766c5 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:10.120612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-d4b20752-46c9-4b9f-8615-5b71130766c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:37:10.120612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:10.120612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:10.120612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:10.120612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:10.120612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:10.120612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:10.120612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:10.120612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:10.120612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:10.120612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:10.120612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:10.120612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:37:10.120612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:37:10.120612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:37:10.121627 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:37:10.121627 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:10.121627 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:10.121627 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:10.121627 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:10.121627 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:10.121627 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:10.121627 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:10.121627 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:10.121627 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:10.121627 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:10.121627 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:10.121627 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:10.121627 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:10.121627 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:10.121627 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:10.121627 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:10.122510 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:37:10.122510 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:37:10.122510 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:37:10.122510 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:37:10.122510 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:37:10.122510 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:37:10.122510 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:37:10.122510 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:10.126931 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 389/772] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:37:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:10.127866 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b20752-46c9-4b9f-8615-5b71130766c5 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:10.204728 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4407da4-5f51-4171-969e-a1ae2ccfe7b7 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:10.247262 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e1c30-3a18-468f-ba77-d414a845dc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:10.248332 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e1c30-3a18-468f-ba77-d414a845dc04 None admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:10.248882 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e1c30-3a18-468f-ba77-d414a845dc04 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:10.249358 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e1c30-3a18-468f-ba77-d414a845dc04 None admin] PATH_INFO: `/v3/projects/08755f450e6c47dcaaaa754a6aa2ec62/users/9dc9a3cf381e4a2da36ed82b407a2d94/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:10.252036 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e1c30-3a18-468f-ba77-d414a845dc04 None admin] RBAC: Authorizing `identity:create_grant(project_id=08755f450e6c47dcaaaa754a6aa2ec62, user_id=9dc9a3cf381e4a2da36ed82b407a2d94, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:10.252714 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b20752-46c9-4b9f-8615-5b71130766c5 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:10.253980 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e1c30-3a18-468f-ba77-d414a845dc04 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:10.273044 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 384/773] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 24 04:37:10 2022] PUT /identity/v3/projects/08755f450e6c47dcaaaa754a6aa2ec62/users/9dc9a3cf381e4a2da36ed82b407a2d94/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:37:10.274358 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e1c30-3a18-468f-ba77-d414a845dc04 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:10.290194 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:10.296292 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8893f-d26f-4f01-8cbc-1078adb6e527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:10.297009 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8893f-d26f-4f01-8cbc-1078adb6e527 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:10.298402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8893f-d26f-4f01-8cbc-1078adb6e527 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:10.298988 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e8893f-d26f-4f01-8cbc-1078adb6e527 None admin] PATH_INFO: `/v3/services/network` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:10.299687 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e8893f-d26f-4f01-8cbc-1078adb6e527 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:10.301876 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e8893f-d26f-4f01-8cbc-1078adb6e527 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:10.313502 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-c9e8893f-d26f-4f01-8cbc-1078adb6e527 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:37:10.313502 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:10.313502 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:37:10.313502 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:37:10.313502 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:37:10.313502 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:37:10.313502 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:37:10.313502 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:10.313502 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:37:10.313502 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:10.313502 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:37:10.313502 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:10.313502 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:10.313502 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:10.313502 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:10.313502 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:10.313502 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:10.314576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:10.314576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:10.314576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:10.314576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:10.314576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:10.314576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:10.314576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:37:10.314576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:37:10.314576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:37:10.314576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:37:10.314576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:10.314576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:10.314576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:10.314576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:10.314576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:10.314576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:10.315402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:10.315402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:10.315402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:10.315402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:10.315402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:10.315402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:10.315402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:10.315402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:10.315402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:10.315402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:10.315402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:37:10.315402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:10.315402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:37:10.315402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:10.315402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 390/774] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:37:10 2022] GET /identity/v3/services/network => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:10.321973 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8893f-d26f-4f01-8cbc-1078adb6e527 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:10.362052 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:10.423222 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e1c30-3a18-468f-ba77-d414a845dc04 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:10.485638 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7f0d8-9327-4260-8ae9-26fae5aa9dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:10.486270 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7f0d8-9327-4260-8ae9-26fae5aa9dd9 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:10.486550 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7f0d8-9327-4260-8ae9-26fae5aa9dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:10.486823 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7f0d8-9327-4260-8ae9-26fae5aa9dd9 None admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:10.488054 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7f0d8-9327-4260-8ae9-26fae5aa9dd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:10.488169 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7f0d8-9327-4260-8ae9-26fae5aa9dd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:10.491798 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a7f0d8-9327-4260-8ae9-26fae5aa9dd9 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:10.499527 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e8893f-d26f-4f01-8cbc-1078adb6e527 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:10.509736 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 385/775] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 24 04:37:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:10.511359 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e78ec-a33e-4121-99bf-c7ef98a97c01 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:10.511833 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e78ec-a33e-4121-99bf-c7ef98a97c01 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:10.512295 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e78ec-a33e-4121-99bf-c7ef98a97c01 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:10.514577 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 386/776] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:10.519445 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e78ec-a33e-4121-99bf-c7ef98a97c01 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:10.538895 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2587abcd-a1aa-4d4b-8379-3c94617dacda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:10.539440 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587abcd-a1aa-4d4b-8379-3c94617dacda None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:10.539716 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587abcd-a1aa-4d4b-8379-3c94617dacda None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:10.539993 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587abcd-a1aa-4d4b-8379-3c94617dacda None admin] PATH_INFO: `/v3/services` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:10.540647 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2587abcd-a1aa-4d4b-8379-3c94617dacda None admin] RBAC: Adding query filter params (name=network) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:10.540958 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2587abcd-a1aa-4d4b-8379-3c94617dacda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:10.542456 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2587abcd-a1aa-4d4b-8379-3c94617dacda None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:10.550781 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 391/777] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 24 04:37:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:10.552026 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac96c7-92e3-4f9f-ac90-ddcc56962c2c None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:10.552305 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac96c7-92e3-4f9f-ac90-ddcc56962c2c None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:10.552574 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac96c7-92e3-4f9f-ac90-ddcc56962c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:10.576458 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-06ac96c7-92e3-4f9f-ac90-ddcc56962c2c None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:10.577756 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-06ac96c7-92e3-4f9f-ac90-ddcc56962c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:10.639629 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:10.661359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 392/778] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:10.661359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac96c7-92e3-4f9f-ac90-ddcc56962c2c None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:10.674885 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e78ec-a33e-4121-99bf-c7ef98a97c01 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:10.717042 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:10.743435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814d248-253e-44cb-aa05-5c1423801c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:10.744489 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814d248-253e-44cb-aa05-5c1423801c12 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:10.745096 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814d248-253e-44cb-aa05-5c1423801c12 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:10.745587 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814d248-253e-44cb-aa05-5c1423801c12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:10.746518 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b814d248-253e-44cb-aa05-5c1423801c12 None admin] RBAC: Adding query filter params (role.id=d62916d0c54540b3859985d5d3565718, scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62, user.id=c737c4586910476eafead0dfd4d9bc4c) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:10.749295 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b814d248-253e-44cb-aa05-5c1423801c12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:10.750996 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b814d248-253e-44cb-aa05-5c1423801c12 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:10.765253 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 387/779] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:37:10 2022] GET /identity/v3/role_assignments?user.id=c737c4586910476eafead0dfd4d9bc4c&scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62&role.id=d62916d0c54540b3859985d5d3565718 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:10.839124 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac96c7-92e3-4f9f-ac90-ddcc56962c2c None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:10.888639 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5a8bf-b095-4942-b43b-382d922da350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:10.889691 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5a8bf-b095-4942-b43b-382d922da350 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:10.890279 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5a8bf-b095-4942-b43b-382d922da350 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:10.890754 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5a8bf-b095-4942-b43b-382d922da350 None admin] PATH_INFO: `/v3/services` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:10.891613 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5a8bf-b095-4942-b43b-382d922da350 None admin] RBAC: Adding query filter params (type=network) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:10.892128 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5a8bf-b095-4942-b43b-382d922da350 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:10.893791 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5a8bf-b095-4942-b43b-382d922da350 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:10.906029 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 393/780] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 24 04:37:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:10.911956 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814d248-253e-44cb-aa05-5c1423801c12 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:11.021184 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5a8bf-b095-4942-b43b-382d922da350 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:11.048778 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814d248-253e-44cb-aa05-5c1423801c12 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:11.092607 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef6fef-4010-4b9c-b4fb-f310b424ddaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:11.092607 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef6fef-4010-4b9c-b4fb-f310b424ddaf None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:11.092607 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef6fef-4010-4b9c-b4fb-f310b424ddaf None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:11.092607 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef6fef-4010-4b9c-b4fb-f310b424ddaf None admin] PATH_INFO: `/v3/endpoints` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:11.093063 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef6fef-4010-4b9c-b4fb-f310b424ddaf None admin] RBAC: Adding query filter params (interface=public, service_id=4bba245c7b674e88aca18542de9d3b6b, region_id=RegionOne) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:11.093063 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef6fef-4010-4b9c-b4fb-f310b424ddaf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:11.093063 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef6fef-4010-4b9c-b4fb-f310b424ddaf None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:11.102062 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 388/781] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Aug 24 04:37:10 2022] GET /identity/v3/endpoints?service_id=4bba245c7b674e88aca18542de9d3b6b&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:11.107204 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef6fef-4010-4b9c-b4fb-f310b424ddaf None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:11.124254 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:11.211026 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5a8bf-b095-4942-b43b-382d922da350 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:11.217721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:11.284255 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e128df9a-9fe8-48d8-ac2d-3a979646ff4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:11.284904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128df9a-9fe8-48d8-ac2d-3a979646ff4b None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:11.285182 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128df9a-9fe8-48d8-ac2d-3a979646ff4b None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:11.285476 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128df9a-9fe8-48d8-ac2d-3a979646ff4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:11.301199 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef6fef-4010-4b9c-b4fb-f310b424ddaf None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:11.306349 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e128df9a-9fe8-48d8-ac2d-3a979646ff4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:37:11.316717 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-e128df9a-9fe8-48d8-ac2d-3a979646ff4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:37:11.316717 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:11.316717 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:11.316717 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:11.316717 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:11.316717 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:11.316717 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:11.316717 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:11.316717 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:11.316717 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:11.316717 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:11.316717 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:11.316717 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:37:11.316717 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:37:11.316717 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:37:11.316717 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:37:11.317739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:37:11.317739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:37:11.317739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:37:11.317739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:37:11.317739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:11.317739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:11.317739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:11.317739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:11.317739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:11.317739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:11.317739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:11.317739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:11.317739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:11.317739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:11.317739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:11.317739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:11.318539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:11.318539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:11.318539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:11.318539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:11.318539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:37:11.318539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:37:11.318539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:37:11.318539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:37:11.318539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:37:11.318539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:37:11.318539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:37:11.318539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:11.318539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 394/782] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 24 04:37:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:11.324176 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e128df9a-9fe8-48d8-ac2d-3a979646ff4b None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:11.347218 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448478c1-14e7-49ec-bf86-dd1c65783a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:11.348562 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448478c1-14e7-49ec-bf86-dd1c65783a7b None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:11.349027 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448478c1-14e7-49ec-bf86-dd1c65783a7b None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:11.349483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448478c1-14e7-49ec-bf86-dd1c65783a7b None admin] PATH_INFO: `/v3/services` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:11.350307 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448478c1-14e7-49ec-bf86-dd1c65783a7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:11.352693 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448478c1-14e7-49ec-bf86-dd1c65783a7b None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:11.359378 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 389/783] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Aug 24 04:37:11 2022] GET /identity/v3/services => generated 772 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:11.516107 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e128df9a-9fe8-48d8-ac2d-3a979646ff4b None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:11.535326 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:11.558544 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2225c-8d8a-42e7-9312-c6c1440ce823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:11.559195 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2225c-8d8a-42e7-9312-c6c1440ce823 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:11.559477 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2225c-8d8a-42e7-9312-c6c1440ce823 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:11.559750 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2225c-8d8a-42e7-9312-c6c1440ce823 None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:11.560460 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e2225c-8d8a-42e7-9312-c6c1440ce823 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:11.560790 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e2225c-8d8a-42e7-9312-c6c1440ce823 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:11.562383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e2225c-8d8a-42e7-9312-c6c1440ce823 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:11.577892 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 395/784] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:37:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:11.583482 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448478c1-14e7-49ec-bf86-dd1c65783a7b None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:11.691514 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448478c1-14e7-49ec-bf86-dd1c65783a7b None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:11.723937 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:11.757581 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b525e2-38a0-4dbe-b3c4-e6638b414ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:11.758646 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b525e2-38a0-4dbe-b3c4-e6638b414ebf None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:11.759118 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b525e2-38a0-4dbe-b3c4-e6638b414ebf None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:11.759578 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b525e2-38a0-4dbe-b3c4-e6638b414ebf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:11.772544 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b525e2-38a0-4dbe-b3c4-e6638b414ebf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:11.774309 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b525e2-38a0-4dbe-b3c4-e6638b414ebf None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:11.791023 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-32b525e2-38a0-4dbe-b3c4-e6638b414ebf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:11.791023 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:11.791023 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:11.791023 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:11.791023 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:11.791023 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:11.791023 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:11.791023 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:11.791023 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:11.791023 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:11.791023 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:11.791023 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:11.791023 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:37:11.791023 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:37:11.791023 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:37:11.791023 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:37:11.791990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:11.791990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:11.791990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:11.791990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:11.791990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:11.791990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:11.791990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:11.791990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:11.791990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:11.791990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:11.791990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:11.791990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:11.791990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:11.791990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:11.791990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:11.791990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:11.791990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:37:11.792869 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:37:11.792869 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:11.792869 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:11.794922 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 390/785] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:11.801019 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2225c-8d8a-42e7-9312-c6c1440ce823 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:11.948275 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2225c-8d8a-42e7-9312-c6c1440ce823 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:11.999485 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09c092-89cf-45b3-bcf9-1471f310ad30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:12.000130 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09c092-89cf-45b3-bcf9-1471f310ad30 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:12.000413 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09c092-89cf-45b3-bcf9-1471f310ad30 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:12.000688 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f09c092-89cf-45b3-bcf9-1471f310ad30 None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:12.001437 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f09c092-89cf-45b3-bcf9-1471f310ad30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:12.001755 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f09c092-89cf-45b3-bcf9-1471f310ad30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:12.003184 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f09c092-89cf-45b3-bcf9-1471f310ad30 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:12.018965 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 396/786] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:12.024666 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b525e2-38a0-4dbe-b3c4-e6638b414ebf None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:12.153532 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b525e2-38a0-4dbe-b3c4-e6638b414ebf None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:12.203323 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f84b73-78ed-40e0-a486-51bb3689e44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:12.203906 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f84b73-78ed-40e0-a486-51bb3689e44b None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:12.204185 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f84b73-78ed-40e0-a486-51bb3689e44b None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:12.204458 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f84b73-78ed-40e0-a486-51bb3689e44b None admin] PATH_INFO: `/v3/users/swift` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:12.213042 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f84b73-78ed-40e0-a486-51bb3689e44b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:12.214574 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f84b73-78ed-40e0-a486-51bb3689e44b None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:12.227751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-a4f84b73-78ed-40e0-a486-51bb3689e44b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:37:12.227751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:12.227751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:12.227751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:12.227751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:12.227751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:12.227751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:12.227751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:12.227751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:12.227751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:12.227751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:12.227751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:12.227751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:37:12.227751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:37:12.227751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:37:12.227751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:37:12.228763 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:12.228763 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:12.228763 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:37:12.228763 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:37:12.228763 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:37:12.228763 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:37:12.228763 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:12.228763 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:12.228763 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:12.228763 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:12.228763 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:12.228763 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:12.228763 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:12.228763 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:12.228763 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:12.228763 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:12.228763 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:12.228763 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:12.229805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:12.229805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:12.229805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:37:12.229805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:37:12.229805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:37:12.229805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:37:12.229805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:37:12.229805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:37:12.229805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:37:12.229805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:12.229805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 391/787] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 24 04:37:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:12.236749 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09c092-89cf-45b3-bcf9-1471f310ad30 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:12.298593 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:12.379250 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f09c092-89cf-45b3-bcf9-1471f310ad30 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:12.416539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07cc01-5fe3-4e85-897e-b7e56b7d4a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:12.417159 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07cc01-5fe3-4e85-897e-b7e56b7d4a65 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:12.417469 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07cc01-5fe3-4e85-897e-b7e56b7d4a65 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:12.417746 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07cc01-5fe3-4e85-897e-b7e56b7d4a65 None admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:12.418491 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07cc01-5fe3-4e85-897e-b7e56b7d4a65 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:12.418798 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07cc01-5fe3-4e85-897e-b7e56b7d4a65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:12.420232 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07cc01-5fe3-4e85-897e-b7e56b7d4a65 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:12.439447 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 397/788] 10.222.0.49 () {56 vars in 1135 bytes} [Wed Aug 24 04:37:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:12.445223 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f84b73-78ed-40e0-a486-51bb3689e44b None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:12.458875 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a7cf4-3954-4826-8b56-23c1032241dd None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:12.459167 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a7cf4-3954-4826-8b56-23c1032241dd None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:12.459440 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a7cf4-3954-4826-8b56-23c1032241dd None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:12.461220 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 398/789] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:12.466661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd33ae-f39a-4eae-af0f-08507d0e20f3 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:12.467213 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd33ae-f39a-4eae-af0f-08507d0e20f3 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:12.467403 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd33ae-f39a-4eae-af0f-08507d0e20f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:12.489678 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-99bd33ae-f39a-4eae-af0f-08507d0e20f3 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:12.491658 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-99bd33ae-f39a-4eae-af0f-08507d0e20f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:12.498184 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:12.619978 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 399/790] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:37:12.648087 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f84b73-78ed-40e0-a486-51bb3689e44b None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:12.654446 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034433c-50b2-443d-8fd2-428ecf8eda91 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:12.655074 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034433c-50b2-443d-8fd2-428ecf8eda91 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:12.655555 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034433c-50b2-443d-8fd2-428ecf8eda91 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:12.657195 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 400/791] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:37:12.662606 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c3bdd-0272-436b-a296-7d2ce84bdaa4 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:12.663193 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c3bdd-0272-436b-a296-7d2ce84bdaa4 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:12.663665 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c3bdd-0272-436b-a296-7d2ce84bdaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:12.695813 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-1e0c3bdd-0272-436b-a296-7d2ce84bdaa4 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:12.699004 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-1e0c3bdd-0272-436b-a296-7d2ce84bdaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:12.730463 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c2e08-d4a3-42c0-a3ec-0fda37c64a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:12.731953 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c2e08-d4a3-42c0-a3ec-0fda37c64a79 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:12.732479 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c2e08-d4a3-42c0-a3ec-0fda37c64a79 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:12.732938 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c2e08-d4a3-42c0-a3ec-0fda37c64a79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:12.746317 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c2e08-d4a3-42c0-a3ec-0fda37c64a79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:12.748257 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c2e08-d4a3-42c0-a3ec-0fda37c64a79 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:12.753699 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:12.765231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-475c2e08-d4a3-42c0-a3ec-0fda37c64a79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:12.765231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:12.765231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:12.765231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:12.765231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:12.765231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:12.765231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:12.765231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:12.765231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:12.765231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:12.765231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:12.765231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:12.765231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:37:12.765231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:37:12.765231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:37:12.765231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:37:12.766231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:12.766231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:12.766231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:12.766231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:12.766231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:12.766231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:12.766231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:12.766231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:12.766231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:12.766231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:12.766231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:12.766231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:12.766231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:12.766231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:12.766231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:12.766231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:12.766231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:37:12.767109 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:37:12.767109 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:12.767109 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:12.769488 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 392/792] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:12.775888 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c2e08-d4a3-42c0-a3ec-0fda37c64a79 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:12.868498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:12.894476 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c2e08-d4a3-42c0-a3ec-0fda37c64a79 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:12.933153 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa6aef-3123-48e3-a626-667da6f16fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:12.934149 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa6aef-3123-48e3-a626-667da6f16fff None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:12.934638 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa6aef-3123-48e3-a626-667da6f16fff None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:12.935123 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa6aef-3123-48e3-a626-667da6f16fff None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:12.935966 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa6aef-3123-48e3-a626-667da6f16fff None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:12.936454 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa6aef-3123-48e3-a626-667da6f16fff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:12.938071 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa6aef-3123-48e3-a626-667da6f16fff None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:12.949447 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 401/793] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:12.952115 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 393/794] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:12.958544 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c3bdd-0272-436b-a296-7d2ce84bdaa4 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:12.961162 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa6aef-3123-48e3-a626-667da6f16fff None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:13.098661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa6aef-3123-48e3-a626-667da6f16fff None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:13.158192 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b2e1e-a649-433b-b862-d97d06a50df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:13.158888 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b2e1e-a649-433b-b862-d97d06a50df9 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:13.159171 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b2e1e-a649-433b-b862-d97d06a50df9 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:13.159447 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b2e1e-a649-433b-b862-d97d06a50df9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:13.160443 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b2e1e-a649-433b-b862-d97d06a50df9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:13.161485 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b2e1e-a649-433b-b862-d97d06a50df9 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:13.184757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-116b2e1e-a649-433b-b862-d97d06a50df9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:37:13.184757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:13.184757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:37:13.184757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:37:13.184757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:37:13.184757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:37:13.184757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:37:13.184757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:13.184757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:37:13.184757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:13.184757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:37:13.184757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:13.184757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:13.184757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:13.184757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:13.184757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:13.184757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:13.186167 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:13.186167 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:13.186167 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:13.186167 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:13.186167 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:13.186167 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:13.186167 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:37:13.186167 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:37:13.186167 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:37:13.186167 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:37:13.186167 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:13.186167 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:13.186167 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:13.186167 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:13.186167 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:13.186167 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:13.187003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:13.187003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:13.187003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:13.187003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:13.187003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:13.187003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:13.187003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:13.187003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:13.187003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:13.187003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:13.187003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:37:13.187003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:13.187003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:37:13.187003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:13.192027 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c3bdd-0272-436b-a296-7d2ce84bdaa4 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:13.193420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 394/795] 10.222.0.49 () {56 vars in 1129 bytes} [Wed Aug 24 04:37:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:13.194530 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b2e1e-a649-433b-b862-d97d06a50df9 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:13.203929 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:13.231755 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b66a5-b122-4ca7-bba4-66a14aa48fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:13.232819 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b66a5-b122-4ca7-bba4-66a14aa48fea None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:13.233367 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b66a5-b122-4ca7-bba4-66a14aa48fea None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:13.233839 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b66a5-b122-4ca7-bba4-66a14aa48fea None admin] PATH_INFO: `/v3/projects/service` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:13.242052 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b66a5-b122-4ca7-bba4-66a14aa48fea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:13.243948 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b66a5-b122-4ca7-bba4-66a14aa48fea None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:13.257223 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-ee0b66a5-b122-4ca7-bba4-66a14aa48fea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:37:13.257223 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:13.257223 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:13.257223 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:13.257223 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:13.257223 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:13.257223 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:13.257223 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:13.257223 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:13.257223 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:13.257223 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:13.257223 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:13.257223 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:37:13.257223 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:37:13.257223 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:37:13.258365 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:37:13.258365 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:13.258365 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:13.258365 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:13.258365 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:13.258365 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:13.258365 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:13.258365 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:13.258365 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:13.258365 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:13.258365 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:13.258365 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:13.258365 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:13.258365 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:13.258365 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:13.258365 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:13.258365 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:13.259429 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:37:13.259429 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:37:13.259429 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:37:13.259429 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:37:13.259429 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:37:13.259429 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:37:13.259429 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:37:13.259429 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:13.261545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 402/796] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:37:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:13.267175 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b66a5-b122-4ca7-bba4-66a14aa48fea None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:13.284674 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:13.319687 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b2e1e-a649-433b-b862-d97d06a50df9 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:13.354094 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa409d08-6df5-4399-b6c9-5968aec3380a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:13.354714 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa409d08-6df5-4399-b6c9-5968aec3380a None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:13.355001 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa409d08-6df5-4399-b6c9-5968aec3380a None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:13.355279 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa409d08-6df5-4399-b6c9-5968aec3380a None admin] PATH_INFO: `/v3/services` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:13.356013 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa409d08-6df5-4399-b6c9-5968aec3380a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:13.356338 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa409d08-6df5-4399-b6c9-5968aec3380a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:13.357910 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa409d08-6df5-4399-b6c9-5968aec3380a None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:13.363020 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 395/797] 10.222.0.49 () {56 vars in 1124 bytes} [Wed Aug 24 04:37:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:13.364296 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5934d8-8353-4904-ad22-9b3b721336ee None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:13.364588 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5934d8-8353-4904-ad22-9b3b721336ee None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:13.364862 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5934d8-8353-4904-ad22-9b3b721336ee None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:13.366318 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 396/798] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:13.366840 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5934d8-8353-4904-ad22-9b3b721336ee None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:13.395193 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b66a5-b122-4ca7-bba4-66a14aa48fea None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:13.434778 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93f046-d152-44a1-a454-a220c795e35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:13.435420 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93f046-d152-44a1-a454-a220c795e35a None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:13.435699 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93f046-d152-44a1-a454-a220c795e35a None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:13.435969 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93f046-d152-44a1-a454-a220c795e35a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:13.450131 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93f046-d152-44a1-a454-a220c795e35a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:37:13.455023 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-1e93f046-d152-44a1-a454-a220c795e35a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:37:13.455023 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:13.455023 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:13.455023 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:13.455023 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:13.455023 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:13.455023 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:13.455023 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:13.455023 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:13.455023 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:13.455023 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:13.455023 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:13.455023 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:37:13.455023 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:37:13.455023 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:37:13.455023 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:37:13.456739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:37:13.456739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:37:13.456739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:37:13.456739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:37:13.456739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:13.456739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:13.456739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:13.456739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:13.456739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:13.456739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:13.456739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:13.456739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:13.456739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:13.456739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:13.456739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:13.456739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:13.458428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:13.458428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:13.458428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:13.458428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:13.458428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:37:13.458428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:37:13.458428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:37:13.458428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:37:13.458428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:37:13.458428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:37:13.458428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:37:13.458428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:13.458428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 403/799] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 24 04:37:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:13.461550 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:13.462702 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93f046-d152-44a1-a454-a220c795e35a None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:13.504665 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5934d8-8353-4904-ad22-9b3b721336ee None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:13.543653 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2effea2-0f24-4302-95c9-b7fd3b65884c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:13.544393 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2effea2-0f24-4302-95c9-b7fd3b65884c None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:13.544747 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2effea2-0f24-4302-95c9-b7fd3b65884c None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:13.545084 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2effea2-0f24-4302-95c9-b7fd3b65884c None admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:13.545879 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2effea2-0f24-4302-95c9-b7fd3b65884c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:13.546255 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2effea2-0f24-4302-95c9-b7fd3b65884c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:13.547777 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2effea2-0f24-4302-95c9-b7fd3b65884c None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:13.552426 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:13.560937 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 397/800] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 24 04:37:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:13.562233 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a864238-2205-493d-9668-569f46e7dd5c None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:13.562521 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a864238-2205-493d-9668-569f46e7dd5c None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:13.562785 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a864238-2205-493d-9668-569f46e7dd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:13.584666 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-1a864238-2205-493d-9668-569f46e7dd5c None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:13.585986 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-1a864238-2205-493d-9668-569f46e7dd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:13.588341 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93f046-d152-44a1-a454-a220c795e35a None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:13.636643 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a4a1f-4298-410d-a137-cfbbad18d0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:13.637172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a4a1f-4298-410d-a137-cfbbad18d0d8 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:13.637939 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a4a1f-4298-410d-a137-cfbbad18d0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:13.638217 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a4a1f-4298-410d-a137-cfbbad18d0d8 None admin] PATH_INFO: `/v3/services` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:13.638858 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a4a1f-4298-410d-a137-cfbbad18d0d8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:13.639219 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a4a1f-4298-410d-a137-cfbbad18d0d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:13.640989 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a4a1f-4298-410d-a137-cfbbad18d0d8 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:13.647311 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 404/801] 10.222.0.49 () {56 vars in 1124 bytes} [Wed Aug 24 04:37:13 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:13.648163 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a4a1f-4298-410d-a137-cfbbad18d0d8 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:13.676263 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 398/802] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:13.677225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a864238-2205-493d-9668-569f46e7dd5c None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:13.751741 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:13.775241 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a4a1f-4298-410d-a137-cfbbad18d0d8 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:13.802608 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a864238-2205-493d-9668-569f46e7dd5c None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:13.820165 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df86f398-dc0e-4135-8ab7-04ec12994d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:13.820792 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86f398-dc0e-4135-8ab7-04ec12994d15 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:13.821063 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86f398-dc0e-4135-8ab7-04ec12994d15 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:13.821350 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86f398-dc0e-4135-8ab7-04ec12994d15 None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:13.822085 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df86f398-dc0e-4135-8ab7-04ec12994d15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:13.822433 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df86f398-dc0e-4135-8ab7-04ec12994d15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:13.823854 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df86f398-dc0e-4135-8ab7-04ec12994d15 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:13.829803 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:13.835192 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 405/803] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:37:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:13.835990 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df86f398-dc0e-4135-8ab7-04ec12994d15 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:13.848555 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e23002-791d-4c1d-9c06-e815019d54f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:13.849325 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e23002-791d-4c1d-9c06-e815019d54f2 None admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:13.849695 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e23002-791d-4c1d-9c06-e815019d54f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:13.850375 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e23002-791d-4c1d-9c06-e815019d54f2 None admin] PATH_INFO: `/v3/projects/08755f450e6c47dcaaaa754a6aa2ec62/users/a7ebb5105220438693118d734c9fda70/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:13.853064 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e23002-791d-4c1d-9c06-e815019d54f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=08755f450e6c47dcaaaa754a6aa2ec62, user_id=a7ebb5105220438693118d734c9fda70, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:13.854744 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e23002-791d-4c1d-9c06-e815019d54f2 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:13.872180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 399/804] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 24 04:37:13 2022] PUT /identity/v3/projects/08755f450e6c47dcaaaa754a6aa2ec62/users/a7ebb5105220438693118d734c9fda70/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:37:13.873846 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5ab84-d954-4696-ab60-14b98fb755f3 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:13.874128 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5ab84-d954-4696-ab60-14b98fb755f3 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:13.874487 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5ab84-d954-4696-ab60-14b98fb755f3 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:13.880377 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 400/805] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:13.880377 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5ab84-d954-4696-ab60-14b98fb755f3 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:13.986149 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df86f398-dc0e-4135-8ab7-04ec12994d15 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:14.027793 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5ab84-d954-4696-ab60-14b98fb755f3 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:14.034137 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee287f25-9af0-40d6-89c6-c7a1f769383f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:14.035243 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee287f25-9af0-40d6-89c6-c7a1f769383f None admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:14.035818 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee287f25-9af0-40d6-89c6-c7a1f769383f None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:14.036339 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee287f25-9af0-40d6-89c6-c7a1f769383f None admin] PATH_INFO: `/v3/endpoints` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:14.037536 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee287f25-9af0-40d6-89c6-c7a1f769383f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:14.040204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee287f25-9af0-40d6-89c6-c7a1f769383f None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:14.050529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:14.076255 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e07cd-f9d3-40c1-888e-726a70f4d9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:14.077110 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e07cd-f9d3-40c1-888e-726a70f4d9cf None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:14.077652 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 406/806] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:37:13 2022] POST /identity/v3/endpoints => generated 346 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:37:14.077768 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e07cd-f9d3-40c1-888e-726a70f4d9cf None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:14.085465 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e07cd-f9d3-40c1-888e-726a70f4d9cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:14.085675 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1fe50-84db-4c8f-b667-98bf5f59d4f5 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:14.085675 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1fe50-84db-4c8f-b667-98bf5f59d4f5 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:14.085675 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1fe50-84db-4c8f-b667-98bf5f59d4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:14.100301 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e07cd-f9d3-40c1-888e-726a70f4d9cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:14.102385 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e07cd-f9d3-40c1-888e-726a70f4d9cf None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:14.110975 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-5db1fe50-84db-4c8f-b667-98bf5f59d4f5 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:14.112500 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-5db1fe50-84db-4c8f-b667-98bf5f59d4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:14.135529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-ad1e07cd-f9d3-40c1-888e-726a70f4d9cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:14.135529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:14.135529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:14.135529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:14.135529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:14.135529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:14.135529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:14.135529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:14.135529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:14.135529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:14.135529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:14.135529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:14.135529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:37:14.135529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:37:14.135529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:37:14.135529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:37:14.136851 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:14.136851 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:14.136851 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:14.136851 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:14.136851 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:14.136851 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:14.136851 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:14.136851 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:14.136851 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:14.136851 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:14.136851 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:14.136851 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:14.136851 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:14.136851 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:14.136851 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:14.136851 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:14.136851 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:37:14.138099 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:37:14.138099 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:14.138099 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:14.139463 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 401/807] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:14.144366 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e07cd-f9d3-40c1-888e-726a70f4d9cf None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:14.205801 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:14.226396 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 407/808] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:14.228145 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1fe50-84db-4c8f-b667-98bf5f59d4f5 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:14.285830 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e07cd-f9d3-40c1-888e-726a70f4d9cf None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:14.333200 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb203c-f32e-4ca2-9d62-3d243b0fc8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:14.333894 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb203c-f32e-4ca2-9d62-3d243b0fc8a8 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:14.334455 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb203c-f32e-4ca2-9d62-3d243b0fc8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:14.334737 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb203c-f32e-4ca2-9d62-3d243b0fc8a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:14.346865 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1fe50-84db-4c8f-b667-98bf5f59d4f5 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:14.353084 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb203c-f32e-4ca2-9d62-3d243b0fc8a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:37:14.359022 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-74bb203c-f32e-4ca2-9d62-3d243b0fc8a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:37:14.359022 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:14.359022 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:14.359022 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:14.359022 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:14.359022 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:14.359022 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:14.359022 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:14.359022 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:14.359022 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:14.359022 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:14.359022 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:14.359022 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:37:14.359022 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:37:14.359022 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:37:14.359022 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:37:14.360530 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:37:14.360530 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:37:14.360530 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:37:14.360530 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:37:14.360530 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:14.360530 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:14.360530 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:14.360530 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:14.360530 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:14.360530 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:14.360530 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:14.360530 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:14.360530 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:14.360530 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:14.360530 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:14.360530 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:14.362103 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:14.362103 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:14.362103 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:14.362103 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:14.362103 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:37:14.362103 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:37:14.362103 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:37:14.362103 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:37:14.362103 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:37:14.362103 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:37:14.362103 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:37:14.362103 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:14.362103 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 402/809] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 24 04:37:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:14.367357 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb203c-f32e-4ca2-9d62-3d243b0fc8a8 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:14.401995 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac953a2-7025-4cb7-b2bd-5f5cb9435012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:14.402648 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac953a2-7025-4cb7-b2bd-5f5cb9435012 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:14.402925 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac953a2-7025-4cb7-b2bd-5f5cb9435012 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:14.403192 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac953a2-7025-4cb7-b2bd-5f5cb9435012 None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:14.403853 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac953a2-7025-4cb7-b2bd-5f5cb9435012 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:14.404566 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac953a2-7025-4cb7-b2bd-5f5cb9435012 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:14.405673 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac953a2-7025-4cb7-b2bd-5f5cb9435012 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:14.407576 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:14.419324 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 408/810] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:14.426485 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac953a2-7025-4cb7-b2bd-5f5cb9435012 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:14.493607 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:14.527876 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb203c-f32e-4ca2-9d62-3d243b0fc8a8 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:14.603026 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a06468-33b9-41b3-8527-d2b3430000a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:14.603769 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a06468-33b9-41b3-8527-d2b3430000a8 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:14.604051 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a06468-33b9-41b3-8527-d2b3430000a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:14.604324 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a06468-33b9-41b3-8527-d2b3430000a8 None admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:14.605032 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a06468-33b9-41b3-8527-d2b3430000a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:14.605369 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a06468-33b9-41b3-8527-d2b3430000a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:14.606828 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a06468-33b9-41b3-8527-d2b3430000a8 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:14.617665 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 403/811] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 24 04:37:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:14.618593 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a06468-33b9-41b3-8527-d2b3430000a8 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:14.730395 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac953a2-7025-4cb7-b2bd-5f5cb9435012 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:14.733395 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:14.750192 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a06468-33b9-41b3-8527-d2b3430000a8 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:14.780447 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac53ee5-0131-4e53-96e2-f242f71b3efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:14.782119 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac53ee5-0131-4e53-96e2-f242f71b3efe None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:14.782643 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac53ee5-0131-4e53-96e2-f242f71b3efe None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:14.783049 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac53ee5-0131-4e53-96e2-f242f71b3efe None admin] PATH_INFO: `/v3/users/nova` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:14.789813 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547039d8-4211-4255-8482-6df686c4f36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:14.790590 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547039d8-4211-4255-8482-6df686c4f36e None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:14.791000 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547039d8-4211-4255-8482-6df686c4f36e None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:14.791366 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547039d8-4211-4255-8482-6df686c4f36e None admin] PATH_INFO: `/v3/services/network` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:14.792067 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547039d8-4211-4255-8482-6df686c4f36e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:14.793625 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547039d8-4211-4255-8482-6df686c4f36e None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:14.793984 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac53ee5-0131-4e53-96e2-f242f71b3efe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:14.795869 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac53ee5-0131-4e53-96e2-f242f71b3efe None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:14.803955 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-547039d8-4211-4255-8482-6df686c4f36e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:37:14.803955 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:14.803955 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:37:14.803955 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:37:14.803955 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:37:14.803955 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:37:14.803955 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:37:14.803955 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:14.803955 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:37:14.803955 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:14.803955 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:37:14.803955 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:14.803955 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:14.803955 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:14.803955 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:14.803955 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:14.803955 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:14.805107 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:14.805107 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:14.805107 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:14.805107 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:14.805107 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:14.805107 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:14.805107 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:37:14.805107 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:37:14.805107 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:37:14.805107 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:37:14.805107 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:14.805107 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:14.805107 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:14.805107 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:14.805107 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:14.805107 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:14.806000 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:14.806000 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:14.806000 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:14.806000 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:14.806000 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:14.806000 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:14.806000 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:14.806000 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:14.806000 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:14.806000 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:14.806000 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:37:14.806000 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:14.806000 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:37:14.806000 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:14.806000 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 404/812] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:37:14 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:14.806867 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547039d8-4211-4255-8482-6df686c4f36e None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:14.813441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-4ac53ee5-0131-4e53-96e2-f242f71b3efe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:37:14.813441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:14.813441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:14.813441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:14.813441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:14.813441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:14.813441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:14.813441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:14.813441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:14.813441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:14.813441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:14.813441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:14.813441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:37:14.813441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:37:14.813441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:37:14.813441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:37:14.814606 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:14.814606 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:14.814606 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:37:14.814606 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:37:14.814606 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:37:14.814606 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:37:14.814606 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:14.814606 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:14.814606 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:14.814606 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:14.814606 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:14.814606 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:14.814606 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:14.814606 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:14.814606 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:14.814606 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:14.814606 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:14.814606 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:14.815749 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:14.815749 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:14.815749 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:37:14.815749 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:37:14.815749 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:37:14.815749 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:37:14.815749 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:37:14.815749 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:37:14.815749 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:37:14.815749 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:14.822713 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 409/813] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Aug 24 04:37:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:14.822713 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac53ee5-0131-4e53-96e2-f242f71b3efe None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:14.927926 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547039d8-4211-4255-8482-6df686c4f36e None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:14.953129 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac53ee5-0131-4e53-96e2-f242f71b3efe None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:14.965734 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:14.978940 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9c185-0fc4-4ae1-890b-75674c21b4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:14.979787 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9c185-0fc4-4ae1-890b-75674c21b4c5 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:14.980447 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9c185-0fc4-4ae1-890b-75674c21b4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:14.980829 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9c185-0fc4-4ae1-890b-75674c21b4c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:14.993176 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6968ab5e-6a53-4e21-82ab-1a245deab29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:14.994465 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968ab5e-6a53-4e21-82ab-1a245deab29f None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:14.994886 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968ab5e-6a53-4e21-82ab-1a245deab29f None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:14.995304 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968ab5e-6a53-4e21-82ab-1a245deab29f None admin] PATH_INFO: `/v3/services` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:14.995617 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9c185-0fc4-4ae1-890b-75674c21b4c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:14.996260 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6968ab5e-6a53-4e21-82ab-1a245deab29f None admin] RBAC: Adding query filter params (name=network) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:14.996696 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6968ab5e-6a53-4e21-82ab-1a245deab29f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:14.997421 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9c185-0fc4-4ae1-890b-75674c21b4c5 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:14.998423 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6968ab5e-6a53-4e21-82ab-1a245deab29f None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:15.003641 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 410/814] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 24 04:37:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:15.004749 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6968ab5e-6a53-4e21-82ab-1a245deab29f None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:15.020926 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-bae9c185-0fc4-4ae1-890b-75674c21b4c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:15.020926 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:15.020926 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:15.020926 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:15.020926 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:15.020926 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:15.020926 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:15.020926 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:15.020926 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:15.020926 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:15.020926 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:15.020926 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:15.020926 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:37:15.020926 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:37:15.020926 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:37:15.020926 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:37:15.022225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:15.022225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:15.022225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:15.022225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:15.022225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:15.022225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:15.022225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:15.022225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:15.022225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:15.022225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:15.022225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:15.022225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:15.022225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:15.022225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:15.022225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:15.022225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:15.022225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:37:15.023348 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:37:15.023348 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:15.023348 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:15.029304 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 405/815] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:15.029304 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9c185-0fc4-4ae1-890b-75674c21b4c5 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:15.037676 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:15.145067 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9c185-0fc4-4ae1-890b-75674c21b4c5 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:15.146148 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6968ab5e-6a53-4e21-82ab-1a245deab29f None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:15.182376 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86947ad2-6de6-4e75-b417-c0f0b2246b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:15.183340 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86947ad2-6de6-4e75-b417-c0f0b2246b98 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:15.183780 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86947ad2-6de6-4e75-b417-c0f0b2246b98 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:15.184196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86947ad2-6de6-4e75-b417-c0f0b2246b98 None admin] PATH_INFO: `/v3/services` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:15.184980 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86947ad2-6de6-4e75-b417-c0f0b2246b98 None admin] RBAC: Adding query filter params (type=network) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:15.185460 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86947ad2-6de6-4e75-b417-c0f0b2246b98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:15.187067 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86947ad2-6de6-4e75-b417-c0f0b2246b98 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:15.193232 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 406/816] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 24 04:37:15 2022] GET /identity/v3/services?type=network => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:15.194414 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86947ad2-6de6-4e75-b417-c0f0b2246b98 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:15.195209 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da0a32-7a53-4c26-846a-45c5c2af332c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:15.195957 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da0a32-7a53-4c26-846a-45c5c2af332c None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:15.196342 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da0a32-7a53-4c26-846a-45c5c2af332c None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:15.196720 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da0a32-7a53-4c26-846a-45c5c2af332c None admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:15.197813 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da0a32-7a53-4c26-846a-45c5c2af332c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:15.198084 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da0a32-7a53-4c26-846a-45c5c2af332c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:15.200820 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da0a32-7a53-4c26-846a-45c5c2af332c None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:15.227037 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 411/817] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Aug 24 04:37:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:15.228473 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da0a32-7a53-4c26-846a-45c5c2af332c None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:15.261066 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:15.278493 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:15.314247 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86947ad2-6de6-4e75-b417-c0f0b2246b98 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:15.357492 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0083252-2c26-45f4-8a03-5abb5b2772ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:15.357492 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0083252-2c26-45f4-8a03-5abb5b2772ab None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:15.357492 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0083252-2c26-45f4-8a03-5abb5b2772ab None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:15.357492 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0083252-2c26-45f4-8a03-5abb5b2772ab None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:15.357931 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0083252-2c26-45f4-8a03-5abb5b2772ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:15.357931 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0083252-2c26-45f4-8a03-5abb5b2772ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:15.357931 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0083252-2c26-45f4-8a03-5abb5b2772ab None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:15.358112 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da0a32-7a53-4c26-846a-45c5c2af332c None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:15.369227 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 407/818] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:15.370196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0083252-2c26-45f4-8a03-5abb5b2772ab None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:15.403414 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cbcb70-5331-45b9-a75c-bd19e379e79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:15.404143 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbcb70-5331-45b9-a75c-bd19e379e79e None admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:15.404494 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbcb70-5331-45b9-a75c-bd19e379e79e None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:15.404837 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cbcb70-5331-45b9-a75c-bd19e379e79e None admin] PATH_INFO: `/v3/endpoints` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:15.406050 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cbcb70-5331-45b9-a75c-bd19e379e79e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:15.408543 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cbcb70-5331-45b9-a75c-bd19e379e79e None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:15.437378 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 412/819] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:37:15 2022] POST /identity/v3/endpoints => generated 337 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:37:15.438277 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cbcb70-5331-45b9-a75c-bd19e379e79e None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:15.555956 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0083252-2c26-45f4-8a03-5abb5b2772ab None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:15.565106 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:15.599565 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cbcb70-5331-45b9-a75c-bd19e379e79e None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:15.640405 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:15.644841 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf80d9b-24c0-4f3a-ad70-ab0a816e874f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:15.645678 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf80d9b-24c0-4f3a-ad70-ab0a816e874f None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:15.646113 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf80d9b-24c0-4f3a-ad70-ab0a816e874f None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:15.647276 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf80d9b-24c0-4f3a-ad70-ab0a816e874f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:15.651374 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fd870-d24c-4a6a-adbb-9a86fbf08516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:15.652254 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fd870-d24c-4a6a-adbb-9a86fbf08516 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:15.652734 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fd870-d24c-4a6a-adbb-9a86fbf08516 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:15.653197 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fd870-d24c-4a6a-adbb-9a86fbf08516 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:15.656448 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf80d9b-24c0-4f3a-ad70-ab0a816e874f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:15.659918 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf80d9b-24c0-4f3a-ad70-ab0a816e874f None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:15.674594 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-6bf80d9b-24c0-4f3a-ad70-ab0a816e874f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:37:15.674594 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:15.674594 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:15.674594 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:15.674594 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:15.674594 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:15.674594 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:15.674594 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:15.674594 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:15.674594 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:15.674594 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:15.674594 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:15.674594 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:37:15.674594 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:37:15.674594 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:37:15.674594 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:37:15.675596 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:15.675596 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:15.675596 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:37:15.675596 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:37:15.675596 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:37:15.675596 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:37:15.675596 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:15.675596 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:15.675596 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:15.675596 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:15.675596 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:15.675596 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:15.675596 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:15.675596 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:15.675596 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:15.675596 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:15.675596 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:15.675596 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:15.676551 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:15.676551 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:15.676551 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:37:15.676551 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:37:15.676551 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:37:15.676551 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:37:15.676551 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:37:15.676551 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:37:15.676551 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:37:15.676551 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:15.676551 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 413/820] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Aug 24 04:37:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:15.681619 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf80d9b-24c0-4f3a-ad70-ab0a816e874f None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:15.746886 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077fd870-d24c-4a6a-adbb-9a86fbf08516 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:15.748537 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077fd870-d24c-4a6a-adbb-9a86fbf08516 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:15.812236 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf80d9b-24c0-4f3a-ad70-ab0a816e874f None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:15.853736 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f631e3-0043-43c3-93d3-2febd2970874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:15.854504 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f631e3-0043-43c3-93d3-2febd2970874 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:15.854878 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f631e3-0043-43c3-93d3-2febd2970874 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:15.855244 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f631e3-0043-43c3-93d3-2febd2970874 None admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:15.856093 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f631e3-0043-43c3-93d3-2febd2970874 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:15.856494 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f631e3-0043-43c3-93d3-2febd2970874 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:15.858127 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f631e3-0043-43c3-93d3-2febd2970874 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:15.861774 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:15.880209 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 414/821] 10.222.0.49 () {56 vars in 1149 bytes} [Wed Aug 24 04:37:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:15.885373 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f631e3-0043-43c3-93d3-2febd2970874 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:15.930411 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 408/822] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:37:15 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:37:15.930411 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23dd77-f4e9-4192-9013-274ed3645441 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:15.930411 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23dd77-f4e9-4192-9013-274ed3645441 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:15.930411 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23dd77-f4e9-4192-9013-274ed3645441 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:15.931120 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 409/823] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:15.931700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23dd77-f4e9-4192-9013-274ed3645441 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:15.965511 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:15.998463 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f631e3-0043-43c3-93d3-2febd2970874 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:16.040075 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d37e60-84de-417d-8e27-1b9fd6945935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:16.040769 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d37e60-84de-417d-8e27-1b9fd6945935 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:16.041050 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d37e60-84de-417d-8e27-1b9fd6945935 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:16.041303 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d37e60-84de-417d-8e27-1b9fd6945935 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:16.042304 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23dd77-f4e9-4192-9013-274ed3645441 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:16.052885 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d37e60-84de-417d-8e27-1b9fd6945935 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:16.054613 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d37e60-84de-417d-8e27-1b9fd6945935 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:16.070157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-42d37e60-84de-417d-8e27-1b9fd6945935 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:16.070157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:16.070157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:16.070157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:16.070157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:16.070157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:16.070157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:16.070157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:16.070157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:16.070157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:16.070157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:16.070157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:16.070157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:37:16.070157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:37:16.070157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:37:16.070157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:37:16.071330 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:16.071330 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:16.071330 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:16.071330 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:16.071330 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:16.071330 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:16.071330 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:16.071330 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:16.071330 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:16.071330 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:16.071330 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:16.071330 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:16.071330 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:16.071330 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:16.071330 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:16.071330 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:16.071330 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:37:16.072294 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:37:16.072294 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:16.072294 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:16.072294 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 415/824] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:37:16.072932 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129c501-6ffd-4bb8-9bfb-8c8a6eaa38eb None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:16.073052 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129c501-6ffd-4bb8-9bfb-8c8a6eaa38eb None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:16.073238 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129c501-6ffd-4bb8-9bfb-8c8a6eaa38eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:16.083831 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f840e08-32ae-40eb-a82a-d1ee87dcb30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:16.084461 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f840e08-32ae-40eb-a82a-d1ee87dcb30e None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:16.084734 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f840e08-32ae-40eb-a82a-d1ee87dcb30e None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:16.085000 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f840e08-32ae-40eb-a82a-d1ee87dcb30e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:16.092781 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-8129c501-6ffd-4bb8-9bfb-8c8a6eaa38eb None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:16.094834 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-8129c501-6ffd-4bb8-9bfb-8c8a6eaa38eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:16.095967 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f840e08-32ae-40eb-a82a-d1ee87dcb30e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:16.097471 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f840e08-32ae-40eb-a82a-d1ee87dcb30e None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:16.113299 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-7f840e08-32ae-40eb-a82a-d1ee87dcb30e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:16.113299 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:16.113299 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:16.113299 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:16.113299 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:16.113299 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:16.113299 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:16.113299 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:16.113299 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:16.113299 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:16.113299 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:16.113299 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:16.113299 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:37:16.113299 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:37:16.113299 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:37:16.113299 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:37:16.114483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:16.114483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:16.114483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:16.114483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:16.114483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:16.114483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:16.114483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:16.114483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:16.114483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:16.114483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:16.114483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:16.114483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:16.114483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:16.114483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:16.114483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:16.114483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:16.114483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:37:16.115634 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:37:16.115634 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:16.115634 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:16.119014 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 410/825] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:16.119881 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f840e08-32ae-40eb-a82a-d1ee87dcb30e None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:16.152220 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:16.181892 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 416/826] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:16.182789 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129c501-6ffd-4bb8-9bfb-8c8a6eaa38eb None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:16.241748 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:16.245906 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f840e08-32ae-40eb-a82a-d1ee87dcb30e None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:16.285261 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652defe-b744-4545-9ec8-afa7f4f28a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:16.286424 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652defe-b744-4545-9ec8-afa7f4f28a72 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:16.286669 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129c501-6ffd-4bb8-9bfb-8c8a6eaa38eb None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:16.287145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652defe-b744-4545-9ec8-afa7f4f28a72 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:16.287639 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652defe-b744-4545-9ec8-afa7f4f28a72 None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:16.288614 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652defe-b744-4545-9ec8-afa7f4f28a72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:16.289091 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652defe-b744-4545-9ec8-afa7f4f28a72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:16.290863 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652defe-b744-4545-9ec8-afa7f4f28a72 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:16.309043 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 411/827] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:37:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:16.310877 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652defe-b744-4545-9ec8-afa7f4f28a72 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:16.324683 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff431843-a2af-4573-b6e2-910427fb5e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:16.325538 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff431843-a2af-4573-b6e2-910427fb5e7a None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:16.325752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff431843-a2af-4573-b6e2-910427fb5e7a None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:16.326023 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff431843-a2af-4573-b6e2-910427fb5e7a None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:16.326692 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff431843-a2af-4573-b6e2-910427fb5e7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:16.327044 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff431843-a2af-4573-b6e2-910427fb5e7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:16.328495 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff431843-a2af-4573-b6e2-910427fb5e7a None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:16.348132 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 417/828] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:37:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:16.349071 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff431843-a2af-4573-b6e2-910427fb5e7a None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:16.390628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:16.425587 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652defe-b744-4545-9ec8-afa7f4f28a72 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:16.462835 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8eee9-e842-4bfe-9eab-99f4041afb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:16.463403 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff431843-a2af-4573-b6e2-910427fb5e7a None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:16.463567 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8eee9-e842-4bfe-9eab-99f4041afb37 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:16.463829 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8eee9-e842-4bfe-9eab-99f4041afb37 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:16.464104 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8eee9-e842-4bfe-9eab-99f4041afb37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:16.472960 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8eee9-e842-4bfe-9eab-99f4041afb37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:16.474876 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8eee9-e842-4bfe-9eab-99f4041afb37 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:16.487764 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-85a8eee9-e842-4bfe-9eab-99f4041afb37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:37:16.487764 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:16.487764 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:16.487764 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:16.487764 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:16.487764 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:16.487764 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:16.487764 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:16.487764 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:16.487764 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:16.487764 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:16.487764 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:16.487764 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:37:16.487764 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:37:16.487764 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:37:16.488806 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:37:16.488806 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:16.488806 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:16.488806 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:16.488806 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:16.488806 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:16.488806 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:16.488806 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:16.488806 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:16.488806 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:16.488806 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:16.488806 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:16.488806 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:16.488806 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:16.488806 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:16.488806 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:16.488806 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:16.489739 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:37:16.489739 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:37:16.489739 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:37:16.489739 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:37:16.489739 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:37:16.489739 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:37:16.489739 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:37:16.489739 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:16.489739 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 412/829] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:37:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:37:16.490275 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc546fd-96d6-46e9-a29d-3182e899bec0 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:16.490468 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc546fd-96d6-46e9-a29d-3182e899bec0 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:16.490690 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc546fd-96d6-46e9-a29d-3182e899bec0 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:16.492068 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 413/830] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:16.493221 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc546fd-96d6-46e9-a29d-3182e899bec0 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:16.496794 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:16.505775 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4521b5f7-77d3-477e-b8e2-d1873adf1807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:16.506408 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521b5f7-77d3-477e-b8e2-d1873adf1807 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:16.506683 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521b5f7-77d3-477e-b8e2-d1873adf1807 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:16.506954 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4521b5f7-77d3-477e-b8e2-d1873adf1807 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:16.514124 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4521b5f7-77d3-477e-b8e2-d1873adf1807 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:16.515617 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4521b5f7-77d3-477e-b8e2-d1873adf1807 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:16.527835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-4521b5f7-77d3-477e-b8e2-d1873adf1807 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:37:16.527835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:16.527835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:16.527835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:16.527835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:16.527835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:16.527835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:16.527835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:16.527835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:16.527835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:16.527835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:16.527835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:16.527835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:37:16.527835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:37:16.527835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:37:16.528958 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:37:16.528958 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:16.528958 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:16.528958 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:16.528958 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:16.528958 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:16.528958 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:16.528958 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:16.528958 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:16.528958 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:16.528958 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:16.528958 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:16.528958 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:16.528958 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:16.528958 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:16.528958 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:16.528958 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:16.530011 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:37:16.530011 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:37:16.530011 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:37:16.530011 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:37:16.530011 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:37:16.530011 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:37:16.530011 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:37:16.530011 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:16.530011 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 418/831] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:37:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:16.530495 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4521b5f7-77d3-477e-b8e2-d1873adf1807 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:16.605733 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc546fd-96d6-46e9-a29d-3182e899bec0 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:16.629674 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:16.636819 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4521b5f7-77d3-477e-b8e2-d1873adf1807 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:16.642033 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d6edf4-b195-4d58-ad4b-f5ce2def1513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:16.642674 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6edf4-b195-4d58-ad4b-f5ce2def1513 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:16.642947 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6edf4-b195-4d58-ad4b-f5ce2def1513 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:16.643215 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6edf4-b195-4d58-ad4b-f5ce2def1513 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:16.654090 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d6edf4-b195-4d58-ad4b-f5ce2def1513 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:37:16.658783 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-53d6edf4-b195-4d58-ad4b-f5ce2def1513 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:37:16.658783 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:16.658783 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:16.658783 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:16.658783 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:16.658783 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:16.658783 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:16.658783 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:16.658783 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:16.658783 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:16.658783 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:16.658783 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:16.658783 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:37:16.658783 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:37:16.658783 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:37:16.658783 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:37:16.659891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:37:16.659891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:37:16.659891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:37:16.659891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:37:16.659891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:16.659891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:16.659891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:16.659891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:16.659891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:16.659891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:16.659891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:16.659891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:16.659891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:16.659891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:16.659891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:16.659891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:16.660767 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:16.660767 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:16.660767 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:16.660767 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:16.660767 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:37:16.660767 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:37:16.660767 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:37:16.660767 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:37:16.660767 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:37:16.660767 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:37:16.660767 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:37:16.660767 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:16.660767 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 414/832] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 24 04:37:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:16.661522 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd5e21-a237-4304-9dd6-1f1b0b60125f None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:16.661522 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd5e21-a237-4304-9dd6-1f1b0b60125f None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:16.661651 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd5e21-a237-4304-9dd6-1f1b0b60125f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:16.675183 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67800315-4ac5-4f06-92b6-443edf2c208d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:16.675793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67800315-4ac5-4f06-92b6-443edf2c208d None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:16.676066 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67800315-4ac5-4f06-92b6-443edf2c208d None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:16.676329 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67800315-4ac5-4f06-92b6-443edf2c208d None admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:16.677034 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67800315-4ac5-4f06-92b6-443edf2c208d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:16.677343 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67800315-4ac5-4f06-92b6-443edf2c208d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:16.678797 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67800315-4ac5-4f06-92b6-443edf2c208d None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:16.679242 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-30fd5e21-a237-4304-9dd6-1f1b0b60125f None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:16.680444 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-30fd5e21-a237-4304-9dd6-1f1b0b60125f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:16.691740 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 419/833] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 24 04:37:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:16.692626 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67800315-4ac5-4f06-92b6-443edf2c208d None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:16.747803 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:16.760522 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 415/834] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:16.761513 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd5e21-a237-4304-9dd6-1f1b0b60125f None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:16.804762 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67800315-4ac5-4f06-92b6-443edf2c208d None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:16.841771 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e156c6-ae72-4374-b275-cab3aa109b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:16.842692 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e156c6-ae72-4374-b275-cab3aa109b90 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:16.842692 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e156c6-ae72-4374-b275-cab3aa109b90 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:16.842923 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e156c6-ae72-4374-b275-cab3aa109b90 None admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:16.843615 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e156c6-ae72-4374-b275-cab3aa109b90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:16.843921 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e156c6-ae72-4374-b275-cab3aa109b90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:16.845837 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e156c6-ae72-4374-b275-cab3aa109b90 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:16.863703 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 420/835] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 24 04:37:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:16.863703 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e156c6-ae72-4374-b275-cab3aa109b90 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:16.874759 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd5e21-a237-4304-9dd6-1f1b0b60125f None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:16.880624 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:16.911872 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb985bf-81ec-405f-adad-fd36162ddc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:16.912507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb985bf-81ec-405f-adad-fd36162ddc54 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:16.912788 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb985bf-81ec-405f-adad-fd36162ddc54 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:16.913058 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb985bf-81ec-405f-adad-fd36162ddc54 None admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:16.913771 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb985bf-81ec-405f-adad-fd36162ddc54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:16.914080 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb985bf-81ec-405f-adad-fd36162ddc54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:16.915529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb985bf-81ec-405f-adad-fd36162ddc54 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:16.924214 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 416/836] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:37:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:16.925017 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb985bf-81ec-405f-adad-fd36162ddc54 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:16.978820 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e156c6-ae72-4374-b275-cab3aa109b90 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:16.981510 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:17.016444 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee44d2-3835-459c-922e-614ece896715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:17.017211 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee44d2-3835-459c-922e-614ece896715 None admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:17.017420 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee44d2-3835-459c-922e-614ece896715 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:17.017697 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee44d2-3835-459c-922e-614ece896715 None admin] PATH_INFO: `/v3/projects/08755f450e6c47dcaaaa754a6aa2ec62/users/c737c4586910476eafead0dfd4d9bc4c/roles/d62916d0c54540b3859985d5d3565718` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:17.033903 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee44d2-3835-459c-922e-614ece896715 None admin] RBAC: Authorizing `identity:create_grant(project_id=08755f450e6c47dcaaaa754a6aa2ec62, user_id=c737c4586910476eafead0dfd4d9bc4c, role_id=d62916d0c54540b3859985d5d3565718)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:17.034403 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb985bf-81ec-405f-adad-fd36162ddc54 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:17.035403 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ee44d2-3835-459c-922e-614ece896715 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:17.052058 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 421/837] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 24 04:37:16 2022] PUT /identity/v3/projects/08755f450e6c47dcaaaa754a6aa2ec62/users/c737c4586910476eafead0dfd4d9bc4c/roles/d62916d0c54540b3859985d5d3565718 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:37:17.053062 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee44d2-3835-459c-922e-614ece896715 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:17.087588 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e008ab-44e6-4813-9339-a924c84dbfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:17.088216 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e008ab-44e6-4813-9339-a924c84dbfad None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:17.088499 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e008ab-44e6-4813-9339-a924c84dbfad None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:17.088770 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e008ab-44e6-4813-9339-a924c84dbfad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:17.089544 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e008ab-44e6-4813-9339-a924c84dbfad None admin] RBAC: Adding query filter params (role.id=74ce7b72bcc94a8a8ad65c3db928e6ac, scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62, user.id=9dc9a3cf381e4a2da36ed82b407a2d94) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:17.089861 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e008ab-44e6-4813-9339-a924c84dbfad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:17.091397 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e008ab-44e6-4813-9339-a924c84dbfad None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:17.098904 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 417/838] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:37:16 2022] GET /identity/v3/role_assignments?user.id=9dc9a3cf381e4a2da36ed82b407a2d94&scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62&role.id=74ce7b72bcc94a8a8ad65c3db928e6ac => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:17.099610 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e008ab-44e6-4813-9339-a924c84dbfad None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:17.162865 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:17.249525 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee44d2-3835-459c-922e-614ece896715 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:17.286719 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e008ab-44e6-4813-9339-a924c84dbfad None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:17.296294 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb61b6-4ebf-481c-b404-6ee828478f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:17.297068 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb61b6-4ebf-481c-b404-6ee828478f66 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:17.297474 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb61b6-4ebf-481c-b404-6ee828478f66 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:17.297813 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb61b6-4ebf-481c-b404-6ee828478f66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:17.308803 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb61b6-4ebf-481c-b404-6ee828478f66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:17.310444 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb61b6-4ebf-481c-b404-6ee828478f66 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:17.311388 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:17.330852 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-97fb61b6-4ebf-481c-b404-6ee828478f66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:17.330852 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:17.330852 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:17.330852 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:17.330852 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:17.330852 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:17.330852 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:17.330852 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:17.330852 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:17.330852 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:17.330852 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:17.330852 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:17.330852 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:37:17.330852 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:37:17.330852 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:37:17.330852 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:37:17.331906 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:17.331906 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:17.331906 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:17.331906 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:17.331906 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:17.331906 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:17.331906 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:17.331906 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:17.331906 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:17.331906 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:17.331906 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:17.331906 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:17.331906 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:17.331906 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:17.331906 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:17.331906 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:17.331906 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:37:17.332779 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:37:17.332779 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:17.332779 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:17.332943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 422/839] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:17.338542 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f757e3-56bc-4caa-9ab8-c4231372caf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:17.339040 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb61b6-4ebf-481c-b404-6ee828478f66 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:17.339353 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f757e3-56bc-4caa-9ab8-c4231372caf2 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:17.339694 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f757e3-56bc-4caa-9ab8-c4231372caf2 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:17.340064 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f757e3-56bc-4caa-9ab8-c4231372caf2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:17.340644 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f757e3-56bc-4caa-9ab8-c4231372caf2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:17.342232 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f757e3-56bc-4caa-9ab8-c4231372caf2 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:17.354613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-62f757e3-56bc-4caa-9ab8-c4231372caf2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:37:17.354613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:17.354613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:37:17.354613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:37:17.354613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:37:17.354613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:37:17.354613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:37:17.354613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:17.354613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:37:17.354613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:17.354613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:37:17.354613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:17.354613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:17.354613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:17.354613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:17.354613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:17.354613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:17.355657 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:17.355657 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:17.355657 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:17.355657 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:17.355657 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:17.355657 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:17.355657 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:37:17.355657 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:37:17.355657 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:37:17.355657 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:37:17.355657 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:17.355657 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:17.355657 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:17.355657 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:17.355657 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:17.355657 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:17.356459 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:17.356459 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:17.356459 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:17.356459 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:17.356459 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:17.356459 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:17.356459 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:17.356459 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:17.356459 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:17.356459 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:17.356459 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:37:17.356459 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:17.356459 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:37:17.356459 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:17.356459 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 418/840] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 24 04:37:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:17.361989 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f757e3-56bc-4caa-9ab8-c4231372caf2 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:17.467767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb61b6-4ebf-481c-b404-6ee828478f66 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:17.487831 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:17.490979 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f757e3-56bc-4caa-9ab8-c4231372caf2 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:17.506976 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07a20a-96b5-415e-9030-db27bc1f0269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:17.507595 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07a20a-96b5-415e-9030-db27bc1f0269 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:17.507867 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07a20a-96b5-415e-9030-db27bc1f0269 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:17.508128 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07a20a-96b5-415e-9030-db27bc1f0269 None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:17.508773 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee07a20a-96b5-415e-9030-db27bc1f0269 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:17.509133 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee07a20a-96b5-415e-9030-db27bc1f0269 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:17.510545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee07a20a-96b5-415e-9030-db27bc1f0269 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:17.529991 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 423/841] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:37:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:17.531111 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07a20a-96b5-415e-9030-db27bc1f0269 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:17.540227 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b5777-4488-4ab6-9225-013ebdcb7fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:17.541736 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b5777-4488-4ab6-9225-013ebdcb7fd6 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:17.542201 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b5777-4488-4ab6-9225-013ebdcb7fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:17.542653 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b5777-4488-4ab6-9225-013ebdcb7fd6 None admin] PATH_INFO: `/v3/services` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:17.543906 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b5777-4488-4ab6-9225-013ebdcb7fd6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:17.544787 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b5777-4488-4ab6-9225-013ebdcb7fd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:17.546673 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b5777-4488-4ab6-9225-013ebdcb7fd6 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:17.553796 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 419/842] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 24 04:37:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:17.564538 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b5777-4488-4ab6-9225-013ebdcb7fd6 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:17.627818 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:17.648690 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07a20a-96b5-415e-9030-db27bc1f0269 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:17.677181 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b5777-4488-4ab6-9225-013ebdcb7fd6 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:17.686785 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652acbd-c44c-4a50-a06f-ae9614057bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:17.687735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652acbd-c44c-4a50-a06f-ae9614057bdc None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:17.688234 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652acbd-c44c-4a50-a06f-ae9614057bdc None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:17.688705 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652acbd-c44c-4a50-a06f-ae9614057bdc None admin] PATH_INFO: `/v3/users/swift` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:17.697727 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652acbd-c44c-4a50-a06f-ae9614057bdc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:17.699600 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652acbd-c44c-4a50-a06f-ae9614057bdc None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:17.713471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-8652acbd-c44c-4a50-a06f-ae9614057bdc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:37:17.713471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:17.713471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:17.713471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:17.713471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:17.713471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:17.713471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:17.713471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:17.713471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:17.713471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:17.713471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:17.713471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:17.713471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:37:17.713471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:37:17.713471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:37:17.713471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:37:17.714471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:17.714471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:17.714471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:37:17.714471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:37:17.714471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:37:17.714471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:37:17.714471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:17.714471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:17.714471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:17.714471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:17.714471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:17.714471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:17.714471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:17.714471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:17.714471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:17.714471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:17.714471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:17.714471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:17.715421 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:17.715421 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:17.715421 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:37:17.715421 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:37:17.715421 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:37:17.715421 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:37:17.715421 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:37:17.715421 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:37:17.715421 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:37:17.715421 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:17.717137 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16ba0f-159f-46d7-9ed2-7f91d703d7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:17.717841 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16ba0f-159f-46d7-9ed2-7f91d703d7ce None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:17.718062 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16ba0f-159f-46d7-9ed2-7f91d703d7ce None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:17.718468 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16ba0f-159f-46d7-9ed2-7f91d703d7ce None admin] PATH_INFO: `/v3/services` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:17.718898 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 424/843] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 24 04:37:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:17.719090 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16ba0f-159f-46d7-9ed2-7f91d703d7ce None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:17.719388 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16ba0f-159f-46d7-9ed2-7f91d703d7ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:17.720867 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16ba0f-159f-46d7-9ed2-7f91d703d7ce None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:17.724876 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652acbd-c44c-4a50-a06f-ae9614057bdc None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:17.729385 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 420/844] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 24 04:37:17 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:17.772580 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:17.849532 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652acbd-c44c-4a50-a06f-ae9614057bdc None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:17.887596 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdebe85-fe9a-4fd0-b36c-f0d966e54b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:17.888225 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdebe85-fe9a-4fd0-b36c-f0d966e54b4a None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:17.888508 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdebe85-fe9a-4fd0-b36c-f0d966e54b4a None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:17.888783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdebe85-fe9a-4fd0-b36c-f0d966e54b4a None admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:17.889566 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdebe85-fe9a-4fd0-b36c-f0d966e54b4a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:17.889876 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdebe85-fe9a-4fd0-b36c-f0d966e54b4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:17.891334 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdebe85-fe9a-4fd0-b36c-f0d966e54b4a None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:17.910515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 425/845] 10.222.0.49 () {56 vars in 1135 bytes} [Wed Aug 24 04:37:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:17.915965 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16ba0f-159f-46d7-9ed2-7f91d703d7ce None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:18.030576 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16ba0f-159f-46d7-9ed2-7f91d703d7ce None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:18.051925 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:18.072782 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46a07e-8687-402a-a049-480a67c76c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:18.073455 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46a07e-8687-402a-a049-480a67c76c24 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:18.073737 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46a07e-8687-402a-a049-480a67c76c24 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:18.074043 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46a07e-8687-402a-a049-480a67c76c24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:18.148658 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46a07e-8687-402a-a049-480a67c76c24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:18.150226 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46a07e-8687-402a-a049-480a67c76c24 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:18.263651 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 421/846] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:37:17 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:37:18.269473 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdebe85-fe9a-4fd0-b36c-f0d966e54b4a None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:18.369353 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:18.377179 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdebe85-fe9a-4fd0-b36c-f0d966e54b4a None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:18.418433 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04fe07-f30a-4fa2-8802-9725ec1f661a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:18.419432 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04fe07-f30a-4fa2-8802-9725ec1f661a None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:18.419905 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04fe07-f30a-4fa2-8802-9725ec1f661a None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:18.420403 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04fe07-f30a-4fa2-8802-9725ec1f661a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:18.431680 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04fe07-f30a-4fa2-8802-9725ec1f661a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:18.433440 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04fe07-f30a-4fa2-8802-9725ec1f661a None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:18.448415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-9e04fe07-f30a-4fa2-8802-9725ec1f661a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:18.448415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:18.448415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:18.448415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:18.448415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:18.448415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:18.448415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:18.448415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:18.448415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:18.448415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:18.448415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:18.448415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:18.448415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:37:18.448415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:37:18.448415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:37:18.448415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:37:18.449399 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:18.449399 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:18.449399 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:18.449399 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:18.449399 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:18.449399 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:18.449399 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:18.449399 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:18.449399 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:18.449399 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:18.449399 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:18.449399 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:18.449399 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:18.449399 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:18.449399 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:18.449399 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:18.449399 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:37:18.450319 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:37:18.450319 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:18.450319 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:18.452420 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 426/847] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:18.459158 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46a07e-8687-402a-a049-480a67c76c24 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:18.472624 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:18.562830 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46a07e-8687-402a-a049-480a67c76c24 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:18.598345 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27cbaa5-87b7-4de9-9068-a0c28b9871e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:18.598982 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27cbaa5-87b7-4de9-9068-a0c28b9871e6 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:18.599259 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27cbaa5-87b7-4de9-9068-a0c28b9871e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:18.599528 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27cbaa5-87b7-4de9-9068-a0c28b9871e6 None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:18.600523 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27cbaa5-87b7-4de9-9068-a0c28b9871e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:18.600841 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27cbaa5-87b7-4de9-9068-a0c28b9871e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:18.602277 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27cbaa5-87b7-4de9-9068-a0c28b9871e6 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:18.614730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 422/848] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:18.622509 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04fe07-f30a-4fa2-8802-9725ec1f661a None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:18.737218 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04fe07-f30a-4fa2-8802-9725ec1f661a None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:18.773154 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5663fe-9e40-4dbd-9c7e-c4718acd9269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:18.773832 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5663fe-9e40-4dbd-9c7e-c4718acd9269 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:18.774108 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5663fe-9e40-4dbd-9c7e-c4718acd9269 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:18.774402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5663fe-9e40-4dbd-9c7e-c4718acd9269 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:18.781724 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5663fe-9e40-4dbd-9c7e-c4718acd9269 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:18.783254 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5663fe-9e40-4dbd-9c7e-c4718acd9269 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:18.795568 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-9d5663fe-9e40-4dbd-9c7e-c4718acd9269 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:37:18.795568 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:18.795568 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:18.795568 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:18.795568 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:18.795568 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:18.795568 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:18.795568 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:18.795568 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:18.795568 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:18.795568 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:18.795568 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:18.795568 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:37:18.795568 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:37:18.795568 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:37:18.796482 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:37:18.796482 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:18.796482 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:18.796482 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:18.796482 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:18.796482 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:18.796482 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:18.796482 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:18.796482 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:18.796482 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:18.796482 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:18.796482 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:18.796482 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:18.796482 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:18.796482 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:18.796482 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:18.796482 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:18.797382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:37:18.797382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:37:18.797382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:37:18.797382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:37:18.797382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:37:18.797382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:37:18.797382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:37:18.797382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:18.797382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 427/849] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:37:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:18.804406 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27cbaa5-87b7-4de9-9068-a0c28b9871e6 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:18.880352 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:18.914893 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27cbaa5-87b7-4de9-9068-a0c28b9871e6 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:18.956246 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04613f7e-27b5-429c-b7f9-e6a5a74e3015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:18.956872 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04613f7e-27b5-429c-b7f9-e6a5a74e3015 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:18.957149 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04613f7e-27b5-429c-b7f9-e6a5a74e3015 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:18.957442 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04613f7e-27b5-429c-b7f9-e6a5a74e3015 None admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:18.958154 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04613f7e-27b5-429c-b7f9-e6a5a74e3015 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:18.958459 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04613f7e-27b5-429c-b7f9-e6a5a74e3015 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:18.959915 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04613f7e-27b5-429c-b7f9-e6a5a74e3015 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:18.972728 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 423/850] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 24 04:37:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:18.979645 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5663fe-9e40-4dbd-9c7e-c4718acd9269 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:18.994100 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:19.032123 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3beaec-a3b5-4d77-8113-8b1507d7537c None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:19.032660 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3beaec-a3b5-4d77-8113-8b1507d7537c None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:19.032660 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3beaec-a3b5-4d77-8113-8b1507d7537c None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:19.034976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 424/851] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:19.039801 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b67b9-853d-4b8d-9f03-6d60a7955807 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:19.040155 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b67b9-853d-4b8d-9f03-6d60a7955807 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:19.040745 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b67b9-853d-4b8d-9f03-6d60a7955807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:19.059525 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-698b67b9-853d-4b8d-9f03-6d60a7955807 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:19.060726 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-698b67b9-853d-4b8d-9f03-6d60a7955807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:19.099849 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5663fe-9e40-4dbd-9c7e-c4718acd9269 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:19.141589 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 425/852] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:37:19.148251 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c117f0-2f1b-49d1-843b-bca40e09e318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:19.149257 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c117f0-2f1b-49d1-843b-bca40e09e318 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:19.149703 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c117f0-2f1b-49d1-843b-bca40e09e318 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:19.150080 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c117f0-2f1b-49d1-843b-bca40e09e318 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:19.151119 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c117f0-2f1b-49d1-843b-bca40e09e318 None admin] RBAC: Adding query filter params (role.id=74ce7b72bcc94a8a8ad65c3db928e6ac, scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62, user.id=a7ebb5105220438693118d734c9fda70) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:19.151436 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c117f0-2f1b-49d1-843b-bca40e09e318 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:19.153483 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c117f0-2f1b-49d1-843b-bca40e09e318 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:19.160818 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 428/853] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:37:18 2022] GET /identity/v3/role_assignments?user.id=a7ebb5105220438693118d734c9fda70&scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62&role.id=74ce7b72bcc94a8a8ad65c3db928e6ac => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:19.248848 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678458b-c01a-4ab9-bd80-69fe44162929 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:19.249221 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678458b-c01a-4ab9-bd80-69fe44162929 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:19.249454 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678458b-c01a-4ab9-bd80-69fe44162929 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:19.251262 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 426/854] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:19.257657 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f6037-5fd0-4f9c-a120-4b6edea2f081 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:19.257988 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f6037-5fd0-4f9c-a120-4b6edea2f081 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:19.258242 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f6037-5fd0-4f9c-a120-4b6edea2f081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:19.278409 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-093f6037-5fd0-4f9c-a120-4b6edea2f081 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:19.279647 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-093f6037-5fd0-4f9c-a120-4b6edea2f081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:19.364817 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 429/855] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:19.441644 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678458b-c01a-4ab9-bd80-69fe44162929 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:19.505739 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:19.552523 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678458b-c01a-4ab9-bd80-69fe44162929 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:19.589963 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186fc2b-860d-4860-9837-85d94d270dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:19.590997 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186fc2b-860d-4860-9837-85d94d270dad None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:19.591470 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186fc2b-860d-4860-9837-85d94d270dad None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:19.591952 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186fc2b-860d-4860-9837-85d94d270dad None admin] PATH_INFO: `/v3/roles/service` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:19.603411 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9186fc2b-860d-4860-9837-85d94d270dad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:37:19.608377 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-9186fc2b-860d-4860-9837-85d94d270dad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:37:19.608377 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:19.608377 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:19.608377 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:19.608377 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:19.608377 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:19.608377 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:19.608377 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:19.608377 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:19.608377 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:19.608377 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:19.608377 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:19.608377 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:37:19.608377 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:37:19.608377 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:37:19.608377 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:37:19.609266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:37:19.609266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:37:19.609266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:37:19.609266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:37:19.609266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:19.609266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:19.609266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:19.609266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:19.609266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:19.609266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:19.609266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:19.609266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:19.609266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:19.609266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:19.609266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:19.609266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:19.610145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:19.610145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:19.610145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:19.610145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:19.610145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:37:19.610145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:37:19.610145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:37:19.610145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:37:19.610145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:37:19.610145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:37:19.610145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:37:19.610145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:19.612684 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 427/856] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 24 04:37:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:19.618810 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f6037-5fd0-4f9c-a120-4b6edea2f081 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:19.621445 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:19.631060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186fc2b-860d-4860-9837-85d94d270dad None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:19.751675 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f6037-5fd0-4f9c-a120-4b6edea2f081 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:19.763619 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186fc2b-860d-4860-9837-85d94d270dad None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:19.792528 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:19.795506 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524d2f9-56d7-4b9c-b6fd-855687595423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:19.797600 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524d2f9-56d7-4b9c-b6fd-855687595423 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:19.798267 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524d2f9-56d7-4b9c-b6fd-855687595423 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:19.798759 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524d2f9-56d7-4b9c-b6fd-855687595423 None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:19.799782 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524d2f9-56d7-4b9c-b6fd-855687595423 None admin] RBAC: Adding query filter params (name=service) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:19.800298 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524d2f9-56d7-4b9c-b6fd-855687595423 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:19.802146 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524d2f9-56d7-4b9c-b6fd-855687595423 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:19.810973 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2701feb1-b01d-42aa-8ea5-3c45122939f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:19.811622 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701feb1-b01d-42aa-8ea5-3c45122939f2 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:19.811899 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701feb1-b01d-42aa-8ea5-3c45122939f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:19.812171 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701feb1-b01d-42aa-8ea5-3c45122939f2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:19.812772 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2701feb1-b01d-42aa-8ea5-3c45122939f2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:19.818889 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2701feb1-b01d-42aa-8ea5-3c45122939f2 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:19.819043 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 430/857] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 24 04:37:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:19.819880 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524d2f9-56d7-4b9c-b6fd-855687595423 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:19.835561 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-2701feb1-b01d-42aa-8ea5-3c45122939f2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:37:19.835561 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:19.835561 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:37:19.835561 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:37:19.835561 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:37:19.835561 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:37:19.835561 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:37:19.835561 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:19.835561 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:37:19.835561 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:19.835561 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:37:19.835561 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:19.835561 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:19.835561 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:19.835561 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:19.835561 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:19.836593 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:19.836593 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:19.836593 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:19.836593 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:19.836593 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:19.836593 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:19.836593 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:19.836593 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:37:19.836593 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:37:19.836593 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:37:19.836593 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:37:19.836593 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:19.836593 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:19.836593 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:19.836593 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:19.836593 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:19.836593 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:19.837653 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:19.837653 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:19.837653 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:19.837653 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:19.837653 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:19.837653 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:19.837653 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:19.837653 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:19.837653 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:19.837653 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:19.837653 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:37:19.837653 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:19.837653 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:37:19.837653 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:19.841416 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 428/858] 10.222.0.49 () {56 vars in 1132 bytes} [Wed Aug 24 04:37:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:37:19.842982 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d685edb-bba7-4a74-b782-03019ccf478f None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:19.843270 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d685edb-bba7-4a74-b782-03019ccf478f None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:19.843547 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d685edb-bba7-4a74-b782-03019ccf478f None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:19.844917 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 429/859] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:19.845827 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d685edb-bba7-4a74-b782-03019ccf478f None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:19.921249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:19.968007 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524d2f9-56d7-4b9c-b6fd-855687595423 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:19.983765 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d685edb-bba7-4a74-b782-03019ccf478f None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:20.005001 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb477a5a-0544-4850-9d44-b4a9a003e9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:20.005587 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb477a5a-0544-4850-9d44-b4a9a003e9d5 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:20.005861 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb477a5a-0544-4850-9d44-b4a9a003e9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:20.006147 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb477a5a-0544-4850-9d44-b4a9a003e9d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:20.017219 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb477a5a-0544-4850-9d44-b4a9a003e9d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:20.018847 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb477a5a-0544-4850-9d44-b4a9a003e9d5 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:20.021483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ccb108-e60e-443e-874f-265d9dbd0a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:20.022089 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccb108-e60e-443e-874f-265d9dbd0a06 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:20.022365 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccb108-e60e-443e-874f-265d9dbd0a06 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:20.022629 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ccb108-e60e-443e-874f-265d9dbd0a06 None admin] PATH_INFO: `/v3/services` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:20.023254 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ccb108-e60e-443e-874f-265d9dbd0a06 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:20.023546 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ccb108-e60e-443e-874f-265d9dbd0a06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:20.024948 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ccb108-e60e-443e-874f-265d9dbd0a06 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:20.029956 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 430/860] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Aug 24 04:37:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:20.030928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac258048-132f-41d5-b8f8-53d6e150ad32 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:20.031205 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac258048-132f-41d5-b8f8-53d6e150ad32 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:20.031474 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac258048-132f-41d5-b8f8-53d6e150ad32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:20.038204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-bb477a5a-0544-4850-9d44-b4a9a003e9d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:20.038204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:20.038204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:20.038204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:20.038204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:20.038204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:20.038204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:20.038204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:20.038204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:20.038204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:20.038204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:20.038204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:20.038204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:37:20.038204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:37:20.038204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:37:20.038204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:37:20.039152 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:20.039152 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:20.039152 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:20.039152 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:20.039152 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:20.039152 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:20.039152 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:20.039152 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:20.039152 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:20.039152 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:20.039152 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:20.039152 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:20.039152 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:20.039152 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:20.039152 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:20.039152 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:20.039152 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:37:20.040055 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:37:20.040055 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:20.040055 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:20.040055 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 431/861] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:37:20.040285 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb477a5a-0544-4850-9d44-b4a9a003e9d5 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:20.052235 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-ac258048-132f-41d5-b8f8-53d6e150ad32 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:20.053495 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-ac258048-132f-41d5-b8f8-53d6e150ad32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:20.111185 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:20.138888 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 431/862] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:20.139781 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac258048-132f-41d5-b8f8-53d6e150ad32 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:20.171966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb477a5a-0544-4850-9d44-b4a9a003e9d5 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:20.194238 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:20.222373 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a114bc-5457-4a46-ad61-bc31e262475f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:20.223610 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a114bc-5457-4a46-ad61-bc31e262475f None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:20.224053 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a114bc-5457-4a46-ad61-bc31e262475f None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:20.224730 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a114bc-5457-4a46-ad61-bc31e262475f None admin] PATH_INFO: `/v3/services` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:20.226423 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a114bc-5457-4a46-ad61-bc31e262475f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:20.227148 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a114bc-5457-4a46-ad61-bc31e262475f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:20.229533 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a114bc-5457-4a46-ad61-bc31e262475f None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:20.241674 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 432/863] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Aug 24 04:37:20 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:20.280972 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac258048-132f-41d5-b8f8-53d6e150ad32 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:20.323938 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0176e3-b2a7-4466-a95d-80f334048efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:20.324575 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0176e3-b2a7-4466-a95d-80f334048efd None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:20.324861 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0176e3-b2a7-4466-a95d-80f334048efd None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:20.325124 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0176e3-b2a7-4466-a95d-80f334048efd None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:20.325835 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0176e3-b2a7-4466-a95d-80f334048efd None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:20.326141 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0176e3-b2a7-4466-a95d-80f334048efd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:20.327569 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0176e3-b2a7-4466-a95d-80f334048efd None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:20.342226 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 432/864] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:20.348386 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a114bc-5457-4a46-ad61-bc31e262475f None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:20.427385 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0176e3-b2a7-4466-a95d-80f334048efd None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:20.485945 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:20.488330 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a114bc-5457-4a46-ad61-bc31e262475f None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:20.528947 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e007f-09e5-491f-a142-e0435e1fd40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:20.529199 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e007f-09e5-491f-a142-e0435e1fd40c None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:20.529556 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e007f-09e5-491f-a142-e0435e1fd40c None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:20.529893 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e007f-09e5-491f-a142-e0435e1fd40c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:20.538496 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e007f-09e5-491f-a142-e0435e1fd40c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:20.539958 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e007f-09e5-491f-a142-e0435e1fd40c None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:20.551668 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-9f0e007f-09e5-491f-a142-e0435e1fd40c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:37:20.551668 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:20.551668 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:20.551668 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:20.551668 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:20.551668 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:20.551668 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:20.551668 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:20.551668 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:20.551668 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:20.551668 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:20.551668 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:20.551668 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:37:20.551668 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:37:20.551668 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:37:20.551668 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:37:20.552757 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:20.552757 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:20.552757 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:37:20.552757 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:37:20.552757 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:37:20.552757 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:37:20.552757 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:20.552757 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:20.552757 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:20.552757 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:20.552757 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:20.552757 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:20.552757 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:20.552757 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:20.552757 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:20.552757 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:20.552757 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:20.552757 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:20.553763 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:20.553763 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:20.553763 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:37:20.553763 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:37:20.553763 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:37:20.553763 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:37:20.553763 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:37:20.553763 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:37:20.553763 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:37:20.553763 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:20.553763 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 433/865] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Aug 24 04:37:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:20.558420 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e007f-09e5-491f-a142-e0435e1fd40c None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:20.566950 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0176e3-b2a7-4466-a95d-80f334048efd None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:20.605908 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181fda1-65d7-4122-8706-1be96c0c52d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:20.606567 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181fda1-65d7-4122-8706-1be96c0c52d6 None admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:20.606846 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181fda1-65d7-4122-8706-1be96c0c52d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:20.607115 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181fda1-65d7-4122-8706-1be96c0c52d6 None admin] PATH_INFO: `/v3/services` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:20.607794 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181fda1-65d7-4122-8706-1be96c0c52d6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:20.609308 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181fda1-65d7-4122-8706-1be96c0c52d6 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:20.619222 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:20.637812 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 433/866] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 24 04:37:20 2022] POST /identity/v3/services => generated 251 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:37:20.688798 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e007f-09e5-491f-a142-e0435e1fd40c None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:20.735884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274ad89-93b4-403e-b537-78ff11e1f6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:20.736927 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274ad89-93b4-403e-b537-78ff11e1f6cf None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:20.737458 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274ad89-93b4-403e-b537-78ff11e1f6cf None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:20.737920 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274ad89-93b4-403e-b537-78ff11e1f6cf None admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:20.738881 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274ad89-93b4-403e-b537-78ff11e1f6cf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:20.739418 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274ad89-93b4-403e-b537-78ff11e1f6cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:20.741108 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274ad89-93b4-403e-b537-78ff11e1f6cf None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:20.763301 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 434/867] 10.222.0.49 () {56 vars in 1149 bytes} [Wed Aug 24 04:37:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:20.772523 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181fda1-65d7-4122-8706-1be96c0c52d6 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:20.927603 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:20.935369 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181fda1-65d7-4122-8706-1be96c0c52d6 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:20.978550 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408558c-4e89-4e73-a51f-f79245e4522e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:20.979519 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408558c-4e89-4e73-a51f-f79245e4522e None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:20.980003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408558c-4e89-4e73-a51f-f79245e4522e None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:20.980461 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408558c-4e89-4e73-a51f-f79245e4522e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:21.069571 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408558c-4e89-4e73-a51f-f79245e4522e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:21.071750 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408558c-4e89-4e73-a51f-f79245e4522e None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:21.189955 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:21.195770 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 434/868] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:37:20 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:37:21.197664 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274ad89-93b4-403e-b537-78ff11e1f6cf None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:21.317159 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:21.325895 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274ad89-93b4-403e-b537-78ff11e1f6cf None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:21.334997 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed29e01-2816-47ae-b11f-6a57352dbb99 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:21.335692 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed29e01-2816-47ae-b11f-6a57352dbb99 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:21.336159 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed29e01-2816-47ae-b11f-6a57352dbb99 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:21.338193 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 435/869] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:21.344216 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9d40a-efbb-46f6-a7cd-03a04a9ea24f None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:21.344798 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9d40a-efbb-46f6-a7cd-03a04a9ea24f None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:21.345265 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9d40a-efbb-46f6-a7cd-03a04a9ea24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:21.368056 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-87a9d40a-efbb-46f6-a7cd-03a04a9ea24f None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:21.368548 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0246e5-7515-42d9-a81b-409b79331f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:21.369264 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0246e5-7515-42d9-a81b-409b79331f94 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:21.369568 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0246e5-7515-42d9-a81b-409b79331f94 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:21.369841 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0246e5-7515-42d9-a81b-409b79331f94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:21.370983 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-87a9d40a-efbb-46f6-a7cd-03a04a9ea24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:21.384985 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0246e5-7515-42d9-a81b-409b79331f94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:21.386788 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0246e5-7515-42d9-a81b-409b79331f94 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:21.408112 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-7b0246e5-7515-42d9-a81b-409b79331f94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:21.408112 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:21.408112 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:21.408112 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:21.408112 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:21.408112 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:21.408112 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:21.408112 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:21.408112 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:21.408112 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:21.408112 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:21.408112 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:21.408112 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:37:21.408112 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:37:21.408112 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:37:21.408112 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:37:21.409208 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:21.409208 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:21.409208 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:21.409208 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:21.409208 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:21.409208 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:21.409208 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:21.409208 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:21.409208 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:21.409208 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:21.409208 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:21.409208 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:21.409208 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:21.409208 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:21.409208 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:21.409208 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:21.409208 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:37:21.410498 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:37:21.410498 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:21.410498 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:21.410498 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 435/870] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:21.418555 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0246e5-7515-42d9-a81b-409b79331f94 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:21.485749 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 436/871] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:21 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:37:21.559656 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0246e5-7515-42d9-a81b-409b79331f94 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:21.599415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07316f41-b2b9-42d0-aacb-eae48949e8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:21.600726 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07316f41-b2b9-42d0-aacb-eae48949e8e6 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:21.601375 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07316f41-b2b9-42d0-aacb-eae48949e8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:21.601881 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07316f41-b2b9-42d0-aacb-eae48949e8e6 None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:21.603032 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07316f41-b2b9-42d0-aacb-eae48949e8e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:21.603526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07316f41-b2b9-42d0-aacb-eae48949e8e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:21.605142 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07316f41-b2b9-42d0-aacb-eae48949e8e6 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:21.618807 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 436/872] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:21.625913 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9d40a-efbb-46f6-a7cd-03a04a9ea24f None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:21.798537 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9d40a-efbb-46f6-a7cd-03a04a9ea24f None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:21.852735 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:21.869539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce8242-7abc-4fad-9dee-7c5e4b5fb5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:21.870635 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce8242-7abc-4fad-9dee-7c5e4b5fb5af None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:21.871144 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce8242-7abc-4fad-9dee-7c5e4b5fb5af None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:21.871645 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce8242-7abc-4fad-9dee-7c5e4b5fb5af None admin] PATH_INFO: `/v3/projects/service` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:21.885529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce8242-7abc-4fad-9dee-7c5e4b5fb5af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:21.888455 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce8242-7abc-4fad-9dee-7c5e4b5fb5af None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:21.913744 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-edce8242-7abc-4fad-9dee-7c5e4b5fb5af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:37:21.913744 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:21.913744 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:21.913744 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:21.913744 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:21.913744 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:21.913744 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:21.913744 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:21.913744 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:21.913744 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:21.913744 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:21.913744 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:21.913744 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:37:21.913744 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:37:21.913744 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:37:21.915359 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:37:21.915359 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:21.915359 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:21.915359 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:21.915359 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:21.915359 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:21.915359 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:21.915359 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:21.915359 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:21.915359 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:21.915359 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:21.915359 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:21.915359 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:21.915359 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:21.915359 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:21.915359 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:21.915359 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:21.917700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:37:21.917700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:37:21.917700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:37:21.917700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:37:21.917700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:37:21.917700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:37:21.917700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:37:21.917700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:21.921003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 437/873] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:37:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:37:21.926687 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07316f41-b2b9-42d0-aacb-eae48949e8e6 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:21.940162 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:21.961202 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce8242-7abc-4fad-9dee-7c5e4b5fb5af None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:22.080588 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce8242-7abc-4fad-9dee-7c5e4b5fb5af None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:22.108732 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07316f41-b2b9-42d0-aacb-eae48949e8e6 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:22.124875 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1686b8-98f2-4aa5-8bd8-3116b2e70638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:22.125589 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1686b8-98f2-4aa5-8bd8-3116b2e70638 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:22.125870 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1686b8-98f2-4aa5-8bd8-3116b2e70638 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:22.126151 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1686b8-98f2-4aa5-8bd8-3116b2e70638 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:22.126771 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1686b8-98f2-4aa5-8bd8-3116b2e70638 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:22.128610 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1686b8-98f2-4aa5-8bd8-3116b2e70638 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:22.139687 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-7e1686b8-98f2-4aa5-8bd8-3116b2e70638 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:37:22.139687 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:22.139687 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:37:22.139687 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:37:22.139687 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:37:22.139687 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:37:22.139687 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:37:22.139687 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:22.139687 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:37:22.139687 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:22.139687 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:37:22.139687 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:22.139687 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:22.139687 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:22.139687 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:22.139687 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:22.139687 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:22.142089 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:22.142089 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:22.142089 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:22.142089 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:22.142089 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:22.142089 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:22.142089 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:37:22.142089 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:37:22.142089 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:37:22.142089 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:37:22.142089 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:22.142089 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:22.142089 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:22.142089 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:22.142089 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:22.142089 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:22.143791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:22.143791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:22.143791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:22.143791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:22.143791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:22.143791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:22.143791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:22.143791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:22.143791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:22.143791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:22.143791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:37:22.143791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:22.143791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:37:22.143791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:22.149209 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 438/874] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Aug 24 04:37:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:37:22.150159 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1686b8-98f2-4aa5-8bd8-3116b2e70638 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:22.183957 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e3991-c7c5-4525-9b37-b46c40ff5797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:22.185603 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e3991-c7c5-4525-9b37-b46c40ff5797 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:22.186407 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e3991-c7c5-4525-9b37-b46c40ff5797 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:22.187181 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e3991-c7c5-4525-9b37-b46c40ff5797 None admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:22.188838 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e3991-c7c5-4525-9b37-b46c40ff5797 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:22.189737 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e3991-c7c5-4525-9b37-b46c40ff5797 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:22.193100 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7e3991-c7c5-4525-9b37-b46c40ff5797 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:22.218159 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 437/875] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 24 04:37:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:22.226160 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:22.228511 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e3991-c7c5-4525-9b37-b46c40ff5797 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:22.283923 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1686b8-98f2-4aa5-8bd8-3116b2e70638 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:22.329952 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d26926-4bc2-4235-b867-bbb9fe9be06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:22.330883 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d26926-4bc2-4235-b867-bbb9fe9be06e None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:22.331328 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d26926-4bc2-4235-b867-bbb9fe9be06e None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:22.331738 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d26926-4bc2-4235-b867-bbb9fe9be06e None admin] PATH_INFO: `/v3/services` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:22.332659 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d26926-4bc2-4235-b867-bbb9fe9be06e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:22.333179 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d26926-4bc2-4235-b867-bbb9fe9be06e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:22.334800 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d26926-4bc2-4235-b867-bbb9fe9be06e None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:22.349429 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 439/876] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Aug 24 04:37:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:22.354219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d26926-4bc2-4235-b867-bbb9fe9be06e None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:22.356328 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:22.423907 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e3991-c7c5-4525-9b37-b46c40ff5797 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:22.477937 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d26926-4bc2-4235-b867-bbb9fe9be06e None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:22.485665 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29a11b-fdd2-44bd-8ac7-c136232f41a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:22.486771 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29a11b-fdd2-44bd-8ac7-c136232f41a1 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:22.487514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29a11b-fdd2-44bd-8ac7-c136232f41a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:22.487808 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29a11b-fdd2-44bd-8ac7-c136232f41a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:22.489252 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29a11b-fdd2-44bd-8ac7-c136232f41a1 None admin] RBAC: Adding query filter params (role.id=d62916d0c54540b3859985d5d3565718, scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62, user.id=c737c4586910476eafead0dfd4d9bc4c) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:22.489839 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29a11b-fdd2-44bd-8ac7-c136232f41a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:22.492926 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29a11b-fdd2-44bd-8ac7-c136232f41a1 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:22.501885 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:22.509366 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 438/877] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:37:22 2022] GET /identity/v3/role_assignments?user.id=c737c4586910476eafead0dfd4d9bc4c&scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62&role.id=d62916d0c54540b3859985d5d3565718 => generated 608 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:22.518268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f510b57-bb30-48de-8be1-65bb43fa4aa4 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:22.518615 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f510b57-bb30-48de-8be1-65bb43fa4aa4 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:22.518830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f510b57-bb30-48de-8be1-65bb43fa4aa4 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:22.520589 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 439/878] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:37:22.528316 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9d1b3-f784-465b-aa2c-b8a40fcebfd5 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:22.528647 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9d1b3-f784-465b-aa2c-b8a40fcebfd5 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:22.529004 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9d1b3-f784-465b-aa2c-b8a40fcebfd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:22.542145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b525950-b946-405d-96a0-1a137932d0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:22.543180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b525950-b946-405d-96a0-1a137932d0cc None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:22.544561 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b525950-b946-405d-96a0-1a137932d0cc None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:22.545049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b525950-b946-405d-96a0-1a137932d0cc None admin] PATH_INFO: `/v3/services` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:22.546889 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b525950-b946-405d-96a0-1a137932d0cc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:22.547481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b525950-b946-405d-96a0-1a137932d0cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:22.549843 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-b5e9d1b3-f784-465b-aa2c-b8a40fcebfd5 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:22.550193 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b525950-b946-405d-96a0-1a137932d0cc None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:22.551211 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-b5e9d1b3-f784-465b-aa2c-b8a40fcebfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:22.559326 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 440/879] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Aug 24 04:37:22 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:22.639085 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 440/880] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:22 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:37:22.971749 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b525950-b946-405d-96a0-1a137932d0cc None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:23.084475 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b525950-b946-405d-96a0-1a137932d0cc None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:23.119875 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75551c-1018-4536-8823-b3ec4751144b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:23.120490 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75551c-1018-4536-8823-b3ec4751144b None admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:23.120768 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75551c-1018-4536-8823-b3ec4751144b None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:23.121041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75551c-1018-4536-8823-b3ec4751144b None admin] PATH_INFO: `/v3/services` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:23.121739 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75551c-1018-4536-8823-b3ec4751144b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:23.123113 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75551c-1018-4536-8823-b3ec4751144b None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:23.143255 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 441/881] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 24 04:37:22 2022] POST /identity/v3/services => generated 269 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:37:23.222295 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a2545-0899-48c0-b27f-95831e2bdbe8 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:23.222477 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a2545-0899-48c0-b27f-95831e2bdbe8 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:23.222756 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a2545-0899-48c0-b27f-95831e2bdbe8 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:23.224516 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 441/882] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:23.230738 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303181d0-a98d-48b3-a19a-d593abc50548 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:23.231020 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303181d0-a98d-48b3-a19a-d593abc50548 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:23.231293 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303181d0-a98d-48b3-a19a-d593abc50548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:23.251432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-303181d0-a98d-48b3-a19a-d593abc50548 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:23.252754 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-303181d0-a98d-48b3-a19a-d593abc50548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:23.292310 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:23.343255 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 442/883] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:23 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:23.610144 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a2545-0899-48c0-b27f-95831e2bdbe8 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:23.677436 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:23.724514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a2545-0899-48c0-b27f-95831e2bdbe8 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:23.765052 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ae2e0-9377-4bce-a7db-4d124e5da9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:23.766110 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ae2e0-9377-4bce-a7db-4d124e5da9e3 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:23.766585 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ae2e0-9377-4bce-a7db-4d124e5da9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:23.767050 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ae2e0-9377-4bce-a7db-4d124e5da9e3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:23.767829 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ae2e0-9377-4bce-a7db-4d124e5da9e3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:23.769426 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ae2e0-9377-4bce-a7db-4d124e5da9e3 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:23.778872 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-e47ae2e0-9377-4bce-a7db-4d124e5da9e3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:37:23.778872 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:23.778872 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:37:23.778872 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:37:23.778872 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:37:23.778872 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:37:23.778872 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:37:23.778872 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:23.778872 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:37:23.778872 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:23.778872 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:37:23.778872 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:23.778872 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:23.778872 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:23.778872 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:23.778872 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:23.778872 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:23.780034 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:23.780034 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:23.780034 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:23.780034 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:23.780034 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:23.780034 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:23.780034 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:37:23.780034 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:37:23.780034 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:37:23.780034 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:37:23.780034 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:23.780034 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:23.780034 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:23.780034 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:23.780034 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:23.780034 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:23.781249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:23.781249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:23.781249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:23.781249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:23.781249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:23.781249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:23.781249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:23.781249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:23.781249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:23.781249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:23.781249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:37:23.781249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:23.781249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:37:23.781249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:23.784112 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 442/884] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 24 04:37:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:23.789655 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303181d0-a98d-48b3-a19a-d593abc50548 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:23.896656 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303181d0-a98d-48b3-a19a-d593abc50548 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:23.938678 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596beeb5-6fca-43bf-bbe3-ce73a7d64a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:23.939434 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596beeb5-6fca-43bf-bbe3-ce73a7d64a28 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:23.939818 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596beeb5-6fca-43bf-bbe3-ce73a7d64a28 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:23.940087 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596beeb5-6fca-43bf-bbe3-ce73a7d64a28 None admin] PATH_INFO: `/v3/services` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:23.940805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596beeb5-6fca-43bf-bbe3-ce73a7d64a28 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:23.941104 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596beeb5-6fca-43bf-bbe3-ce73a7d64a28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:23.942760 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596beeb5-6fca-43bf-bbe3-ce73a7d64a28 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:23.948481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 443/885] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 24 04:37:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:23.954297 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ae2e0-9377-4bce-a7db-4d124e5da9e3 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:24.069876 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ae2e0-9377-4bce-a7db-4d124e5da9e3 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:24.095094 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:24.107126 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cd770-103c-43ac-947a-c7386357273a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:24.108123 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cd770-103c-43ac-947a-c7386357273a None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:24.108600 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cd770-103c-43ac-947a-c7386357273a None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:24.109124 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6cd770-103c-43ac-947a-c7386357273a None admin] PATH_INFO: `/v3/services` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:24.110015 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6cd770-103c-43ac-947a-c7386357273a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:24.110514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6cd770-103c-43ac-947a-c7386357273a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:24.112252 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6cd770-103c-43ac-947a-c7386357273a None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:24.118800 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 443/886] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 24 04:37:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:24.129396 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596beeb5-6fca-43bf-bbe3-ce73a7d64a28 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:24.158179 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:24.231938 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596beeb5-6fca-43bf-bbe3-ce73a7d64a28 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:24.268493 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779be50-d343-4f25-8d43-53cdb93c96c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:24.269088 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779be50-d343-4f25-8d43-53cdb93c96c7 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:24.269386 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779be50-d343-4f25-8d43-53cdb93c96c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:24.269663 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779be50-d343-4f25-8d43-53cdb93c96c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:24.270408 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779be50-d343-4f25-8d43-53cdb93c96c7 None admin] RBAC: Adding query filter params (interface=public, service_id=e42837e509584b838838d2e0b54ef72c, region_id=RegionOne) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:24.270714 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779be50-d343-4f25-8d43-53cdb93c96c7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:24.272103 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779be50-d343-4f25-8d43-53cdb93c96c7 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:24.277981 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 444/887] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Aug 24 04:37:24 2022] GET /identity/v3/endpoints?service_id=e42837e509584b838838d2e0b54ef72c&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:24.283521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cd770-103c-43ac-947a-c7386357273a None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:24.397770 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6cd770-103c-43ac-947a-c7386357273a None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:24.434857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b97d22-46c6-4673-8012-3c1837683a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:24.435847 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b97d22-46c6-4673-8012-3c1837683a0a None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:24.436331 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b97d22-46c6-4673-8012-3c1837683a0a None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:24.436796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b97d22-46c6-4673-8012-3c1837683a0a None admin] PATH_INFO: `/v3/services` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:24.437637 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b97d22-46c6-4673-8012-3c1837683a0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:24.439300 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b97d22-46c6-4673-8012-3c1837683a0a None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:24.446220 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 444/888] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Aug 24 04:37:24 2022] GET /identity/v3/services => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:37:24.652785 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb310c33-5528-41d7-b9f3-e4bed9c5b329 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:24.653534 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb310c33-5528-41d7-b9f3-e4bed9c5b329 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:24.654043 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb310c33-5528-41d7-b9f3-e4bed9c5b329 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:24.655905 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 445/889] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:37:24.661942 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50c097-dc10-41cd-a1a0-0e0218994046 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:24.662819 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50c097-dc10-41cd-a1a0-0e0218994046 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:24.663301 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50c097-dc10-41cd-a1a0-0e0218994046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:24.683863 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-da50c097-dc10-41cd-a1a0-0e0218994046 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:24.685591 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-da50c097-dc10-41cd-a1a0-0e0218994046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:24.735344 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0499a7-453f-498a-8f9b-160efe585a3a None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:24.735582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0499a7-453f-498a-8f9b-160efe585a3a None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:24.735790 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0499a7-453f-498a-8f9b-160efe585a3a None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:24.737098 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 446/890] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:37:24.741585 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:24.743311 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600954d1-bc4b-4822-9ec5-3186849d9840 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:24.743959 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600954d1-bc4b-4822-9ec5-3186849d9840 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:24.744291 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600954d1-bc4b-4822-9ec5-3186849d9840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:24.764427 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 445/891] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:24 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:24.769480 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-600954d1-bc4b-4822-9ec5-3186849d9840 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:24.769480 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-600954d1-bc4b-4822-9ec5-3186849d9840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:24.840083 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 447/892] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:24 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:37:25.033177 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50c097-dc10-41cd-a1a0-0e0218994046 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:25.133655 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600954d1-bc4b-4822-9ec5-3186849d9840 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:25.147138 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50c097-dc10-41cd-a1a0-0e0218994046 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:25.161002 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:25.189566 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc2f51-46b0-4bc3-903e-460c4ce73b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:25.190213 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc2f51-46b0-4bc3-903e-460c4ce73b72 None admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:25.190486 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc2f51-46b0-4bc3-903e-460c4ce73b72 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:25.190763 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc2f51-46b0-4bc3-903e-460c4ce73b72 None admin] PATH_INFO: `/v3/services` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:25.191420 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc2f51-46b0-4bc3-903e-460c4ce73b72 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:25.192812 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc2f51-46b0-4bc3-903e-460c4ce73b72 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:25.212424 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 446/893] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 24 04:37:25 2022] POST /identity/v3/services => generated 241 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:37:25.230336 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb38a55-1889-4a6d-a9b0-b3086b198ebd None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:25.230682 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb38a55-1889-4a6d-a9b0-b3086b198ebd None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:25.230889 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb38a55-1889-4a6d-a9b0-b3086b198ebd None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:25.235543 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 447/894] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:37:25.240380 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a07fe7-e598-4786-aa87-5db08ab5c6d5 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:25.240824 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a07fe7-e598-4786-aa87-5db08ab5c6d5 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:25.241161 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a07fe7-e598-4786-aa87-5db08ab5c6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:25.255046 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600954d1-bc4b-4822-9ec5-3186849d9840 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:25.266707 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-25a07fe7-e598-4786-aa87-5db08ab5c6d5 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:25.268101 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-25a07fe7-e598-4786-aa87-5db08ab5c6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:25.301816 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa70c67-748f-4ae9-a92d-3d1360cfe710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:25.302389 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa70c67-748f-4ae9-a92d-3d1360cfe710 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:25.302667 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa70c67-748f-4ae9-a92d-3d1360cfe710 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:25.302935 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa70c67-748f-4ae9-a92d-3d1360cfe710 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:25.315204 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa70c67-748f-4ae9-a92d-3d1360cfe710 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:37:25.315554 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:25.321125 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-7aa70c67-748f-4ae9-a92d-3d1360cfe710 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:37:25.321125 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:25.321125 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:25.321125 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:25.321125 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:25.321125 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:25.321125 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:25.321125 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:25.321125 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:25.321125 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:25.321125 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:25.321125 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:25.321125 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:37:25.321125 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:37:25.321125 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:37:25.321125 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:37:25.323534 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:37:25.323534 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:37:25.323534 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:37:25.323534 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:37:25.323534 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:25.323534 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:25.323534 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:25.323534 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:25.323534 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:25.323534 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:25.323534 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:25.323534 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:25.323534 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:25.323534 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:25.323534 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:25.323534 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:25.325431 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:25.325431 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:25.325431 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:25.325431 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:25.325431 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:37:25.325431 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:37:25.325431 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:37:25.325431 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:37:25.325431 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:37:25.325431 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:37:25.325431 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:37:25.325431 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:25.329365 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 448/895] 10.222.0.49 () {56 vars in 1120 bytes} [Wed Aug 24 04:37:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:37:25.331296 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa70c67-748f-4ae9-a92d-3d1360cfe710 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:25.365513 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 448/896] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:37:25.420414 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:25.442892 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa70c67-748f-4ae9-a92d-3d1360cfe710 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:25.484305 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8e103-a8de-47ad-8bf3-aec6335df2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:25.485011 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8e103-a8de-47ad-8bf3-aec6335df2f9 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:25.485290 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8e103-a8de-47ad-8bf3-aec6335df2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:25.485589 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8e103-a8de-47ad-8bf3-aec6335df2f9 None admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:25.486265 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a8e103-a8de-47ad-8bf3-aec6335df2f9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:25.486570 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a8e103-a8de-47ad-8bf3-aec6335df2f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:25.488129 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a8e103-a8de-47ad-8bf3-aec6335df2f9 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:25.498388 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 449/897] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Aug 24 04:37:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:25.504383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a07fe7-e598-4786-aa87-5db08ab5c6d5 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:25.611360 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a07fe7-e598-4786-aa87-5db08ab5c6d5 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:25.646510 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a71cf5-8caa-4026-a12f-99da1ac3298c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:25.647213 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a71cf5-8caa-4026-a12f-99da1ac3298c None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:25.647485 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a71cf5-8caa-4026-a12f-99da1ac3298c None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:25.647749 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a71cf5-8caa-4026-a12f-99da1ac3298c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:25.658681 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a71cf5-8caa-4026-a12f-99da1ac3298c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:25.660155 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a71cf5-8caa-4026-a12f-99da1ac3298c None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:25.667495 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8e103-a8de-47ad-8bf3-aec6335df2f9 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:25.677215 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-b0a71cf5-8caa-4026-a12f-99da1ac3298c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:25.677215 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:25.677215 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:25.677215 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:25.677215 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:25.677215 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:25.677215 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:25.677215 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:25.677215 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:25.677215 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:25.677215 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:25.677215 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:25.677215 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:37:25.677215 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:37:25.677215 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:37:25.677215 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:37:25.678514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:25.678514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:25.678514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:25.678514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:25.678514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:25.678514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:25.678514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:25.678514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:25.678514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:25.678514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:25.678514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:25.678514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:25.678514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:25.678514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:25.678514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:25.678514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:25.678514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:37:25.680261 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:37:25.680261 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:25.680261 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:25.680261 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 449/898] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:25.684354 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a71cf5-8caa-4026-a12f-99da1ac3298c None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:25.713754 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:25.790081 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a71cf5-8caa-4026-a12f-99da1ac3298c None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:25.807316 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8e103-a8de-47ad-8bf3-aec6335df2f9 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:25.835429 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb6ae9-a1fd-4163-ae74-67666bdbc1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:25.836084 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb6ae9-a1fd-4163-ae74-67666bdbc1ba None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:25.836382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb6ae9-a1fd-4163-ae74-67666bdbc1ba None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:25.836655 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb6ae9-a1fd-4163-ae74-67666bdbc1ba None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:25.837318 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb6ae9-a1fd-4163-ae74-67666bdbc1ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:25.837645 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb6ae9-a1fd-4163-ae74-67666bdbc1ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:25.839051 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fb6ae9-a1fd-4163-ae74-67666bdbc1ba None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:25.855158 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9e28b-fde1-4e56-940c-bbc8e73e3b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:25.855805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9e28b-fde1-4e56-940c-bbc8e73e3b92 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:25.856082 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9e28b-fde1-4e56-940c-bbc8e73e3b92 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:25.856355 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9e28b-fde1-4e56-940c-bbc8e73e3b92 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:25.856949 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff9e28b-fde1-4e56-940c-bbc8e73e3b92 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:25.862875 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff9e28b-fde1-4e56-940c-bbc8e73e3b92 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:25.863011 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 450/899] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:25.863916 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb6ae9-a1fd-4163-ae74-67666bdbc1ba None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:25.874978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-1ff9e28b-fde1-4e56-940c-bbc8e73e3b92 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:37:25.874978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:25.874978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:37:25.874978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:37:25.874978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:37:25.874978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:37:25.874978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:37:25.874978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:25.874978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:37:25.874978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:25.874978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:37:25.874978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:25.874978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:25.874978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:25.874978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:25.874978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:25.876049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:25.876049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:25.876049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:25.876049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:25.876049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:25.876049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:25.876049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:25.876049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:37:25.876049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:37:25.876049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:37:25.876049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:37:25.876049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:25.876049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:25.876049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:25.876049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:25.876049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:25.876049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:25.876917 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:25.876917 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:25.876917 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:25.876917 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:25.876917 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:25.876917 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:25.876917 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:25.876917 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:25.876917 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:25.876917 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:25.876917 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:37:25.876917 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:25.876917 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:37:25.876917 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:25.881156 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 450/900] 10.222.0.49 () {56 vars in 1132 bytes} [Wed Aug 24 04:37:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:25.882075 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9e28b-fde1-4e56-940c-bbc8e73e3b92 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:25.893075 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:25.986493 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:25.994486 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9e28b-fde1-4e56-940c-bbc8e73e3b92 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:26.006612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb6ae9-a1fd-4163-ae74-67666bdbc1ba None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:26.034831 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af6ce0-1505-4d94-8e1a-9799bb9e2439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:26.035562 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af6ce0-1505-4d94-8e1a-9799bb9e2439 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:26.035912 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af6ce0-1505-4d94-8e1a-9799bb9e2439 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:26.036250 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07af6ce0-1505-4d94-8e1a-9799bb9e2439 None admin] PATH_INFO: `/v3/services` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:26.037046 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af6ce0-1505-4d94-8e1a-9799bb9e2439 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:26.037444 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af6ce0-1505-4d94-8e1a-9799bb9e2439 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:26.039094 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07af6ce0-1505-4d94-8e1a-9799bb9e2439 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:26.049463 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8c579-7046-4210-97f1-da0e9ce6fc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:26.049758 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 451/901] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Aug 24 04:37:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:26.050637 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8c579-7046-4210-97f1-da0e9ce6fc8a None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:26.051123 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8c579-7046-4210-97f1-da0e9ce6fc8a None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:26.051578 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8c579-7046-4210-97f1-da0e9ce6fc8a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:26.051835 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af6ce0-1505-4d94-8e1a-9799bb9e2439 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:26.061880 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8c579-7046-4210-97f1-da0e9ce6fc8a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:26.063662 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b8c579-7046-4210-97f1-da0e9ce6fc8a None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:26.080398 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-91b8c579-7046-4210-97f1-da0e9ce6fc8a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:37:26.080398 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:26.080398 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:26.080398 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:26.080398 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:26.080398 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:26.080398 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:26.080398 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:26.080398 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:26.080398 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:26.080398 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:26.080398 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:26.080398 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:37:26.080398 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:37:26.080398 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:37:26.080398 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:37:26.081383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:26.081383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:26.081383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:37:26.081383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:37:26.081383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:37:26.081383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:37:26.081383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:26.081383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:26.081383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:26.081383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:26.081383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:26.081383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:26.081383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:26.081383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:26.081383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:26.081383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:26.081383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:26.081383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:26.082309 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:26.082309 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:26.082309 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:37:26.082309 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:37:26.082309 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:37:26.082309 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:37:26.082309 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:37:26.082309 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:37:26.082309 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:37:26.082309 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:26.087938 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 451/902] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Aug 24 04:37:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:26.088397 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8c579-7046-4210-97f1-da0e9ce6fc8a None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:26.143381 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:26.184932 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07af6ce0-1505-4d94-8e1a-9799bb9e2439 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:26.199283 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8c579-7046-4210-97f1-da0e9ce6fc8a None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:26.228769 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5be3a4-6574-4289-98ac-4cb8805949f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:26.229667 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5be3a4-6574-4289-98ac-4cb8805949f6 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:26.230061 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5be3a4-6574-4289-98ac-4cb8805949f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:26.230434 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5be3a4-6574-4289-98ac-4cb8805949f6 None admin] PATH_INFO: `/v3/services` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:26.231189 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5be3a4-6574-4289-98ac-4cb8805949f6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:26.231675 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5be3a4-6574-4289-98ac-4cb8805949f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:26.233359 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5be3a4-6574-4289-98ac-4cb8805949f6 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:26.238896 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1348280-62a4-44f7-9acf-071721f897b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:26.239521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1348280-62a4-44f7-9acf-071721f897b6 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:26.239794 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1348280-62a4-44f7-9acf-071721f897b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:26.240163 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1348280-62a4-44f7-9acf-071721f897b6 None admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:26.240907 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1348280-62a4-44f7-9acf-071721f897b6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:26.241207 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1348280-62a4-44f7-9acf-071721f897b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:26.242808 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1348280-62a4-44f7-9acf-071721f897b6 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:26.244959 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 452/903] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Aug 24 04:37:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:26.246596 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5be3a4-6574-4289-98ac-4cb8805949f6 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:26.269438 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 452/904] 10.222.0.49 () {56 vars in 1149 bytes} [Wed Aug 24 04:37:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:26.270827 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1348280-62a4-44f7-9acf-071721f897b6 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:26.273906 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:26.375227 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5be3a4-6574-4289-98ac-4cb8805949f6 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:26.387915 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1348280-62a4-44f7-9acf-071721f897b6 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:26.413630 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a64e6c-0b12-4c23-b311-98efa69d610a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:26.414582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a64e6c-0b12-4c23-b311-98efa69d610a None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:26.415152 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a64e6c-0b12-4c23-b311-98efa69d610a None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:26.415580 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a64e6c-0b12-4c23-b311-98efa69d610a None admin] PATH_INFO: `/v3/endpoints` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:26.417047 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a64e6c-0b12-4c23-b311-98efa69d610a None admin] RBAC: Adding query filter params (interface=public, service_id=b721ac727f7142af9589ed8d88f8c5fd, region_id=RegionOne) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:26.417544 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a64e6c-0b12-4c23-b311-98efa69d610a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:26.419714 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a64e6c-0b12-4c23-b311-98efa69d610a None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:26.422161 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:26.432628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed602b-9b34-4a64-b5b1-bb2a892d9e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:26.432628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed602b-9b34-4a64-b5b1-bb2a892d9e69 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:26.432628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed602b-9b34-4a64-b5b1-bb2a892d9e69 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:26.432628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed602b-9b34-4a64-b5b1-bb2a892d9e69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:26.433560 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 453/905] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Aug 24 04:37:26 2022] GET /identity/v3/endpoints?service_id=b721ac727f7142af9589ed8d88f8c5fd&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:26.435969 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b049c92-e8cf-47a4-8090-04bff7824323 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:26.436437 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b049c92-e8cf-47a4-8090-04bff7824323 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:26.436878 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b049c92-e8cf-47a4-8090-04bff7824323 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:26.438471 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 454/906] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:26.439428 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b049c92-e8cf-47a4-8090-04bff7824323 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:26.505184 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed602b-9b34-4a64-b5b1-bb2a892d9e69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:26.506850 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed602b-9b34-4a64-b5b1-bb2a892d9e69 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:26.508887 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:26.545997 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b049c92-e8cf-47a4-8090-04bff7824323 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:26.581586 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7667d8e-ba9d-440a-8692-b6d6f40e256a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:26.582215 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7667d8e-ba9d-440a-8692-b6d6f40e256a None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:26.582492 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7667d8e-ba9d-440a-8692-b6d6f40e256a None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:26.582764 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7667d8e-ba9d-440a-8692-b6d6f40e256a None admin] PATH_INFO: `/v3/services` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:26.583372 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7667d8e-ba9d-440a-8692-b6d6f40e256a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:26.585084 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7667d8e-ba9d-440a-8692-b6d6f40e256a None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:26.591196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 455/907] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Aug 24 04:37:26 2022] GET /identity/v3/services => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:37:26.603038 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b0087-067d-476f-a213-fe6cddb73810 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:26.603654 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b0087-067d-476f-a213-fe6cddb73810 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:26.603654 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b0087-067d-476f-a213-fe6cddb73810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:26.633549 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 453/908] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:37:26 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:37:26.634866 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-e92b0087-067d-476f-a213-fe6cddb73810 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:26.635341 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed602b-9b34-4a64-b5b1-bb2a892d9e69 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:26.636121 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-e92b0087-067d-476f-a213-fe6cddb73810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:26.718974 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:26.741499 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 456/909] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:26.763179 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed602b-9b34-4a64-b5b1-bb2a892d9e69 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:26.765365 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:26.801968 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029a573-9388-4393-801a-c81960c1ddc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:26.802624 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029a573-9388-4393-801a-c81960c1ddc7 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:26.802896 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029a573-9388-4393-801a-c81960c1ddc7 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:26.803168 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029a573-9388-4393-801a-c81960c1ddc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:26.815500 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5029a573-9388-4393-801a-c81960c1ddc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:26.817249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5029a573-9388-4393-801a-c81960c1ddc7 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:26.834460 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-5029a573-9388-4393-801a-c81960c1ddc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:26.834460 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:26.834460 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:26.834460 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:26.834460 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:26.834460 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:26.834460 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:26.834460 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:26.834460 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:26.834460 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:26.834460 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:26.834460 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:26.834460 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:37:26.834460 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:37:26.834460 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:37:26.834460 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:37:26.835441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:26.835441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:26.835441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:26.835441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:26.835441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:26.835441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:26.835441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:26.835441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:26.835441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:26.835441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:26.835441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:26.835441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:26.835441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:26.835441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:26.835441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:26.835441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:26.835441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:37:26.836432 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:37:26.836432 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:26.836432 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:26.838891 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 454/910] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:37:26.844545 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b0087-067d-476f-a213-fe6cddb73810 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:26.951982 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b0087-067d-476f-a213-fe6cddb73810 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:26.988017 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa3fbc-169e-4b5c-a604-9b9fa5efb6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:26.988987 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa3fbc-169e-4b5c-a604-9b9fa5efb6b4 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:26.989504 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa3fbc-169e-4b5c-a604-9b9fa5efb6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:26.990011 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa3fbc-169e-4b5c-a604-9b9fa5efb6b4 None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:26.990871 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa3fbc-169e-4b5c-a604-9b9fa5efb6b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:26.991424 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa3fbc-169e-4b5c-a604-9b9fa5efb6b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:26.993061 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa3fbc-169e-4b5c-a604-9b9fa5efb6b4 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:27.005597 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 457/911] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:27.011177 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029a573-9388-4393-801a-c81960c1ddc7 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:27.026798 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa3fbc-169e-4b5c-a604-9b9fa5efb6b4 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:27.083872 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:27.139255 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029a573-9388-4393-801a-c81960c1ddc7 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:27.143207 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa3fbc-169e-4b5c-a604-9b9fa5efb6b4 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:27.180640 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b310a9-b965-4e42-8406-613de5ec5db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:27.181657 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b310a9-b965-4e42-8406-613de5ec5db7 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:27.181946 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b310a9-b965-4e42-8406-613de5ec5db7 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:27.182227 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b310a9-b965-4e42-8406-613de5ec5db7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:27.188483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2f4b7-367f-4b1b-8775-4eb136ce4f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:27.189865 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2f4b7-367f-4b1b-8775-4eb136ce4f50 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:27.190378 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2f4b7-367f-4b1b-8775-4eb136ce4f50 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:27.191144 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2f4b7-367f-4b1b-8775-4eb136ce4f50 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:27.191687 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b310a9-b965-4e42-8406-613de5ec5db7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:27.192159 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae2f4b7-367f-4b1b-8775-4eb136ce4f50 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:27.193163 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b310a9-b965-4e42-8406-613de5ec5db7 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:27.194085 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae2f4b7-367f-4b1b-8775-4eb136ce4f50 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:27.204786 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-dae2f4b7-367f-4b1b-8775-4eb136ce4f50 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:37:27.204786 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:27.204786 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:37:27.204786 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:37:27.204786 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:37:27.204786 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:37:27.204786 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:37:27.204786 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:27.204786 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:37:27.204786 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:27.204786 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:37:27.204786 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:27.204786 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:27.204786 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:27.204786 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:27.204786 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:27.204786 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:27.205857 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:27.205857 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:27.205857 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:27.205857 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:27.205857 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:27.205857 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:27.205857 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:37:27.205857 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:37:27.205857 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:37:27.205857 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:37:27.205857 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:27.205857 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:27.205857 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:27.205857 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:27.205857 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:27.205857 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:27.206708 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:27.206708 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:27.206708 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:27.206708 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:27.206708 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:27.206708 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:27.206708 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:27.206708 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:27.206708 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:27.206708 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:27.206708 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:37:27.206708 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:27.206708 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:37:27.206708 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:27.207438 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-65b310a9-b965-4e42-8406-613de5ec5db7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:37:27.207438 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:27.207438 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:27.207438 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:27.207438 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:27.207438 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:27.207438 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:27.207438 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:27.207438 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:27.207438 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:27.207438 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:27.207438 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:27.207438 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:37:27.207438 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:37:27.207438 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:37:27.208943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:37:27.208943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:27.208943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:27.208943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:27.208943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:27.208943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:27.208943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:27.208943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:27.208943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:27.208943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:27.208943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:27.208943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:27.208943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:27.208943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:27.208943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:27.208943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:27.208943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:27.210701 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:37:27.210701 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:37:27.210701 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:37:27.210701 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:37:27.210701 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:37:27.210701 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:37:27.210701 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:37:27.210701 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:27.212148 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 455/912] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:37:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:27.212822 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b310a9-b965-4e42-8406-613de5ec5db7 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:27.217604 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 458/913] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 24 04:37:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:37:27.221565 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2f4b7-367f-4b1b-8775-4eb136ce4f50 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:27.235752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:27.334397 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b310a9-b965-4e42-8406-613de5ec5db7 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:27.339242 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2f4b7-367f-4b1b-8775-4eb136ce4f50 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:27.355950 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:27.373192 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bff60d1-36a1-486e-9337-dbdc29ddca1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:27.373938 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff60d1-36a1-486e-9337-dbdc29ddca1e None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:27.374226 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff60d1-36a1-486e-9337-dbdc29ddca1e None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:27.374493 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bff60d1-36a1-486e-9337-dbdc29ddca1e None admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:27.375285 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff60d1-36a1-486e-9337-dbdc29ddca1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:27.375385 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9febdb-c7a3-40bb-9c18-0a133c48c168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:27.375583 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff60d1-36a1-486e-9337-dbdc29ddca1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:27.375938 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9febdb-c7a3-40bb-9c18-0a133c48c168 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:27.376214 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9febdb-c7a3-40bb-9c18-0a133c48c168 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:27.376511 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9febdb-c7a3-40bb-9c18-0a133c48c168 None admin] PATH_INFO: `/v3/services` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:27.377039 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bff60d1-36a1-486e-9337-dbdc29ddca1e None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:27.377136 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9febdb-c7a3-40bb-9c18-0a133c48c168 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:27.377442 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9febdb-c7a3-40bb-9c18-0a133c48c168 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:27.378803 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9febdb-c7a3-40bb-9c18-0a133c48c168 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:27.388530 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 459/914] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 24 04:37:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:27.388530 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510ef81-8ca4-4478-b12c-4d1cd9712cb3 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:27.388530 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510ef81-8ca4-4478-b12c-4d1cd9712cb3 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:27.388530 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510ef81-8ca4-4478-b12c-4d1cd9712cb3 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:27.391069 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 460/915] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:27.391884 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510ef81-8ca4-4478-b12c-4d1cd9712cb3 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:27.395631 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 456/916] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 24 04:37:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:27.396945 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f6286-66d9-4a77-a85f-65f81e6e34e9 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:27.397230 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f6286-66d9-4a77-a85f-65f81e6e34e9 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:27.397527 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f6286-66d9-4a77-a85f-65f81e6e34e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:27.417092 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-9f9f6286-66d9-4a77-a85f-65f81e6e34e9 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:27.418350 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-9f9f6286-66d9-4a77-a85f-65f81e6e34e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:27.491925 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 457/917] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:27.493079 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f6286-66d9-4a77-a85f-65f81e6e34e9 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:27.499372 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:27.510965 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510ef81-8ca4-4478-b12c-4d1cd9712cb3 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:27.555440 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f82f8b-d2a5-4687-aa8e-7c806f0286f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:27.556052 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f82f8b-d2a5-4687-aa8e-7c806f0286f8 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:27.556331 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f82f8b-d2a5-4687-aa8e-7c806f0286f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:27.556604 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f82f8b-d2a5-4687-aa8e-7c806f0286f8 None admin] PATH_INFO: `/v3/services` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:27.557239 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f82f8b-d2a5-4687-aa8e-7c806f0286f8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:27.557576 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f82f8b-d2a5-4687-aa8e-7c806f0286f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:27.558956 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f82f8b-d2a5-4687-aa8e-7c806f0286f8 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:27.574763 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 461/918] 10.222.0.49 () {56 vars in 1114 bytes} [Wed Aug 24 04:37:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:27.576044 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f82f8b-d2a5-4687-aa8e-7c806f0286f8 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:27.630114 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f6286-66d9-4a77-a85f-65f81e6e34e9 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:27.637722 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:27.680323 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c490f1-7bd2-4223-8574-3d78172a99ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:27.681673 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c490f1-7bd2-4223-8574-3d78172a99ed None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:27.682105 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c490f1-7bd2-4223-8574-3d78172a99ed None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:27.682527 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c490f1-7bd2-4223-8574-3d78172a99ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:27.684129 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c490f1-7bd2-4223-8574-3d78172a99ed None admin] RBAC: Adding query filter params (role.id=ebe27ef209074cbb99d86cc8dde4c5d9, scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62, user.id=c737c4586910476eafead0dfd4d9bc4c) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:27.684643 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c490f1-7bd2-4223-8574-3d78172a99ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:27.686992 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c490f1-7bd2-4223-8574-3d78172a99ed None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:27.694878 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 458/919] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:37:27 2022] GET /identity/v3/role_assignments?user.id=c737c4586910476eafead0dfd4d9bc4c&scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62&role.id=ebe27ef209074cbb99d86cc8dde4c5d9 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:27.706829 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f82f8b-d2a5-4687-aa8e-7c806f0286f8 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:27.749826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8272f-a036-4097-89c2-3cb24b8245b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:27.750485 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8272f-a036-4097-89c2-3cb24b8245b3 None admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:27.750761 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8272f-a036-4097-89c2-3cb24b8245b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:27.751093 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8272f-a036-4097-89c2-3cb24b8245b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:27.751825 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8272f-a036-4097-89c2-3cb24b8245b3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:27.753387 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8272f-a036-4097-89c2-3cb24b8245b3 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:27.781936 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 462/920] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:37:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:37:27.785358 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c490f1-7bd2-4223-8574-3d78172a99ed None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:27.875293 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:27.915221 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c490f1-7bd2-4223-8574-3d78172a99ed None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:27.960612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367469f4-8f9c-41b7-aa20-65a728893f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:27.961296 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367469f4-8f9c-41b7-aa20-65a728893f0e None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:27.961602 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367469f4-8f9c-41b7-aa20-65a728893f0e None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:27.961879 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367469f4-8f9c-41b7-aa20-65a728893f0e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:27.962473 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367469f4-8f9c-41b7-aa20-65a728893f0e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:27.963860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367469f4-8f9c-41b7-aa20-65a728893f0e None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:27.972796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-367469f4-8f9c-41b7-aa20-65a728893f0e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:37:27.972796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:27.972796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:37:27.972796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:37:27.972796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:37:27.972796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:37:27.972796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:37:27.972796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:27.972796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:37:27.972796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:27.972796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:37:27.972796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:27.972796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:27.972796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:27.972796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:27.972796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:27.972796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:27.973838 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:27.973838 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:27.973838 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:27.973838 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:27.973838 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:27.973838 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:27.973838 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:37:27.973838 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:37:27.973838 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:37:27.973838 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:37:27.973838 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:27.973838 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:27.973838 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:27.973838 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:27.973838 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:27.973838 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:27.974999 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:27.974999 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:27.974999 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:27.974999 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:27.974999 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:27.974999 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:27.974999 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:27.974999 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:27.974999 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:27.974999 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:27.974999 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:37:27.974999 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:27.974999 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:37:27.974999 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:27.974999 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 459/921] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Aug 24 04:37:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:27.980646 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8272f-a036-4097-89c2-3cb24b8245b3 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:28.093526 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:28.097945 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8272f-a036-4097-89c2-3cb24b8245b3 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:28.141421 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd9a07-3e6a-4190-97db-201573fcb7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:28.142071 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd9a07-3e6a-4190-97db-201573fcb7cb None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:28.142354 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd9a07-3e6a-4190-97db-201573fcb7cb None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:28.142625 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd9a07-3e6a-4190-97db-201573fcb7cb None admin] PATH_INFO: `/v3/services` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:28.143283 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd9a07-3e6a-4190-97db-201573fcb7cb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:28.143583 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd9a07-3e6a-4190-97db-201573fcb7cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:28.145065 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd9a07-3e6a-4190-97db-201573fcb7cb None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:28.154631 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 463/922] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Aug 24 04:37:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:28.162167 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367469f4-8f9c-41b7-aa20-65a728893f0e None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:28.276700 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367469f4-8f9c-41b7-aa20-65a728893f0e None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:28.304744 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:28.313459 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca30cb8-adba-453a-8208-27d80a25f912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:28.314075 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca30cb8-adba-453a-8208-27d80a25f912 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:28.314347 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca30cb8-adba-453a-8208-27d80a25f912 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:28.314614 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca30cb8-adba-453a-8208-27d80a25f912 None admin] PATH_INFO: `/v3/services` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:28.315249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca30cb8-adba-453a-8208-27d80a25f912 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:28.315545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca30cb8-adba-453a-8208-27d80a25f912 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:28.316917 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca30cb8-adba-453a-8208-27d80a25f912 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:28.322428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 460/923] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Aug 24 04:37:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:28.328519 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd9a07-3e6a-4190-97db-201573fcb7cb None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:28.436218 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd9a07-3e6a-4190-97db-201573fcb7cb None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:28.476054 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c3f71-e387-493d-9ca3-16c01aa0576c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:28.476700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c3f71-e387-493d-9ca3-16c01aa0576c None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:28.477078 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c3f71-e387-493d-9ca3-16c01aa0576c None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:28.477270 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c3f71-e387-493d-9ca3-16c01aa0576c None admin] PATH_INFO: `/v3/endpoints` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:28.477986 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c3f71-e387-493d-9ca3-16c01aa0576c None admin] RBAC: Adding query filter params (interface=public, service_id=5b41cad5599f4db08bb3c6a919c00ea2, region_id=RegionOne) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:28.478296 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c3f71-e387-493d-9ca3-16c01aa0576c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:28.479678 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c3f71-e387-493d-9ca3-16c01aa0576c None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:28.485310 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 464/924] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Aug 24 04:37:28 2022] GET /identity/v3/endpoints?service_id=5b41cad5599f4db08bb3c6a919c00ea2&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:28.494431 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca30cb8-adba-453a-8208-27d80a25f912 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:28.595155 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1766da-e6a7-4e79-aa3e-ec5bcb90762f None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:28.595437 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1766da-e6a7-4e79-aa3e-ec5bcb90762f None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:28.595715 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1766da-e6a7-4e79-aa3e-ec5bcb90762f None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:28.597321 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 465/925] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:28.602582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c5b08-e14c-4fd0-bcef-3cb44a8bd505 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:28.602859 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c5b08-e14c-4fd0-bcef-3cb44a8bd505 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:28.603099 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca30cb8-adba-453a-8208-27d80a25f912 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:28.603223 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c5b08-e14c-4fd0-bcef-3cb44a8bd505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:28.623245 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-a36c5b08-e14c-4fd0-bcef-3cb44a8bd505 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:28.624598 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-a36c5b08-e14c-4fd0-bcef-3cb44a8bd505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:28.638386 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7961da8-c5e3-44ed-a42f-3e8ef3a203c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:28.639346 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7961da8-c5e3-44ed-a42f-3e8ef3a203c7 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:28.639880 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7961da8-c5e3-44ed-a42f-3e8ef3a203c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:28.640287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7961da8-c5e3-44ed-a42f-3e8ef3a203c7 None admin] PATH_INFO: `/v3/services` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:28.641031 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7961da8-c5e3-44ed-a42f-3e8ef3a203c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:28.642683 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7961da8-c5e3-44ed-a42f-3e8ef3a203c7 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:28.650077 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:28.651693 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 461/926] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Aug 24 04:37:28 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:37:28.708669 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 466/927] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:37:28.974632 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7961da8-c5e3-44ed-a42f-3e8ef3a203c7 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:29.034934 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:29.086790 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7961da8-c5e3-44ed-a42f-3e8ef3a203c7 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:29.121878 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c0c83-8052-422b-8751-348ee1a8ed89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:29.122912 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c0c83-8052-422b-8751-348ee1a8ed89 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:29.123383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c0c83-8052-422b-8751-348ee1a8ed89 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:29.123842 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c0c83-8052-422b-8751-348ee1a8ed89 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:29.124615 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c0c83-8052-422b-8751-348ee1a8ed89 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:29.126254 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1c0c83-8052-422b-8751-348ee1a8ed89 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:29.135888 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-bf1c0c83-8052-422b-8751-348ee1a8ed89 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:37:29.135888 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:29.135888 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:37:29.135888 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:37:29.135888 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:37:29.135888 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:37:29.135888 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:37:29.135888 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:29.135888 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:37:29.135888 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:29.135888 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:37:29.135888 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:29.135888 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:29.135888 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:29.135888 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:29.135888 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:29.136844 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:29.136844 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:29.136844 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:29.136844 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:29.136844 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:29.136844 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:29.136844 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:29.136844 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:37:29.136844 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:37:29.136844 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:37:29.136844 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:37:29.136844 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:29.136844 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:29.136844 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:29.136844 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:29.136844 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:29.136844 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:29.137743 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:29.137743 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:29.137743 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:29.137743 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:29.137743 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:29.137743 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:29.137743 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:29.137743 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:29.137743 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:29.137743 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:29.137743 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:37:29.137743 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:29.137743 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:37:29.137743 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:29.140485 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 462/928] 10.222.0.49 () {56 vars in 1132 bytes} [Wed Aug 24 04:37:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:29.146182 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c5b08-e14c-4fd0-bcef-3cb44a8bd505 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:29.267510 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c5b08-e14c-4fd0-bcef-3cb44a8bd505 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:29.304341 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbe978-e3c5-410d-8fb2-f7a82a7dfe9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:29.305059 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbe978-e3c5-410d-8fb2-f7a82a7dfe9d None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:29.305356 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbe978-e3c5-410d-8fb2-f7a82a7dfe9d None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:29.305645 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbe978-e3c5-410d-8fb2-f7a82a7dfe9d None admin] PATH_INFO: `/v3/services` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:29.306291 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fbe978-e3c5-410d-8fb2-f7a82a7dfe9d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:29.306595 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fbe978-e3c5-410d-8fb2-f7a82a7dfe9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:29.307992 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fbe978-e3c5-410d-8fb2-f7a82a7dfe9d None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:29.313612 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 467/929] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Aug 24 04:37:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:29.319225 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c0c83-8052-422b-8751-348ee1a8ed89 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:29.429139 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c0c83-8052-422b-8751-348ee1a8ed89 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:29.449245 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:29.463966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1975f0-52a0-4912-ad4a-e65ed569191d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:29.464574 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1975f0-52a0-4912-ad4a-e65ed569191d None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:29.464850 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1975f0-52a0-4912-ad4a-e65ed569191d None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:29.465116 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1975f0-52a0-4912-ad4a-e65ed569191d None admin] PATH_INFO: `/v3/services` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:29.465781 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1975f0-52a0-4912-ad4a-e65ed569191d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:29.466077 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1975f0-52a0-4912-ad4a-e65ed569191d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:29.467573 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1975f0-52a0-4912-ad4a-e65ed569191d None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:29.473096 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 463/930] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Aug 24 04:37:29 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:29.479363 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbe978-e3c5-410d-8fb2-f7a82a7dfe9d None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:29.507774 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:29.592225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbe978-e3c5-410d-8fb2-f7a82a7dfe9d None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:29.628325 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f80725-51bd-4d14-b193-468f141d69a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:29.628941 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f80725-51bd-4d14-b193-468f141d69a6 None admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:29.629222 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f80725-51bd-4d14-b193-468f141d69a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:29.629526 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f80725-51bd-4d14-b193-468f141d69a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:29.630210 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f80725-51bd-4d14-b193-468f141d69a6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:29.631591 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f80725-51bd-4d14-b193-468f141d69a6 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:29.654386 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 468/931] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:37:29 2022] POST /identity/v3/endpoints => generated 347 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:37:29.735148 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4b290-062e-4107-9450-7c70d1960194 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:29.735521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4b290-062e-4107-9450-7c70d1960194 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:29.735681 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4b290-062e-4107-9450-7c70d1960194 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:29.737446 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 464/932] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:29.743266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e8592-9498-48b6-9d26-2c5468e24eb2 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:29.743554 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e8592-9498-48b6-9d26-2c5468e24eb2 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:29.743831 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e8592-9498-48b6-9d26-2c5468e24eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:29.767435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-389e8592-9498-48b6-9d26-2c5468e24eb2 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:29.769356 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-389e8592-9498-48b6-9d26-2c5468e24eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:29.850718 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 469/933] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:29.942301 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf31e6-2de4-4628-ad17-89b7dbdd1fb2 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:29.942645 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf31e6-2de4-4628-ad17-89b7dbdd1fb2 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:29.942845 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf31e6-2de4-4628-ad17-89b7dbdd1fb2 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:29.944447 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 465/934] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:29.949711 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c316e-69c8-4df1-b018-93ac5cc3f45a None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:29.949996 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c316e-69c8-4df1-b018-93ac5cc3f45a None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:29.950265 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c316e-69c8-4df1-b018-93ac5cc3f45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:29.959112 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:29.971008 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-c95c316e-69c8-4df1-b018-93ac5cc3f45a None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:29.972782 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-c95c316e-69c8-4df1-b018-93ac5cc3f45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:30.045014 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 470/935] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:30.121196 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf31e6-2de4-4628-ad17-89b7dbdd1fb2 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:30.231973 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf31e6-2de4-4628-ad17-89b7dbdd1fb2 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:30.268843 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24602f0f-439c-4e8c-adc8-95bc0538554f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:30.269523 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24602f0f-439c-4e8c-adc8-95bc0538554f None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:30.269807 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24602f0f-439c-4e8c-adc8-95bc0538554f None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:30.270081 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24602f0f-439c-4e8c-adc8-95bc0538554f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:30.281732 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24602f0f-439c-4e8c-adc8-95bc0538554f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:37:30.286526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-24602f0f-439c-4e8c-adc8-95bc0538554f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:37:30.286526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:30.286526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:30.286526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:30.286526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:30.286526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:30.286526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:30.286526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:30.286526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:30.286526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:30.286526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:30.286526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:30.286526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:37:30.286526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:37:30.286526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:37:30.286526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:37:30.287418 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:37:30.287418 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:37:30.287418 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:37:30.287418 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:37:30.287418 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:30.287418 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:30.287418 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:30.287418 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:30.287418 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:30.287418 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:30.287418 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:30.287418 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:30.287418 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:30.287418 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:30.287418 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:30.287418 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:30.288240 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:30.288240 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:30.288240 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:30.288240 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:30.288240 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:37:30.288240 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:37:30.288240 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:37:30.288240 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:37:30.288240 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:37:30.288240 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:37:30.288240 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:37:30.288240 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:30.288240 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 466/936] 10.222.0.49 () {56 vars in 1120 bytes} [Wed Aug 24 04:37:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:30.294173 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c316e-69c8-4df1-b018-93ac5cc3f45a None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:30.330782 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24602f0f-439c-4e8c-adc8-95bc0538554f None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:30.399498 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:30.422710 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c316e-69c8-4df1-b018-93ac5cc3f45a None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:30.460058 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24602f0f-439c-4e8c-adc8-95bc0538554f None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:30.466971 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff023f-b2fd-4bf3-8e79-e1fdc9bd10f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:30.467902 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff023f-b2fd-4bf3-8e79-e1fdc9bd10f9 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:30.468917 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff023f-b2fd-4bf3-8e79-e1fdc9bd10f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:30.469413 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff023f-b2fd-4bf3-8e79-e1fdc9bd10f9 None admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:30.470716 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff023f-b2fd-4bf3-8e79-e1fdc9bd10f9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:30.471216 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff023f-b2fd-4bf3-8e79-e1fdc9bd10f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:30.473613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff023f-b2fd-4bf3-8e79-e1fdc9bd10f9 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:30.481650 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:30.487005 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 471/937] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Aug 24 04:37:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:30.493073 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff023f-b2fd-4bf3-8e79-e1fdc9bd10f9 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:30.502791 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d318b9-f9d2-46f4-b3e8-7660ef771bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:30.503407 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d318b9-f9d2-46f4-b3e8-7660ef771bc3 None admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:30.503681 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d318b9-f9d2-46f4-b3e8-7660ef771bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:30.503952 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d318b9-f9d2-46f4-b3e8-7660ef771bc3 None admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:30.504598 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d318b9-f9d2-46f4-b3e8-7660ef771bc3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:30.506078 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d318b9-f9d2-46f4-b3e8-7660ef771bc3 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:30.509646 dv-cinder-854265-1-smb devstack@keystone.service[93147]: WARNING keystone.server.flask.common [None req-29d318b9-f9d2-46f4-b3e8-7660ef771bc3 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 04:37:30.533752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.sql.core [None req-29d318b9-f9d2-46f4-b3e8-7660ef771bc3 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 04:37:30.533752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 04:37:30.533752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [parameters: {'id': '9e5541d98c8e430bac1e6812170f45eb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 04:37:30.533752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93147) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 04:37:30.542612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-29d318b9-f9d2-46f4-b3e8-7660ef771bc3 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9e5541d98c8e430bac1e6812170f45eb.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9e5541d98c8e430bac1e6812170f45eb. Aug 24 04:37:30.542612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:30.542612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 04:37:30.542612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 04:37:30.542612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 04:37:30.542612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 04:37:30.542612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 04:37:30.542612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 04:37:30.542612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 04:37:30.542612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application conn.query(q) Aug 24 04:37:30.542612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 04:37:30.542612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 04:37:30.542612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 04:37:30.543425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application result.read() Aug 24 04:37:30.543425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 04:37:30.543425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 04:37:30.543425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 04:37:30.543425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 04:37:30.543425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 04:37:30.543425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 04:37:30.543425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 04:37:30.543425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 04:37:30.543425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 04:37:30.543425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:30.543425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 04:37:30.543425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:30.543425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:30.543425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 04:37:30.543425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 04:37:30.543425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 04:37:30.543425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 04:37:30.544392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 04:37:30.544392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application next(self.gen) Aug 24 04:37:30.544392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 04:37:30.544392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application yield resource Aug 24 04:37:30.544392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 04:37:30.544392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application next(self.gen) Aug 24 04:37:30.544392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 04:37:30.544392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 04:37:30.544392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 04:37:30.544392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 04:37:30.544392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 04:37:30.544392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise self.value Aug 24 04:37:30.544392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 04:37:30.544392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 04:37:30.544392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 04:37:30.544392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application session.commit() Aug 24 04:37:30.544392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 04:37:30.545248 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 04:37:30.545248 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 04:37:30.545248 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 04:37:30.545248 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 04:37:30.545248 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self.session.flush() Aug 24 04:37:30.545248 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 04:37:30.545248 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 04:37:30.545248 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 04:37:30.545248 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 04:37:30.545248 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 04:37:30.545248 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application compat.raise_( Aug 24 04:37:30.545248 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 04:37:30.545248 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception Aug 24 04:37:30.545248 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 04:37:30.545248 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 04:37:30.545248 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 04:37:30.545248 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 04:37:30.546793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 04:37:30.546793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 04:37:30.546793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 04:37:30.546793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 04:37:30.546793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 04:37:30.546793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 04:37:30.546793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 04:37:30.546793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 04:37:30.546793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 04:37:30.546793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 04:37:30.546793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 04:37:30.546793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 04:37:30.546793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 04:37:30.546793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 04:37:30.546793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 04:37:30.547560 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 04:37:30.547560 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 04:37:30.547560 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception Aug 24 04:37:30.547560 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 04:37:30.547560 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 04:37:30.547560 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 04:37:30.547560 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 04:37:30.547560 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 04:37:30.547560 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 04:37:30.547560 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 04:37:30.547560 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application conn.query(q) Aug 24 04:37:30.547560 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 04:37:30.547560 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 04:37:30.547560 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 04:37:30.547560 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application result.read() Aug 24 04:37:30.547560 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 04:37:30.547560 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 04:37:30.548868 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 04:37:30.548868 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 04:37:30.548868 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 04:37:30.548868 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 04:37:30.548868 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 04:37:30.548868 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 04:37:30.548868 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 04:37:30.548868 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 04:37:30.548868 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [parameters: {'id': '9e5541d98c8e430bac1e6812170f45eb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 04:37:30.548868 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 04:37:30.548868 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:30.548868 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:37:30.548868 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:30.548868 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:30.548868 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 04:37:30.550861 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 04:37:30.550861 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 04:37:30.550861 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 04:37:30.550861 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 04:37:30.550861 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:30.550861 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:37:30.550861 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:30.550861 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:30.550861 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:30.550861 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:30.550861 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:30.550861 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:30.550861 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:30.550861 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:30.550861 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:30.550861 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:30.550861 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:30.552983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:30.552983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 04:37:30.552983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 04:37:30.552983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:30.552983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:30.552983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 04:37:30.552983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 04:37:30.552983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9e5541d98c8e430bac1e6812170f45eb. Aug 24 04:37:30.552983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:30.552983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 467/938] 10.222.0.49 () {60 vars in 1140 bytes} [Wed Aug 24 04:37:30 2022] POST /identity/v3/projects => generated 262 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:37:30.552983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d318b9-f9d2-46f4-b3e8-7660ef771bc3 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:30.626983 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff023f-b2fd-4bf3-8e79-e1fdc9bd10f9 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:30.662915 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bce8c2-fe24-4af1-88f5-548ce729de02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:30.663477 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bce8c2-fe24-4af1-88f5-548ce729de02 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:30.663758 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bce8c2-fe24-4af1-88f5-548ce729de02 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:30.664078 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bce8c2-fe24-4af1-88f5-548ce729de02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:30.666902 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:30.670765 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d318b9-f9d2-46f4-b3e8-7660ef771bc3 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:30.676528 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bce8c2-fe24-4af1-88f5-548ce729de02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:30.678111 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bce8c2-fe24-4af1-88f5-548ce729de02 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:30.694536 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-78bce8c2-fe24-4af1-88f5-548ce729de02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:30.694536 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:30.694536 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:30.694536 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:30.694536 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:30.694536 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:30.694536 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:30.694536 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:30.694536 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:30.694536 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:30.694536 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:30.694536 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:30.694536 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:37:30.694536 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:37:30.694536 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:37:30.694536 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:37:30.695604 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:30.695604 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:30.695604 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:30.695604 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:30.695604 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:30.695604 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:30.695604 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:30.695604 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:30.695604 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:30.695604 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:30.695604 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:30.695604 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:30.695604 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:30.695604 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:30.695604 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:30.695604 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:30.695604 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:37:30.696649 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:37:30.696649 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:30.696649 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:30.696649 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 472/939] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:30.701681 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb5f8a-bbb2-430c-8f75-507f2ea4ef31 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:30.702058 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb5f8a-bbb2-430c-8f75-507f2ea4ef31 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:30.702351 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb5f8a-bbb2-430c-8f75-507f2ea4ef31 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:30.703781 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 473/940] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:30.704477 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb5f8a-bbb2-430c-8f75-507f2ea4ef31 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:30.718337 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc5cbb3-4de4-42a8-a9e4-17d5ec5a78f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:30.719146 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5cbb3-4de4-42a8-a9e4-17d5ec5a78f1 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:30.719427 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5cbb3-4de4-42a8-a9e4-17d5ec5a78f1 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:30.719692 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc5cbb3-4de4-42a8-a9e4-17d5ec5a78f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:30.727667 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5cbb3-4de4-42a8-a9e4-17d5ec5a78f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:30.729547 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc5cbb3-4de4-42a8-a9e4-17d5ec5a78f1 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:30.743415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-7cc5cbb3-4de4-42a8-a9e4-17d5ec5a78f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:37:30.743415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:30.743415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:30.743415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:30.743415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:30.743415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:30.743415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:30.743415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:30.743415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:30.743415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:30.743415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:30.743415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:30.743415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:37:30.743415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:37:30.743415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:37:30.744358 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:37:30.744358 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:30.744358 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:30.744358 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:30.744358 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:30.744358 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:30.744358 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:30.744358 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:30.744358 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:30.744358 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:30.744358 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:30.744358 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:30.744358 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:30.744358 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:30.744358 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:30.744358 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:30.744358 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:30.745230 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:37:30.745230 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:37:30.745230 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:37:30.745230 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:37:30.745230 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:37:30.745230 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:37:30.745230 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:37:30.745230 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:30.745230 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 468/941] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:37:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:37:30.751372 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad868203-4256-4192-beb1-be2d8f2f6045 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:30.751662 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad868203-4256-4192-beb1-be2d8f2f6045 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:30.751936 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad868203-4256-4192-beb1-be2d8f2f6045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:30.757045 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:30.771689 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-ad868203-4256-4192-beb1-be2d8f2f6045 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:30.773326 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-ad868203-4256-4192-beb1-be2d8f2f6045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:30.812191 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb5f8a-bbb2-430c-8f75-507f2ea4ef31 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:30.843283 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 469/942] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:30.853575 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad868203-4256-4192-beb1-be2d8f2f6045 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:30.859005 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9dcfeb-5221-40fb-bf50-572dd5910f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:30.859793 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9dcfeb-5221-40fb-bf50-572dd5910f0f None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:30.860129 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9dcfeb-5221-40fb-bf50-572dd5910f0f None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:30.860470 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9dcfeb-5221-40fb-bf50-572dd5910f0f None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:30.861459 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9dcfeb-5221-40fb-bf50-572dd5910f0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:30.861831 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9dcfeb-5221-40fb-bf50-572dd5910f0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:30.863391 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9dcfeb-5221-40fb-bf50-572dd5910f0f None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:30.881493 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 474/943] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:30.884829 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9dcfeb-5221-40fb-bf50-572dd5910f0f None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:30.952863 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:30.963149 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad868203-4256-4192-beb1-be2d8f2f6045 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:30.999067 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446caf0d-b8bc-443d-8ec4-3f19818f827a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:30.999681 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446caf0d-b8bc-443d-8ec4-3f19818f827a None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:31.000071 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446caf0d-b8bc-443d-8ec4-3f19818f827a None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:31.000347 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446caf0d-b8bc-443d-8ec4-3f19818f827a None admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:31.001082 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446caf0d-b8bc-443d-8ec4-3f19818f827a None admin] RBAC: Adding query filter params (name=service) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:31.001373 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446caf0d-b8bc-443d-8ec4-3f19818f827a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:31.002885 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446caf0d-b8bc-443d-8ec4-3f19818f827a None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:31.020353 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9dcfeb-5221-40fb-bf50-572dd5910f0f None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:31.029103 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 470/944] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 24 04:37:30 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:31.033770 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:31.059106 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a175922-1d6a-4283-ad88-c3e49a2eddb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:31.060184 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a175922-1d6a-4283-ad88-c3e49a2eddb9 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:31.060666 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a175922-1d6a-4283-ad88-c3e49a2eddb9 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:31.061139 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a175922-1d6a-4283-ad88-c3e49a2eddb9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:31.070575 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a175922-1d6a-4283-ad88-c3e49a2eddb9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:31.072425 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a175922-1d6a-4283-ad88-c3e49a2eddb9 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:31.085932 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-8a175922-1d6a-4283-ad88-c3e49a2eddb9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:37:31.085932 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:31.085932 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:31.085932 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:31.085932 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:31.085932 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:31.085932 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:31.085932 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:31.085932 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:31.085932 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:31.085932 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:31.085932 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:31.085932 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:37:31.085932 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:37:31.085932 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:37:31.085932 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:37:31.086927 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:31.086927 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:31.086927 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:37:31.086927 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:37:31.086927 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:37:31.086927 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:37:31.086927 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:31.086927 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:31.086927 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:31.086927 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:31.086927 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:31.086927 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:31.086927 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:31.086927 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:31.086927 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:31.086927 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:31.086927 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:31.086927 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:31.087849 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:31.087849 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:31.087849 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:37:31.087849 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:37:31.087849 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:37:31.087849 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:37:31.087849 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:37:31.087849 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:37:31.087849 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:37:31.087849 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:31.090571 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 475/945] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Aug 24 04:37:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:31.097110 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446caf0d-b8bc-443d-8ec4-3f19818f827a None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:31.138988 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a175922-1d6a-4283-ad88-c3e49a2eddb9 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:31.222801 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446caf0d-b8bc-443d-8ec4-3f19818f827a None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:31.256765 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a175922-1d6a-4283-ad88-c3e49a2eddb9 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:31.265008 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb7218-c0fd-42b3-9b97-f4888fb38a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:31.265680 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb7218-c0fd-42b3-9b97-f4888fb38a95 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:31.265958 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb7218-c0fd-42b3-9b97-f4888fb38a95 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:31.266232 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb7218-c0fd-42b3-9b97-f4888fb38a95 None admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:31.267222 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb7218-c0fd-42b3-9b97-f4888fb38a95 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:31.267326 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb7218-c0fd-42b3-9b97-f4888fb38a95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:31.268759 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb7218-c0fd-42b3-9b97-f4888fb38a95 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:31.290637 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 471/946] 10.222.0.49 () {56 vars in 1149 bytes} [Wed Aug 24 04:37:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:31.296658 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb7218-c0fd-42b3-9b97-f4888fb38a95 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:31.308153 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e2c04-8360-4670-8a60-ad000f6a42e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:31.308562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:31.308972 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e2c04-8360-4670-8a60-ad000f6a42e7 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:31.309600 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e2c04-8360-4670-8a60-ad000f6a42e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:31.309600 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0e2c04-8360-4670-8a60-ad000f6a42e7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:31.310343 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e2c04-8360-4670-8a60-ad000f6a42e7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:31.311565 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0e2c04-8360-4670-8a60-ad000f6a42e7 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:31.321266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-cd0e2c04-8360-4670-8a60-ad000f6a42e7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:37:31.321266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:31.321266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:37:31.321266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:37:31.321266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:37:31.321266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:37:31.321266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:37:31.321266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:31.321266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:37:31.321266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:31.321266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:37:31.321266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:31.321266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:31.321266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:31.321266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:31.321266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:31.321266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:31.322288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:31.322288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:31.322288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:31.322288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:31.322288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:31.322288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:31.322288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:37:31.322288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:37:31.322288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:37:31.322288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:37:31.322288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:31.322288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:31.322288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:31.322288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:31.322288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:31.322288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:31.323131 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:31.323131 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:31.323131 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:31.323131 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:31.323131 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:31.323131 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:31.323131 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:31.323131 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:31.323131 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:31.323131 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:31.323131 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:37:31.323131 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:31.323131 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:37:31.323131 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:31.323131 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 476/947] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Aug 24 04:37:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:37:31.329023 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e2c04-8360-4670-8a60-ad000f6a42e7 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:31.361981 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:31.428978 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb7218-c0fd-42b3-9b97-f4888fb38a95 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:31.444836 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0e2c04-8360-4670-8a60-ad000f6a42e7 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:31.473871 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0d2cc-0894-4bc3-9fa1-09fa7293ec34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:31.475367 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0d2cc-0894-4bc3-9fa1-09fa7293ec34 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:31.475744 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0d2cc-0894-4bc3-9fa1-09fa7293ec34 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:31.476397 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0d2cc-0894-4bc3-9fa1-09fa7293ec34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:31.490372 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf2ed2-d048-47b9-a0b0-91ddfd0d9f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:31.490913 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0d2cc-0894-4bc3-9fa1-09fa7293ec34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:31.491652 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf2ed2-d048-47b9-a0b0-91ddfd0d9f7d None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:31.492254 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf2ed2-d048-47b9-a0b0-91ddfd0d9f7d None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:31.492570 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0d2cc-0894-4bc3-9fa1-09fa7293ec34 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:31.492865 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf2ed2-d048-47b9-a0b0-91ddfd0d9f7d None admin] PATH_INFO: `/v3/services` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:31.494942 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf2ed2-d048-47b9-a0b0-91ddfd0d9f7d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:31.495250 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf2ed2-d048-47b9-a0b0-91ddfd0d9f7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:31.496613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf2ed2-d048-47b9-a0b0-91ddfd0d9f7d None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:31.506463 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 477/948] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Aug 24 04:37:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:31.513382 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf2ed2-d048-47b9-a0b0-91ddfd0d9f7d None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:31.513566 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-3af0d2cc-0894-4bc3-9fa1-09fa7293ec34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:31.513566 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:31.513566 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:31.513566 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:31.513566 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:31.513566 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:31.513566 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:31.513566 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:31.513566 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:31.513566 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:31.513566 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:31.513566 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:31.513566 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:37:31.513566 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:37:31.513566 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:37:31.513566 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:37:31.514605 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:31.514605 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:31.514605 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:31.514605 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:31.514605 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:31.514605 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:31.514605 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:31.514605 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:31.514605 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:31.514605 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:31.514605 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:31.514605 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:31.514605 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:31.514605 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:31.514605 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:31.514605 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:31.514605 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:37:31.515601 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:37:31.515601 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:31.515601 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:31.515601 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 472/949] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:37:31.520427 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0d2cc-0894-4bc3-9fa1-09fa7293ec34 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:31.589789 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:31.614736 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:31.621464 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf2ed2-d048-47b9-a0b0-91ddfd0d9f7d None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:31.637939 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0d2cc-0894-4bc3-9fa1-09fa7293ec34 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:31.658083 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81908f0a-64d6-4ea5-b60f-dd513b68f8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:31.658714 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81908f0a-64d6-4ea5-b60f-dd513b68f8bd None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:31.658989 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81908f0a-64d6-4ea5-b60f-dd513b68f8bd None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:31.659256 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81908f0a-64d6-4ea5-b60f-dd513b68f8bd None admin] PATH_INFO: `/v3/services` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:31.659893 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81908f0a-64d6-4ea5-b60f-dd513b68f8bd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:31.660188 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81908f0a-64d6-4ea5-b60f-dd513b68f8bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:31.661605 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81908f0a-64d6-4ea5-b60f-dd513b68f8bd None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:31.667641 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 478/950] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Aug 24 04:37:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:31.676476 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81908f0a-64d6-4ea5-b60f-dd513b68f8bd None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:31.685492 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c5093-da36-4b21-80f4-6a75a3617ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:31.686412 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c5093-da36-4b21-80f4-6a75a3617ace None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:31.686922 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c5093-da36-4b21-80f4-6a75a3617ace None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:31.687374 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c5093-da36-4b21-80f4-6a75a3617ace None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:31.688238 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c5093-da36-4b21-80f4-6a75a3617ace None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:31.688844 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c5093-da36-4b21-80f4-6a75a3617ace None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:31.690487 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c5093-da36-4b21-80f4-6a75a3617ace None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:31.706187 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 473/951] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:31.711551 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c5093-da36-4b21-80f4-6a75a3617ace None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:31.817841 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81908f0a-64d6-4ea5-b60f-dd513b68f8bd None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:31.822597 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c5093-da36-4b21-80f4-6a75a3617ace None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:31.844686 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:31.855559 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb240f0a-e5f9-4d41-97b9-43ab008cdaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:31.856179 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb240f0a-e5f9-4d41-97b9-43ab008cdaeb None admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:31.856459 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb240f0a-e5f9-4d41-97b9-43ab008cdaeb None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:31.856736 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb240f0a-e5f9-4d41-97b9-43ab008cdaeb None admin] PATH_INFO: `/v3/endpoints` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:31.857426 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb240f0a-e5f9-4d41-97b9-43ab008cdaeb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:31.858803 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb240f0a-e5f9-4d41-97b9-43ab008cdaeb None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:31.861214 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e355f-54a4-4790-9399-83ec3821402b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:31.862056 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e355f-54a4-4790-9399-83ec3821402b None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:31.862491 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e355f-54a4-4790-9399-83ec3821402b None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:31.862913 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e355f-54a4-4790-9399-83ec3821402b None admin] PATH_INFO: `/v3/projects/service` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:31.870225 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e355f-54a4-4790-9399-83ec3821402b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:31.871866 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e355f-54a4-4790-9399-83ec3821402b None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:31.880830 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 479/952] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:37:31 2022] POST /identity/v3/endpoints => generated 349 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:37:31.882281 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf385aa4-0c14-4833-9e3a-822c5e8e77e2 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:31.882686 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf385aa4-0c14-4833-9e3a-822c5e8e77e2 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:31.883035 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf385aa4-0c14-4833-9e3a-822c5e8e77e2 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:31.886190 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-aa6e355f-54a4-4790-9399-83ec3821402b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:37:31.886190 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:31.886190 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:31.886190 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:31.886190 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:31.886190 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:31.886190 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:31.886190 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:31.886190 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:31.886190 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:31.886190 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:31.886190 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:31.886190 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:37:31.886190 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:37:31.886190 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:37:31.887231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:37:31.887231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:31.887231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:31.887231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:31.887231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:31.887231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:31.887231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:31.887231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:31.887231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:31.887231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:31.887231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:31.887231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:31.887231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:31.887231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:31.887231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:31.887231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:31.887231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:31.888201 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:37:31.888201 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:37:31.888201 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:37:31.888201 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:37:31.888201 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:37:31.888201 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:37:31.888201 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:37:31.888201 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:31.889111 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 480/953] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:31.895787 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ad098-7f4f-4c08-93d7-f1d1e82ee494 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:31.895787 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ad098-7f4f-4c08-93d7-f1d1e82ee494 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:31.895787 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37ad098-7f4f-4c08-93d7-f1d1e82ee494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:31.896698 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 474/954] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:37:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:31.897928 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e355f-54a4-4790-9399-83ec3821402b None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:31.915401 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-d37ad098-7f4f-4c08-93d7-f1d1e82ee494 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:31.916912 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-d37ad098-7f4f-4c08-93d7-f1d1e82ee494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:31.932605 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:32.021512 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 481/955] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:32.039656 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e355f-54a4-4790-9399-83ec3821402b None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:32.091470 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28bbbe6-8c7b-436c-b9fb-7724fa2e8e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:32.092352 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bbbe6-8c7b-436c-b9fb-7724fa2e8e9c None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:32.092797 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bbbe6-8c7b-436c-b9fb-7724fa2e8e9c None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:32.093222 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bbbe6-8c7b-436c-b9fb-7724fa2e8e9c None admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:32.094089 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28bbbe6-8c7b-436c-b9fb-7724fa2e8e9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:32.094539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28bbbe6-8c7b-436c-b9fb-7724fa2e8e9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:32.096122 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28bbbe6-8c7b-436c-b9fb-7724fa2e8e9c None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:32.110572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 475/956] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 24 04:37:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:32.116806 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ad098-7f4f-4c08-93d7-f1d1e82ee494 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:32.222256 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37ad098-7f4f-4c08-93d7-f1d1e82ee494 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:32.257820 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bad1d-1828-458e-94eb-0282623f2b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:32.258536 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bad1d-1828-458e-94eb-0282623f2b4b None admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:32.258819 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bad1d-1828-458e-94eb-0282623f2b4b None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:32.259161 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bad1d-1828-458e-94eb-0282623f2b4b None admin] PATH_INFO: `/v3/projects/08755f450e6c47dcaaaa754a6aa2ec62/users/c737c4586910476eafead0dfd4d9bc4c/roles/ebe27ef209074cbb99d86cc8dde4c5d9` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:32.261609 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656bad1d-1828-458e-94eb-0282623f2b4b None admin] RBAC: Authorizing `identity:create_grant(project_id=08755f450e6c47dcaaaa754a6aa2ec62, user_id=c737c4586910476eafead0dfd4d9bc4c, role_id=ebe27ef209074cbb99d86cc8dde4c5d9)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:32.263120 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656bad1d-1828-458e-94eb-0282623f2b4b None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:32.281113 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 482/957] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 24 04:37:32 2022] PUT /identity/v3/projects/08755f450e6c47dcaaaa754a6aa2ec62/users/c737c4586910476eafead0dfd4d9bc4c/roles/ebe27ef209074cbb99d86cc8dde4c5d9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:37:32.338046 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28bbbe6-8c7b-436c-b9fb-7724fa2e8e9c None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:32.390300 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:32.455371 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28bbbe6-8c7b-436c-b9fb-7724fa2e8e9c None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:32.492118 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96d275-e7bc-4718-a897-89305fc14a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:32.492762 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96d275-e7bc-4718-a897-89305fc14a6b None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:32.493041 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96d275-e7bc-4718-a897-89305fc14a6b None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:32.493313 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96d275-e7bc-4718-a897-89305fc14a6b None admin] PATH_INFO: `/v3/services/compute` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:32.493930 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96d275-e7bc-4718-a897-89305fc14a6b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:32.495313 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d96d275-e7bc-4718-a897-89305fc14a6b None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:32.504618 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-0d96d275-e7bc-4718-a897-89305fc14a6b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:37:32.504618 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:32.504618 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:37:32.504618 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:37:32.504618 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:37:32.504618 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:37:32.504618 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:37:32.504618 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:32.504618 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:37:32.504618 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:32.504618 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:37:32.504618 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:32.504618 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:32.504618 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:32.504618 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:32.504618 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:32.504618 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:32.505788 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:32.505788 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:32.505788 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:32.505788 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:32.505788 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:32.505788 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:32.505788 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:37:32.505788 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:37:32.505788 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:37:32.505788 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:37:32.505788 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:32.505788 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:32.505788 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:32.505788 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:32.505788 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:32.505788 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:32.506647 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:32.506647 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:32.506647 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:32.506647 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:32.506647 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:32.506647 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:32.506647 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:32.506647 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:32.506647 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:32.506647 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:32.506647 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:37:32.506647 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:32.506647 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:37:32.506647 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:32.509462 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 476/958] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:37:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:32.512450 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bad1d-1828-458e-94eb-0282623f2b4b None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:32.516141 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:32.628769 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bad1d-1828-458e-94eb-0282623f2b4b None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:32.663714 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be36cea-f48e-43c8-850a-5edf1d21ec8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:32.664384 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be36cea-f48e-43c8-850a-5edf1d21ec8c None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:32.664667 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be36cea-f48e-43c8-850a-5edf1d21ec8c None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:32.664922 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be36cea-f48e-43c8-850a-5edf1d21ec8c None admin] PATH_INFO: `/v3/services` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:32.665592 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be36cea-f48e-43c8-850a-5edf1d21ec8c None admin] RBAC: Adding query filter params (name=compute) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:32.665891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be36cea-f48e-43c8-850a-5edf1d21ec8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:32.667278 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be36cea-f48e-43c8-850a-5edf1d21ec8c None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:32.672494 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 483/959] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 24 04:37:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:32.678216 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96d275-e7bc-4718-a897-89305fc14a6b None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:32.791685 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96d275-e7bc-4718-a897-89305fc14a6b None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:32.794495 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:32.828651 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375254a-9901-434b-bc34-0f20cb7313f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:32.829670 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375254a-9901-434b-bc34-0f20cb7313f8 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:32.830182 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375254a-9901-434b-bc34-0f20cb7313f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:32.830648 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375254a-9901-434b-bc34-0f20cb7313f8 None admin] PATH_INFO: `/v3/services` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:32.831493 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4375254a-9901-434b-bc34-0f20cb7313f8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:32.832014 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4375254a-9901-434b-bc34-0f20cb7313f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:32.833623 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4375254a-9901-434b-bc34-0f20cb7313f8 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:32.839588 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 477/960] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 24 04:37:32 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:33.093616 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86a6d9-7b63-48a7-b044-0d87561a3164 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:33.093999 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86a6d9-7b63-48a7-b044-0d87561a3164 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:33.094204 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86a6d9-7b63-48a7-b044-0d87561a3164 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:33.095782 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 484/961] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:33.101744 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45637ea-9a97-45af-9a97-b05ad7b42c37 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:33.102029 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45637ea-9a97-45af-9a97-b05ad7b42c37 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:33.102299 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45637ea-9a97-45af-9a97-b05ad7b42c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:33.120269 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-f45637ea-9a97-45af-9a97-b05ad7b42c37 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:33.121494 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-f45637ea-9a97-45af-9a97-b05ad7b42c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:33.203907 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 478/962] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:33.468551 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86a6d9-7b63-48a7-b044-0d87561a3164 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:33.537264 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:33.575507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86a6d9-7b63-48a7-b044-0d87561a3164 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:33.611022 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b32269-0f83-4bfe-ae99-5c3942666c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:33.611632 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b32269-0f83-4bfe-ae99-5c3942666c5b None admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:33.611914 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b32269-0f83-4bfe-ae99-5c3942666c5b None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:33.612183 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b32269-0f83-4bfe-ae99-5c3942666c5b None admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:33.612852 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b32269-0f83-4bfe-ae99-5c3942666c5b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:33.614369 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b32269-0f83-4bfe-ae99-5c3942666c5b None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:33.617012 dv-cinder-854265-1-smb devstack@keystone.service[93148]: WARNING keystone.server.flask.common [None req-52b32269-0f83-4bfe-ae99-5c3942666c5b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 04:37:33.633850 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.sql.core [None req-52b32269-0f83-4bfe-ae99-5c3942666c5b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 04:37:33.633850 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 04:37:33.633850 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [parameters: {'user_id': '08869695d3e94a72803b5b9eb7c0b83f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 04:37:33.633850 dv-cinder-854265-1-smb devstack@keystone.service[93148]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93148) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 04:37:33.650021 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-52b32269-0f83-4bfe-ae99-5c3942666c5b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 04:37:33.650021 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:33.650021 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 04:37:33.650021 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 04:37:33.650021 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 04:37:33.650021 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 04:37:33.650021 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 04:37:33.650021 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 04:37:33.650021 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 04:37:33.650021 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application conn.query(q) Aug 24 04:37:33.650021 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 04:37:33.650021 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 04:37:33.650021 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 04:37:33.650021 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application result.read() Aug 24 04:37:33.650021 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 04:37:33.650983 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 04:37:33.650983 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 04:37:33.650983 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 04:37:33.650983 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 04:37:33.650983 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 04:37:33.650983 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 04:37:33.650983 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 04:37:33.650983 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 04:37:33.650983 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:33.650983 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 04:37:33.650983 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:33.650983 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:33.650983 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 04:37:33.650983 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 04:37:33.650983 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 04:37:33.650983 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 04:37:33.650983 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 04:37:33.650983 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application next(self.gen) Aug 24 04:37:33.651929 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 04:37:33.651929 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application yield resource Aug 24 04:37:33.651929 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 04:37:33.651929 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application next(self.gen) Aug 24 04:37:33.651929 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 04:37:33.651929 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 04:37:33.651929 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 04:37:33.651929 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 04:37:33.651929 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 04:37:33.651929 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise self.value Aug 24 04:37:33.651929 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 04:37:33.651929 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 04:37:33.651929 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 04:37:33.651929 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application session.commit() Aug 24 04:37:33.651929 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 04:37:33.651929 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 04:37:33.651929 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 04:37:33.652823 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 04:37:33.652823 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 04:37:33.652823 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application self.session.flush() Aug 24 04:37:33.652823 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 04:37:33.652823 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 04:37:33.652823 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 04:37:33.652823 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 04:37:33.652823 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 04:37:33.652823 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application compat.raise_( Aug 24 04:37:33.652823 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 04:37:33.652823 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception Aug 24 04:37:33.652823 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 04:37:33.652823 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 04:37:33.652823 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 04:37:33.652823 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 04:37:33.652823 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 04:37:33.652823 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 04:37:33.653766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 04:37:33.653766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 04:37:33.653766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 04:37:33.653766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 04:37:33.653766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 04:37:33.653766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 04:37:33.653766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 04:37:33.653766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 04:37:33.653766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 04:37:33.653766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 04:37:33.653766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 04:37:33.653766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 04:37:33.653766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 04:37:33.653766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 04:37:33.653766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 04:37:33.653766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception Aug 24 04:37:33.654618 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 04:37:33.654618 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 04:37:33.654618 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 04:37:33.654618 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 04:37:33.654618 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 04:37:33.654618 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 04:37:33.654618 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 04:37:33.654618 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application conn.query(q) Aug 24 04:37:33.654618 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 04:37:33.654618 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 04:37:33.654618 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 04:37:33.654618 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application result.read() Aug 24 04:37:33.654618 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 04:37:33.654618 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 04:37:33.654618 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 04:37:33.654618 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 04:37:33.655445 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 04:37:33.655445 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 04:37:33.655445 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 04:37:33.655445 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 04:37:33.655445 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 04:37:33.655445 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 04:37:33.655445 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [parameters: {'user_id': '08869695d3e94a72803b5b9eb7c0b83f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 04:37:33.655445 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 04:37:33.655445 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:33.655445 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:37:33.655445 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:33.655445 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:33.655445 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:33.655445 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:33.655445 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:33.656228 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:33.656228 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:33.656228 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:33.656228 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:33.656228 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:33.656228 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:33.656228 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:33.656228 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 04:37:33.656228 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 04:37:33.656228 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:33.656228 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:33.656228 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:37:33.656228 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:37:33.656228 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:37:33.656228 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:37:33.656228 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 04:37:33.656228 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 04:37:33.658838 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 04:37:33.658838 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 04:37:33.658838 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 04:37:33.658838 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 04:37:33.658838 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 04:37:33.658838 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:33.658838 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 485/963] 10.222.0.49 () {60 vars in 1131 bytes} [Wed Aug 24 04:37:33 2022] POST /identity/v3/users => generated 160 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:33.659724 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45637ea-9a97-45af-9a97-b05ad7b42c37 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:33.759572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:33.763496 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45637ea-9a97-45af-9a97-b05ad7b42c37 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:33.801585 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ef047-c743-4060-a66c-86b7b52b8808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:33.802693 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ef047-c743-4060-a66c-86b7b52b8808 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:33.803185 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ef047-c743-4060-a66c-86b7b52b8808 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:33.803684 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ef047-c743-4060-a66c-86b7b52b8808 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:33.816464 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9ef047-c743-4060-a66c-86b7b52b8808 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:33.817956 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9ef047-c743-4060-a66c-86b7b52b8808 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:33.830654 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-8b9ef047-c743-4060-a66c-86b7b52b8808 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:37:33.830654 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:33.830654 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:33.830654 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:33.830654 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:33.830654 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:33.830654 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:33.830654 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:33.830654 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:33.830654 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:33.830654 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:33.830654 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:33.830654 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:37:33.830654 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:37:33.830654 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:37:33.830654 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:37:33.831659 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:33.831659 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:33.831659 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:37:33.831659 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:37:33.831659 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:37:33.831659 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:37:33.831659 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:33.831659 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:33.831659 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:33.831659 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:33.831659 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:33.831659 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:33.831659 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:33.831659 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:33.831659 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:33.831659 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:33.831659 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:33.831659 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:33.832964 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:33.832964 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:33.832964 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:37:33.832964 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:37:33.832964 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:37:33.832964 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:37:33.832964 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:37:33.832964 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:37:33.832964 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:37:33.832964 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:33.832964 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 479/964] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:37:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:33.838087 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b32269-0f83-4bfe-ae99-5c3942666c5b None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:33.943090 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b32269-0f83-4bfe-ae99-5c3942666c5b None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:33.971499 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:33.980793 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad801f92-0ab0-461c-8b25-eb4d54485421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:33.981287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c09e1-51ac-49a8-8d3c-d09c5e8dc997 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:33.981466 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad801f92-0ab0-461c-8b25-eb4d54485421 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:33.981602 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c09e1-51ac-49a8-8d3c-d09c5e8dc997 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:33.981734 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad801f92-0ab0-461c-8b25-eb4d54485421 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:33.981863 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c09e1-51ac-49a8-8d3c-d09c5e8dc997 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:33.981972 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad801f92-0ab0-461c-8b25-eb4d54485421 None admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:33.982696 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad801f92-0ab0-461c-8b25-eb4d54485421 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:33.983001 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad801f92-0ab0-461c-8b25-eb4d54485421 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:33.983567 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 480/965] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:33.985084 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad801f92-0ab0-461c-8b25-eb4d54485421 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:33.989560 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a59f73-1c53-47c1-80fa-aeb6a9f543f4 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:33.990302 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a59f73-1c53-47c1-80fa-aeb6a9f543f4 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:33.990302 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a59f73-1c53-47c1-80fa-aeb6a9f543f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:34.014830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-10a59f73-1c53-47c1-80fa-aeb6a9f543f4 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:34.015987 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-10a59f73-1c53-47c1-80fa-aeb6a9f543f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:34.027407 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 486/966] 10.222.0.49 () {56 vars in 1101 bytes} [Wed Aug 24 04:37:33 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:34.108369 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 481/967] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:34.312430 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fe8cd-0d94-4973-9709-875b40e9c4e0 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:34.312628 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fe8cd-0d94-4973-9709-875b40e9c4e0 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:34.313002 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33fe8cd-0d94-4973-9709-875b40e9c4e0 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:34.314573 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 487/968] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:34.319815 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb7000-8416-45e4-bccc-50b88a41fd3d None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:34.320141 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb7000-8416-45e4-bccc-50b88a41fd3d None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:34.320417 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb7000-8416-45e4-bccc-50b88a41fd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:34.338715 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-7beb7000-8416-45e4-bccc-50b88a41fd3d None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:34.339908 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-7beb7000-8416-45e4-bccc-50b88a41fd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:34.386597 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fe8cd-0d94-4973-9709-875b40e9c4e0 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:34.413213 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 482/969] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:34.498185 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33fe8cd-0d94-4973-9709-875b40e9c4e0 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:34.536001 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23316126-b7f2-406a-af93-5974aa84a98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:34.536638 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23316126-b7f2-406a-af93-5974aa84a98d None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:34.536917 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23316126-b7f2-406a-af93-5974aa84a98d None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:34.537188 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23316126-b7f2-406a-af93-5974aa84a98d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:34.537809 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23316126-b7f2-406a-af93-5974aa84a98d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:34.539208 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23316126-b7f2-406a-af93-5974aa84a98d None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:34.547993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-23316126-b7f2-406a-af93-5974aa84a98d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:37:34.547993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:34.547993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:37:34.547993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:37:34.547993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:37:34.547993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:37:34.547993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:37:34.547993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:34.547993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:37:34.547993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:34.547993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:37:34.547993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:34.547993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:34.547993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:34.547993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:34.547993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:34.547993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:34.548967 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:34.548967 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:34.548967 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:34.548967 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:34.548967 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:34.548967 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:34.548967 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:37:34.548967 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:37:34.548967 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:37:34.548967 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:37:34.548967 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:34.548967 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:34.548967 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:34.548967 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:34.548967 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:34.548967 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:34.554402 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:34.554402 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:34.554402 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:34.554402 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:34.554402 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:34.554402 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:34.554402 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:34.554402 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:34.554402 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:34.554402 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:34.554402 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:37:34.554402 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:34.554402 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:37:34.554402 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:34.554402 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 488/970] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Aug 24 04:37:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:34.555458 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb7000-8416-45e4-bccc-50b88a41fd3d None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:34.574979 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:34.660745 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb7000-8416-45e4-bccc-50b88a41fd3d None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:34.681812 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23316126-b7f2-406a-af93-5974aa84a98d None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:34.698420 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27aac5c-8a0e-4f45-9c8e-76dba09e331c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:34.699036 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27aac5c-8a0e-4f45-9c8e-76dba09e331c None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:34.699316 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27aac5c-8a0e-4f45-9c8e-76dba09e331c None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:34.699583 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27aac5c-8a0e-4f45-9c8e-76dba09e331c None admin] PATH_INFO: `/v3/services` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:34.700219 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27aac5c-8a0e-4f45-9c8e-76dba09e331c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:34.700521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27aac5c-8a0e-4f45-9c8e-76dba09e331c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:34.702542 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27aac5c-8a0e-4f45-9c8e-76dba09e331c None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:34.708236 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 483/971] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Aug 24 04:37:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:34.713703 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27aac5c-8a0e-4f45-9c8e-76dba09e331c None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:34.739504 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:34.796216 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23316126-b7f2-406a-af93-5974aa84a98d None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:34.804801 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:34.825155 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27aac5c-8a0e-4f45-9c8e-76dba09e331c None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:34.830169 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c95d9-d953-4f57-a5d1-a9e4e8024aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:34.830804 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c95d9-d953-4f57-a5d1-a9e4e8024aae None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:34.831086 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c95d9-d953-4f57-a5d1-a9e4e8024aae None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:34.831353 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c95d9-d953-4f57-a5d1-a9e4e8024aae None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:34.842288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c95d9-d953-4f57-a5d1-a9e4e8024aae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:37:34.847433 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-a42c95d9-d953-4f57-a5d1-a9e4e8024aae None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:37:34.847433 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:34.847433 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:34.847433 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:34.847433 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:34.847433 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:34.847433 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:34.847433 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:34.847433 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:34.847433 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:34.847433 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:34.847433 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:34.847433 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:37:34.847433 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:37:34.847433 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:37:34.847433 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:37:34.848324 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:37:34.848324 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:37:34.848324 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:37:34.848324 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:37:34.848324 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:34.848324 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:34.848324 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:34.848324 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:34.848324 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:34.848324 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:34.848324 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:34.848324 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:34.848324 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:34.848324 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:34.848324 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:34.848324 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:34.849787 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:34.849787 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:34.849787 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:34.849787 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:34.849787 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:37:34.849787 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:37:34.849787 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:37:34.849787 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:37:34.849787 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:37:34.849787 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:37:34.849787 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:37:34.849787 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:34.849787 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 489/972] 10.222.0.49 () {56 vars in 1120 bytes} [Wed Aug 24 04:37:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:34.854798 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3c709-9c9c-4cbd-858b-21d2973fe27b None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:34.855078 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3c709-9c9c-4cbd-858b-21d2973fe27b None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:34.855347 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3c709-9c9c-4cbd-858b-21d2973fe27b None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:34.856624 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 490/973] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:34.857314 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3c709-9c9c-4cbd-858b-21d2973fe27b None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:34.862433 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754f0a98-03e2-4491-a43d-c9a2c07a6401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:34.863056 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f0a98-03e2-4491-a43d-c9a2c07a6401 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:34.863336 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f0a98-03e2-4491-a43d-c9a2c07a6401 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:34.863609 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754f0a98-03e2-4491-a43d-c9a2c07a6401 None admin] PATH_INFO: `/v3/services` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:34.864256 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f0a98-03e2-4491-a43d-c9a2c07a6401 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:34.864559 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f0a98-03e2-4491-a43d-c9a2c07a6401 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:34.866045 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754f0a98-03e2-4491-a43d-c9a2c07a6401 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:34.871088 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 484/974] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Aug 24 04:37:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:34.872235 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5751ae-a5c1-460b-a4a0-3f7264888707 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:34.872634 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5751ae-a5c1-460b-a4a0-3f7264888707 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:34.872906 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5751ae-a5c1-460b-a4a0-3f7264888707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:34.890823 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-0d5751ae-a5c1-460b-a4a0-3f7264888707 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:34.892013 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-0d5751ae-a5c1-460b-a4a0-3f7264888707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:34.959739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 485/975] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:34.960604 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5751ae-a5c1-460b-a4a0-3f7264888707 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:34.962058 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3c709-9c9c-4cbd-858b-21d2973fe27b None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:34.978919 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:35.004992 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de493f5-752d-4900-b551-10d5ef28e9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:35.005638 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de493f5-752d-4900-b551-10d5ef28e9af None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:35.005921 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de493f5-752d-4900-b551-10d5ef28e9af None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:35.006185 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de493f5-752d-4900-b551-10d5ef28e9af None admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:35.006868 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de493f5-752d-4900-b551-10d5ef28e9af None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:35.007172 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de493f5-752d-4900-b551-10d5ef28e9af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:35.008603 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de493f5-752d-4900-b551-10d5ef28e9af None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:35.017265 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 491/976] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Aug 24 04:37:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:35.022700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de493f5-752d-4900-b551-10d5ef28e9af None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:35.045302 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:35.071630 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5751ae-a5c1-460b-a4a0-3f7264888707 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:35.108520 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10bcaa6-1e1d-479f-84af-54436a417221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:35.109425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bcaa6-1e1d-479f-84af-54436a417221 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:35.109708 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bcaa6-1e1d-479f-84af-54436a417221 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:35.109977 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bcaa6-1e1d-479f-84af-54436a417221 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:35.110825 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10bcaa6-1e1d-479f-84af-54436a417221 None admin] RBAC: Adding query filter params (interface=admin, service_id=5b41cad5599f4db08bb3c6a919c00ea2, region_id=RegionOne) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:35.111420 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10bcaa6-1e1d-479f-84af-54436a417221 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:35.112817 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10bcaa6-1e1d-479f-84af-54436a417221 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:35.118832 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 486/977] 10.222.0.49 () {56 vars in 1249 bytes} [Wed Aug 24 04:37:34 2022] GET /identity/v3/endpoints?service_id=5b41cad5599f4db08bb3c6a919c00ea2&interface=admin®ion_id=RegionOne => generated 193 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:35.124548 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10bcaa6-1e1d-479f-84af-54436a417221 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:35.125822 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de493f5-752d-4900-b551-10d5ef28e9af None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:35.165194 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6eeac-9796-4635-9be1-a0bd582b86e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:35.165867 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6eeac-9796-4635-9be1-a0bd582b86e5 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:35.166146 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6eeac-9796-4635-9be1-a0bd582b86e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:35.166418 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6eeac-9796-4635-9be1-a0bd582b86e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:35.177700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6eeac-9796-4635-9be1-a0bd582b86e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:35.179176 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6eeac-9796-4635-9be1-a0bd582b86e5 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:35.192940 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-52a6eeac-9796-4635-9be1-a0bd582b86e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:35.192940 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:35.192940 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:35.192940 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:35.192940 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:35.192940 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:35.192940 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:35.192940 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:35.192940 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:35.192940 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:35.192940 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:35.192940 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:35.192940 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:37:35.192940 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:37:35.192940 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:37:35.192940 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:37:35.194041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:35.194041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:35.194041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:35.194041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:35.194041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:35.194041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:35.194041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:35.194041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:35.194041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:35.194041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:35.194041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:35.194041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:35.194041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:35.194041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:35.194041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:35.194041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:35.194041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:37:35.194983 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:37:35.194983 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:35.194983 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:35.194983 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 492/978] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:37:35.199802 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6eeac-9796-4635-9be1-a0bd582b86e5 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:35.227474 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:35.244134 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10bcaa6-1e1d-479f-84af-54436a417221 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:35.279586 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f7534-f70e-4497-ab00-b5de9ded512e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:35.280247 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f7534-f70e-4497-ab00-b5de9ded512e None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:35.280522 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f7534-f70e-4497-ab00-b5de9ded512e None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:35.280794 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f7534-f70e-4497-ab00-b5de9ded512e None admin] PATH_INFO: `/v3/services` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:35.281465 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f7534-f70e-4497-ab00-b5de9ded512e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:35.282854 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f7534-f70e-4497-ab00-b5de9ded512e None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:35.289085 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 487/979] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Aug 24 04:37:35 2022] GET /identity/v3/services => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:37:35.289891 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f7534-f70e-4497-ab00-b5de9ded512e None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:35.294218 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:35.308071 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6eeac-9796-4635-9be1-a0bd582b86e5 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:35.355239 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7073a88-d192-4ab8-8407-209b2a0f95ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:35.355992 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7073a88-d192-4ab8-8407-209b2a0f95ed None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:35.356274 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7073a88-d192-4ab8-8407-209b2a0f95ed None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:35.356537 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7073a88-d192-4ab8-8407-209b2a0f95ed None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:35.357385 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7073a88-d192-4ab8-8407-209b2a0f95ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:35.358060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7073a88-d192-4ab8-8407-209b2a0f95ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:35.359978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7073a88-d192-4ab8-8407-209b2a0f95ed None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:35.381625 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 493/980] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:35.383355 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7073a88-d192-4ab8-8407-209b2a0f95ed None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:35.408574 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f7534-f70e-4497-ab00-b5de9ded512e None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:35.468614 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d1ab9-7caf-4b52-80f0-10ff48819dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:35.469620 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d1ab9-7caf-4b52-80f0-10ff48819dbf None admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:35.470105 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d1ab9-7caf-4b52-80f0-10ff48819dbf None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:35.470569 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d1ab9-7caf-4b52-80f0-10ff48819dbf None admin] PATH_INFO: `/v3/services` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:35.471501 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d1ab9-7caf-4b52-80f0-10ff48819dbf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:35.473150 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d1ab9-7caf-4b52-80f0-10ff48819dbf None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:35.485859 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:35.501259 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 488/981] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 24 04:37:35 2022] POST /identity/v3/services => generated 242 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:37:35.502469 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7073a88-d192-4ab8-8407-209b2a0f95ed None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:35.552150 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f3356-038c-4a2c-af62-5ad27869cb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:35.552840 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f3356-038c-4a2c-af62-5ad27869cb79 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:35.553145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f3356-038c-4a2c-af62-5ad27869cb79 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:35.553360 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f3356-038c-4a2c-af62-5ad27869cb79 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:35.562133 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f3356-038c-4a2c-af62-5ad27869cb79 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:35.563597 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f3356-038c-4a2c-af62-5ad27869cb79 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:35.577009 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-224f3356-038c-4a2c-af62-5ad27869cb79 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:37:35.577009 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:35.577009 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:35.577009 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:35.577009 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:35.577009 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:35.577009 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:35.577009 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:35.577009 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:35.577009 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:35.577009 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:35.577009 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:35.577009 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:37:35.577009 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:37:35.577009 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:37:35.577009 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:37:35.578105 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:35.578105 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:35.578105 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:37:35.578105 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:37:35.578105 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:37:35.578105 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:37:35.578105 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:35.578105 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:35.578105 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:35.578105 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:35.578105 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:35.578105 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:35.578105 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:35.578105 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:35.578105 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:35.578105 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:35.578105 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:35.578105 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:35.584490 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:35.584490 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:35.584490 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:37:35.584490 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:37:35.584490 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:37:35.584490 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:37:35.584490 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:37:35.584490 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:37:35.584490 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:37:35.584490 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:35.584490 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 494/982] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Aug 24 04:37:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:35.585444 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d1ab9-7caf-4b52-80f0-10ff48819dbf None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:35.658780 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:35.705182 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d1ab9-7caf-4b52-80f0-10ff48819dbf None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:35.744363 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf23a4-bcc2-4fd8-a46a-2afe57e69a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:35.745042 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf23a4-bcc2-4fd8-a46a-2afe57e69a92 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:35.745328 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf23a4-bcc2-4fd8-a46a-2afe57e69a92 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:35.745634 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf23a4-bcc2-4fd8-a46a-2afe57e69a92 None admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:35.746422 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf23a4-bcc2-4fd8-a46a-2afe57e69a92 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:35.746726 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf23a4-bcc2-4fd8-a46a-2afe57e69a92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:35.748297 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf23a4-bcc2-4fd8-a46a-2afe57e69a92 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:35.774923 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 489/983] 10.222.0.49 () {56 vars in 1149 bytes} [Wed Aug 24 04:37:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:35.785070 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f3356-038c-4a2c-af62-5ad27869cb79 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:35.895245 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f3356-038c-4a2c-af62-5ad27869cb79 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:35.929570 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b7e2a-2746-4f1c-9d74-fb26cb063da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:35.930091 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b7e2a-2746-4f1c-9d74-fb26cb063da3 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:35.930364 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b7e2a-2746-4f1c-9d74-fb26cb063da3 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:35.930628 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b7e2a-2746-4f1c-9d74-fb26cb063da3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:35.941918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:36.004217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b7e2a-2746-4f1c-9d74-fb26cb063da3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:36.006056 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b7e2a-2746-4f1c-9d74-fb26cb063da3 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:36.108183 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 495/984] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:37:35 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:37:36.113752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf23a4-bcc2-4fd8-a46a-2afe57e69a92 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:36.229303 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf23a4-bcc2-4fd8-a46a-2afe57e69a92 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:36.253367 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:36.266790 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a4ba7-49c3-41cf-bf76-a6100cf8c1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:36.267443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a4ba7-49c3-41cf-bf76-a6100cf8c1e5 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:36.267718 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a4ba7-49c3-41cf-bf76-a6100cf8c1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:36.267989 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a4ba7-49c3-41cf-bf76-a6100cf8c1e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:36.278244 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a4ba7-49c3-41cf-bf76-a6100cf8c1e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:36.279913 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a4ba7-49c3-41cf-bf76-a6100cf8c1e5 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:36.294766 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-904a4ba7-49c3-41cf-bf76-a6100cf8c1e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:36.294766 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:36.294766 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:36.294766 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:36.294766 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:36.294766 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:36.294766 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:36.294766 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:36.294766 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:36.294766 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:36.294766 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:36.294766 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:36.294766 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:37:36.294766 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:37:36.294766 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:37:36.294766 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:37:36.296364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:36.296364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:36.296364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:36.296364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:36.296364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:36.296364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:36.296364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:36.296364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:36.296364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:36.296364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:36.296364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:36.296364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:36.296364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:36.296364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:36.296364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:36.296364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:36.296364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:37:36.297270 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:37:36.297270 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:36.297270 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:36.300706 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 490/985] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:36.301769 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b7e2a-2746-4f1c-9d74-fb26cb063da3 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:36.346188 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:36.416557 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b7e2a-2746-4f1c-9d74-fb26cb063da3 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:36.452823 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4bc9a6-c4ba-49a4-a9c2-17e10b9a431b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:36.453465 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bc9a6-c4ba-49a4-a9c2-17e10b9a431b None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:36.453748 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bc9a6-c4ba-49a4-a9c2-17e10b9a431b None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:36.454000 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bc9a6-c4ba-49a4-a9c2-17e10b9a431b None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:36.454724 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4bc9a6-c4ba-49a4-a9c2-17e10b9a431b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:36.455022 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4bc9a6-c4ba-49a4-a9c2-17e10b9a431b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:36.456481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4bc9a6-c4ba-49a4-a9c2-17e10b9a431b None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:36.473134 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 496/986] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:36.474705 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a4ba7-49c3-41cf-bf76-a6100cf8c1e5 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:36.581825 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a4ba7-49c3-41cf-bf76-a6100cf8c1e5 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:36.619597 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1278b8-326f-4c16-9f79-eed4ee82d4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:36.620642 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1278b8-326f-4c16-9f79-eed4ee82d4a9 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:36.621119 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1278b8-326f-4c16-9f79-eed4ee82d4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:36.621653 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1278b8-326f-4c16-9f79-eed4ee82d4a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:36.629518 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1278b8-326f-4c16-9f79-eed4ee82d4a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:36.631257 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1278b8-326f-4c16-9f79-eed4ee82d4a9 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:36.642793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-5c1278b8-326f-4c16-9f79-eed4ee82d4a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:37:36.642793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:36.642793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:36.642793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:36.642793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:36.642793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:36.642793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:36.642793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:36.642793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:36.642793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:36.642793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:36.642793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:36.642793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:37:36.642793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:37:36.642793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:37:36.643796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:37:36.643796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:36.643796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:36.643796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:36.643796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:36.643796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:36.643796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:36.643796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:36.643796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:36.643796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:36.643796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:36.643796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:36.643796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:36.643796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:36.643796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:36.643796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:36.643796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:36.644674 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:37:36.644674 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:37:36.644674 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:37:36.644674 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:37:36.644674 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:37:36.644674 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:37:36.644674 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:37:36.644674 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:36.651647 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 491/987] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:37:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:37:36.652956 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4bc9a6-c4ba-49a4-a9c2-17e10b9a431b None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:36.756549 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:36.760336 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4bc9a6-c4ba-49a4-a9c2-17e10b9a431b None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:36.797929 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7433733e-2710-448e-bf05-abb8f7f64b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:36.798576 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433733e-2710-448e-bf05-abb8f7f64b27 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:36.798858 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433733e-2710-448e-bf05-abb8f7f64b27 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:36.799127 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7433733e-2710-448e-bf05-abb8f7f64b27 None admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:36.799973 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433733e-2710-448e-bf05-abb8f7f64b27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:36.800288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433733e-2710-448e-bf05-abb8f7f64b27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:36.801784 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7433733e-2710-448e-bf05-abb8f7f64b27 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:36.815812 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 497/988] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 24 04:37:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:36.821924 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1278b8-326f-4c16-9f79-eed4ee82d4a9 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:36.860773 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:36.931572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1278b8-326f-4c16-9f79-eed4ee82d4a9 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:36.967034 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691374dd-debf-4e6f-b6b3-e803a6b23887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:36.967651 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691374dd-debf-4e6f-b6b3-e803a6b23887 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:36.967925 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691374dd-debf-4e6f-b6b3-e803a6b23887 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:36.968197 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691374dd-debf-4e6f-b6b3-e803a6b23887 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:36.968996 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691374dd-debf-4e6f-b6b3-e803a6b23887 None admin] RBAC: Adding query filter params (role.id=ebe27ef209074cbb99d86cc8dde4c5d9, scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62, user.id=c737c4586910476eafead0dfd4d9bc4c) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:36.969306 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691374dd-debf-4e6f-b6b3-e803a6b23887 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:36.970772 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691374dd-debf-4e6f-b6b3-e803a6b23887 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:36.978517 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 492/989] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:37:36 2022] GET /identity/v3/role_assignments?user.id=c737c4586910476eafead0dfd4d9bc4c&scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62&role.id=ebe27ef209074cbb99d86cc8dde4c5d9 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:37.209257 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863bafe-82f2-47ed-a3d3-becbc2f02949 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:37.209642 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863bafe-82f2-47ed-a3d3-becbc2f02949 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:37.209825 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863bafe-82f2-47ed-a3d3-becbc2f02949 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:37.211271 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 498/990] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:37.217167 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c0fca-ac6e-41d7-87e0-389f2fb73bba None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:37.217488 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c0fca-ac6e-41d7-87e0-389f2fb73bba None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:37.217741 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c0fca-ac6e-41d7-87e0-389f2fb73bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:37.237435 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-097c0fca-ac6e-41d7-87e0-389f2fb73bba None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:37.238667 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-097c0fca-ac6e-41d7-87e0-389f2fb73bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:37.318283 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 493/991] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:37 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:37.506827 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29762df5-8405-4d9c-b4b5-317f8e2c7f73 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:37.507015 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29762df5-8405-4d9c-b4b5-317f8e2c7f73 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:37.507239 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29762df5-8405-4d9c-b4b5-317f8e2c7f73 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:37.508891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 499/992] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:37.514213 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f3722-2915-4a4c-b36c-352cb90959aa None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:37.514554 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f3722-2915-4a4c-b36c-352cb90959aa None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:37.514752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f3722-2915-4a4c-b36c-352cb90959aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:37.535231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-100f3722-2915-4a4c-b36c-352cb90959aa None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:37.536464 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-100f3722-2915-4a4c-b36c-352cb90959aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:37.561239 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:37.586566 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29762df5-8405-4d9c-b4b5-317f8e2c7f73 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:37.609601 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 494/993] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:37 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:37.698640 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29762df5-8405-4d9c-b4b5-317f8e2c7f73 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:37.732476 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c1fa4-7c9b-4049-8670-8aa152fe1a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:37.733119 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c1fa4-7c9b-4049-8670-8aa152fe1a84 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:37.733424 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c1fa4-7c9b-4049-8670-8aa152fe1a84 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:37.733698 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c1fa4-7c9b-4049-8670-8aa152fe1a84 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:37.734305 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85c1fa4-7c9b-4049-8670-8aa152fe1a84 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:37.735682 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85c1fa4-7c9b-4049-8670-8aa152fe1a84 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:37.744361 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-b85c1fa4-7c9b-4049-8670-8aa152fe1a84 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:37:37.744361 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:37.744361 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:37:37.744361 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:37:37.744361 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:37:37.744361 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:37:37.744361 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:37:37.744361 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:37.744361 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:37:37.744361 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:37.744361 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:37:37.744361 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:37.744361 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:37.744361 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:37.744361 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:37.744361 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:37.744361 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:37.745314 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:37.745314 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:37.745314 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:37.745314 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:37.745314 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:37.745314 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:37.745314 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:37:37.745314 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:37:37.745314 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:37:37.745314 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:37:37.745314 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:37.745314 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:37.745314 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:37.745314 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:37.745314 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:37.745314 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:37.746185 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:37.746185 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:37.746185 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:37.746185 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:37.746185 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:37.746185 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:37.746185 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:37.746185 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:37.746185 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:37.746185 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:37.746185 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:37:37.746185 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:37.746185 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:37:37.746185 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:37.749907 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 500/994] 10.222.0.49 () {56 vars in 1126 bytes} [Wed Aug 24 04:37:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:37:37.751964 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f3722-2915-4a4c-b36c-352cb90959aa None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:37.855286 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f3722-2915-4a4c-b36c-352cb90959aa None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:37.893412 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c1fa4-7c9b-4049-8670-8aa152fe1a84 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:37.893616 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599047e-14aa-4dcf-84e8-9f2c9f43137f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:37.894223 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599047e-14aa-4dcf-84e8-9f2c9f43137f None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:37.894502 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599047e-14aa-4dcf-84e8-9f2c9f43137f None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:37.894773 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599047e-14aa-4dcf-84e8-9f2c9f43137f None admin] PATH_INFO: `/v3/services` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:37.895422 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599047e-14aa-4dcf-84e8-9f2c9f43137f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:37.895730 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599047e-14aa-4dcf-84e8-9f2c9f43137f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:37.897120 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599047e-14aa-4dcf-84e8-9f2c9f43137f None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:37.905504 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 495/995] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Aug 24 04:37:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:37.908136 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599047e-14aa-4dcf-84e8-9f2c9f43137f None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:37.920658 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:37.938985 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:38.000759 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c1fa4-7c9b-4049-8670-8aa152fe1a84 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:38.024356 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599047e-14aa-4dcf-84e8-9f2c9f43137f None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:38.038787 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c6b43-90d5-49d3-a596-08402b03b72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:38.039515 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c6b43-90d5-49d3-a596-08402b03b72e None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:38.039801 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c6b43-90d5-49d3-a596-08402b03b72e None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:38.040076 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2c6b43-90d5-49d3-a596-08402b03b72e None admin] PATH_INFO: `/v3/services/compute` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:38.040678 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c6b43-90d5-49d3-a596-08402b03b72e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:38.042116 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2c6b43-90d5-49d3-a596-08402b03b72e None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:38.052087 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-be2c6b43-90d5-49d3-a596-08402b03b72e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:37:38.052087 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:38.052087 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:37:38.052087 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:37:38.052087 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:37:38.052087 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:37:38.052087 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:37:38.052087 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:38.052087 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:37:38.052087 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:38.052087 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:37:38.052087 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:38.052087 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:38.052087 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:38.052087 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:38.052087 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:38.052087 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:38.053231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:38.053231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:38.053231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:38.053231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:38.053231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:38.053231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:38.053231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:37:38.053231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:37:38.053231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:37:38.053231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:37:38.053231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:38.053231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:38.053231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:38.053231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:38.053231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:38.053231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:38.054145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:38.054145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:38.054145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:38.054145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:38.054145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:38.054145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:38.054145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:38.054145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:38.054145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:38.054145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:38.054145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:37:38.054145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:38.054145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:37:38.054145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:38.054145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 501/996] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:37:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:38.059528 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c6b43-90d5-49d3-a596-08402b03b72e None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:38.065018 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aeb282-1a48-4101-a33c-040c40ca1984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:38.065682 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aeb282-1a48-4101-a33c-040c40ca1984 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:38.065965 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aeb282-1a48-4101-a33c-040c40ca1984 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:38.066238 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aeb282-1a48-4101-a33c-040c40ca1984 None admin] PATH_INFO: `/v3/services` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:38.066905 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aeb282-1a48-4101-a33c-040c40ca1984 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:38.067210 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aeb282-1a48-4101-a33c-040c40ca1984 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:38.068643 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aeb282-1a48-4101-a33c-040c40ca1984 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:38.076336 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 496/997] 10.222.0.49 () {56 vars in 1122 bytes} [Wed Aug 24 04:37:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:38.082552 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aeb282-1a48-4101-a33c-040c40ca1984 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:38.170114 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:38.183544 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2c6b43-90d5-49d3-a596-08402b03b72e None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:38.189455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:38.206523 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aeb282-1a48-4101-a33c-040c40ca1984 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:38.219444 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970fcd1-ca90-4fe5-a8a9-239a50358b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:38.220084 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970fcd1-ca90-4fe5-a8a9-239a50358b08 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:38.220371 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970fcd1-ca90-4fe5-a8a9-239a50358b08 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:38.220605 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970fcd1-ca90-4fe5-a8a9-239a50358b08 None admin] PATH_INFO: `/v3/services` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:38.221247 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970fcd1-ca90-4fe5-a8a9-239a50358b08 None admin] RBAC: Adding query filter params (name=compute) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:38.221849 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970fcd1-ca90-4fe5-a8a9-239a50358b08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:38.222981 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970fcd1-ca90-4fe5-a8a9-239a50358b08 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:38.233003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 502/998] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 24 04:37:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:38.234088 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970fcd1-ca90-4fe5-a8a9-239a50358b08 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:38.250478 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a3b26-2e2b-491d-bd18-a5a5fefe6a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:38.251523 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a3b26-2e2b-491d-bd18-a5a5fefe6a04 None admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:38.251921 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a3b26-2e2b-491d-bd18-a5a5fefe6a04 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:38.252378 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a3b26-2e2b-491d-bd18-a5a5fefe6a04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:38.253223 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92a3b26-2e2b-491d-bd18-a5a5fefe6a04 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:38.255150 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92a3b26-2e2b-491d-bd18-a5a5fefe6a04 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:38.273914 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 497/999] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:37:38 2022] POST /identity/v3/endpoints => generated 325 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:37:38.357021 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970fcd1-ca90-4fe5-a8a9-239a50358b08 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:38.401160 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b752a4-fb49-418a-8920-a0ffefc14219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:38.401814 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b752a4-fb49-418a-8920-a0ffefc14219 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:38.402098 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b752a4-fb49-418a-8920-a0ffefc14219 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:38.402368 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b752a4-fb49-418a-8920-a0ffefc14219 None admin] PATH_INFO: `/v3/services` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:38.403002 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b752a4-fb49-418a-8920-a0ffefc14219 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:38.403306 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b752a4-fb49-418a-8920-a0ffefc14219 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:38.404836 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b752a4-fb49-418a-8920-a0ffefc14219 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:38.415597 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 503/1000] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 24 04:37:38 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:38.417282 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a3b26-2e2b-491d-bd18-a5a5fefe6a04 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:38.531961 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a3b26-2e2b-491d-bd18-a5a5fefe6a04 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:38.567147 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc10f5-85ed-476b-abc4-603f8a9ded18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:38.567760 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc10f5-85ed-476b-abc4-603f8a9ded18 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:38.568040 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc10f5-85ed-476b-abc4-603f8a9ded18 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:38.568362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc10f5-85ed-476b-abc4-603f8a9ded18 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:38.569071 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc10f5-85ed-476b-abc4-603f8a9ded18 None admin] RBAC: Adding query filter params (interface=public, service_id=be3a985cce1f4fda824a329f3ed32e82, region_id=RegionOne) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:38.569469 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc10f5-85ed-476b-abc4-603f8a9ded18 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:38.570920 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc10f5-85ed-476b-abc4-603f8a9ded18 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:38.576328 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 498/1001] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Aug 24 04:37:38 2022] GET /identity/v3/endpoints?service_id=be3a985cce1f4fda824a329f3ed32e82&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:38.581893 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b752a4-fb49-418a-8920-a0ffefc14219 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:38.597796 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:38.686232 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b752a4-fb49-418a-8920-a0ffefc14219 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:38.719385 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a21881-5bf2-491f-ae64-316d65f7f176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:38.720022 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a21881-5bf2-491f-ae64-316d65f7f176 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:38.720269 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a21881-5bf2-491f-ae64-316d65f7f176 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:38.720541 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a21881-5bf2-491f-ae64-316d65f7f176 None admin] PATH_INFO: `/v3/services` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:38.721151 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a21881-5bf2-491f-ae64-316d65f7f176 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:38.722560 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a21881-5bf2-491f-ae64-316d65f7f176 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:38.729878 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 504/1002] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Aug 24 04:37:38 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:37:38.917410 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a0fa2-2c55-476a-97bf-fb6ee44e82e3 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:38.917931 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a0fa2-2c55-476a-97bf-fb6ee44e82e3 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:38.917931 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a0fa2-2c55-476a-97bf-fb6ee44e82e3 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:38.919268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 499/1003] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:38.924842 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f63c7-b98c-43b8-a2f5-6226012009eb None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:38.925131 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f63c7-b98c-43b8-a2f5-6226012009eb None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:38.925472 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f63c7-b98c-43b8-a2f5-6226012009eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:38.945960 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-4f2f63c7-b98c-43b8-a2f5-6226012009eb None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:38.947726 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-4f2f63c7-b98c-43b8-a2f5-6226012009eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:39.018797 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 505/1004] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:38 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:39.285403 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a0fa2-2c55-476a-97bf-fb6ee44e82e3 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:39.299075 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:39.394532 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a0fa2-2c55-476a-97bf-fb6ee44e82e3 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:39.430993 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11f261-f14b-41af-94b1-cb36200cb716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:39.431648 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11f261-f14b-41af-94b1-cb36200cb716 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:39.431931 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11f261-f14b-41af-94b1-cb36200cb716 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:39.432210 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11f261-f14b-41af-94b1-cb36200cb716 None admin] PATH_INFO: `/v3/services/image` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:39.432820 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c11f261-f14b-41af-94b1-cb36200cb716 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:39.434429 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c11f261-f14b-41af-94b1-cb36200cb716 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:39.443910 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-6c11f261-f14b-41af-94b1-cb36200cb716 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:37:39.443910 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:39.443910 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:37:39.443910 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:37:39.443910 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:37:39.443910 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:37:39.443910 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:37:39.443910 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:39.443910 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:37:39.443910 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:39.443910 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:37:39.443910 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:39.443910 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:39.443910 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:39.443910 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:39.443910 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:39.443910 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:39.444950 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:39.444950 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:39.444950 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:39.444950 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:39.444950 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:39.444950 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:39.444950 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:37:39.444950 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:37:39.444950 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:37:39.444950 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:37:39.444950 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:39.444950 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:39.444950 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:39.444950 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:39.444950 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:39.444950 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:39.445917 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:39.445917 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:39.445917 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:39.445917 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:39.445917 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:39.445917 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:39.445917 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:39.445917 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:39.445917 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:39.445917 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:39.445917 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:37:39.445917 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:39.445917 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:37:39.445917 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:39.449508 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 500/1005] 10.222.0.49 () {56 vars in 1105 bytes} [Wed Aug 24 04:37:39 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:39.451911 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f63c7-b98c-43b8-a2f5-6226012009eb None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:39.460790 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:39.555578 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f63c7-b98c-43b8-a2f5-6226012009eb None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:39.589852 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf04df1-530d-43e7-9cc4-23268d7e0f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:39.590467 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf04df1-530d-43e7-9cc4-23268d7e0f9b None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:39.590742 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf04df1-530d-43e7-9cc4-23268d7e0f9b None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:39.591011 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf04df1-530d-43e7-9cc4-23268d7e0f9b None admin] PATH_INFO: `/v3/services` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:39.591715 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf04df1-530d-43e7-9cc4-23268d7e0f9b None admin] RBAC: Adding query filter params (name=image) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:39.592216 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf04df1-530d-43e7-9cc4-23268d7e0f9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:39.593309 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf04df1-530d-43e7-9cc4-23268d7e0f9b None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:39.598498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 506/1006] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:39.604498 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11f261-f14b-41af-94b1-cb36200cb716 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:39.682648 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:39.713226 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11f261-f14b-41af-94b1-cb36200cb716 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:39.750657 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460d2e0-08cf-4b47-adc1-dee64e85976e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:39.751277 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460d2e0-08cf-4b47-adc1-dee64e85976e None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:39.751562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460d2e0-08cf-4b47-adc1-dee64e85976e None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:39.751829 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460d2e0-08cf-4b47-adc1-dee64e85976e None admin] PATH_INFO: `/v3/services` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:39.752487 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7460d2e0-08cf-4b47-adc1-dee64e85976e None admin] RBAC: Adding query filter params (type=image) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:39.752785 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7460d2e0-08cf-4b47-adc1-dee64e85976e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:39.754223 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7460d2e0-08cf-4b47-adc1-dee64e85976e None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:39.759460 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 501/1007] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:39 2022] GET /identity/v3/services?type=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:40.223028 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31100664-a6e1-44a5-b66e-9d08aca5a5df None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:40.223587 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31100664-a6e1-44a5-b66e-9d08aca5a5df None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:40.223587 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31100664-a6e1-44a5-b66e-9d08aca5a5df None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:40.225482 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 507/1008] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:40.230802 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d7dae-e581-4acc-ac4d-e032e0431bea None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:40.231228 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d7dae-e581-4acc-ac4d-e032e0431bea None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:40.231325 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7d7dae-e581-4acc-ac4d-e032e0431bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:40.251226 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-2d7d7dae-e581-4acc-ac4d-e032e0431bea None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:40.252467 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-2d7d7dae-e581-4acc-ac4d-e032e0431bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:40.324937 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 502/1009] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:40 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:40.590334 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31100664-a6e1-44a5-b66e-9d08aca5a5df None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:40.619650 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3b8cf-337b-410b-8a1f-55019ac596c2 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:40.619970 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3b8cf-337b-410b-8a1f-55019ac596c2 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:40.620215 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3b8cf-337b-410b-8a1f-55019ac596c2 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:40.621699 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 503/1010] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:40.627220 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb8ddf-45eb-4ba2-a3cc-52902a865e6f None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:40.627506 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb8ddf-45eb-4ba2-a3cc-52902a865e6f None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:40.627783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb8ddf-45eb-4ba2-a3cc-52902a865e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:40.646820 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-d2bb8ddf-45eb-4ba2-a3cc-52902a865e6f None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:40.648081 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-d2bb8ddf-45eb-4ba2-a3cc-52902a865e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:40.668591 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:40.701271 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31100664-a6e1-44a5-b66e-9d08aca5a5df None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:40.721228 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:40.731123 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 504/1011] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:40 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:40.738997 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101867d-78b1-42c8-a3d8-fde63e2be978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:40.739648 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101867d-78b1-42c8-a3d8-fde63e2be978 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:40.739911 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101867d-78b1-42c8-a3d8-fde63e2be978 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:40.740181 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101867d-78b1-42c8-a3d8-fde63e2be978 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:40.741287 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101867d-78b1-42c8-a3d8-fde63e2be978 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:40.742816 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101867d-78b1-42c8-a3d8-fde63e2be978 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:40.748953 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 508/1012] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:40.750417 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb8ddf-45eb-4ba2-a3cc-52902a865e6f None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:40.857733 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb8ddf-45eb-4ba2-a3cc-52902a865e6f None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:40.893976 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de8e3c-4647-416d-8c1c-1941c1916e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:40.894588 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de8e3c-4647-416d-8c1c-1941c1916e3c None admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:40.894867 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de8e3c-4647-416d-8c1c-1941c1916e3c None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:40.895134 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de8e3c-4647-416d-8c1c-1941c1916e3c None admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:40.895778 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de8e3c-4647-416d-8c1c-1941c1916e3c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:40.897230 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de8e3c-4647-416d-8c1c-1941c1916e3c None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:40.933363 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 505/1013] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 24 04:37:40 2022] POST /identity/v3/projects => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:37:40.993230 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101867d-78b1-42c8-a3d8-fde63e2be978 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:41.101077 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101867d-78b1-42c8-a3d8-fde63e2be978 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:41.138043 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154b08a-6611-4c9a-b4d3-418ca994572a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:41.138535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154b08a-6611-4c9a-b4d3-418ca994572a None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:41.138808 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154b08a-6611-4c9a-b4d3-418ca994572a None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:41.139074 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154b08a-6611-4c9a-b4d3-418ca994572a None admin] PATH_INFO: `/v3/services/compute` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:41.139656 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b154b08a-6611-4c9a-b4d3-418ca994572a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:41.141019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b154b08a-6611-4c9a-b4d3-418ca994572a None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:41.150655 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-b154b08a-6611-4c9a-b4d3-418ca994572a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:37:41.150655 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:41.150655 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:37:41.150655 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:37:41.150655 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:37:41.150655 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:37:41.150655 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:37:41.150655 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:41.150655 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:37:41.150655 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:41.150655 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:37:41.150655 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:41.150655 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:41.150655 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:41.150655 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:41.150655 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:41.150655 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:41.151709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:41.151709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:41.151709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:41.151709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:41.151709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:41.151709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:41.151709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:37:41.151709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:37:41.151709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:37:41.151709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:37:41.151709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:41.151709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:41.151709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:41.151709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:41.151709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:41.151709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:41.152568 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:41.152568 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:41.152568 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:41.152568 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:41.152568 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:41.152568 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:41.152568 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:41.152568 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:41.152568 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:41.152568 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:41.152568 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:37:41.152568 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:41.152568 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:37:41.152568 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:41.152568 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 509/1014] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:37:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:41.158148 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de8e3c-4647-416d-8c1c-1941c1916e3c None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:41.213886 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:41.280926 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de8e3c-4647-416d-8c1c-1941c1916e3c None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:41.324764 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f921a-c4f8-4bd0-a00e-2d3922c0987d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:41.325712 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f921a-c4f8-4bd0-a00e-2d3922c0987d None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:41.326138 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f921a-c4f8-4bd0-a00e-2d3922c0987d None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:41.326553 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f921a-c4f8-4bd0-a00e-2d3922c0987d None admin] PATH_INFO: `/v3/services` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:41.327340 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f921a-c4f8-4bd0-a00e-2d3922c0987d None admin] RBAC: Adding query filter params (name=compute) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:41.327801 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f921a-c4f8-4bd0-a00e-2d3922c0987d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:41.329381 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f921a-c4f8-4bd0-a00e-2d3922c0987d None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:41.334863 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 506/1015] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 24 04:37:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:41.340916 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154b08a-6611-4c9a-b4d3-418ca994572a None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:41.344764 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:41.451004 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154b08a-6611-4c9a-b4d3-418ca994572a None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:41.486902 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a05059-bff4-4c2b-a161-c0b48b3bdfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:41.487509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a05059-bff4-4c2b-a161-c0b48b3bdfeb None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:41.487781 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a05059-bff4-4c2b-a161-c0b48b3bdfeb None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:41.488052 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a05059-bff4-4c2b-a161-c0b48b3bdfeb None admin] PATH_INFO: `/v3/services` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:41.488691 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a05059-bff4-4c2b-a161-c0b48b3bdfeb None admin] RBAC: Adding query filter params (type=compute) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:41.488969 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a05059-bff4-4c2b-a161-c0b48b3bdfeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:41.490421 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a05059-bff4-4c2b-a161-c0b48b3bdfeb None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:41.496970 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 510/1016] 10.222.0.49 () {56 vars in 1112 bytes} [Wed Aug 24 04:37:41 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:41.502836 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f921a-c4f8-4bd0-a00e-2d3922c0987d None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:41.612032 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f921a-c4f8-4bd0-a00e-2d3922c0987d None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:41.626705 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:41.648621 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d02d41-cb04-4817-9a7e-0d5e62c95b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:41.649241 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d02d41-cb04-4817-9a7e-0d5e62c95b43 None admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:41.649539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d02d41-cb04-4817-9a7e-0d5e62c95b43 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:41.649816 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d02d41-cb04-4817-9a7e-0d5e62c95b43 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:41.650478 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d02d41-cb04-4817-9a7e-0d5e62c95b43 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:41.651872 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d02d41-cb04-4817-9a7e-0d5e62c95b43 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:41.681373 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 507/1017] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:37:41 2022] POST /identity/v3/endpoints => generated 334 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:37:41.715704 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92d23f-a27e-45b4-948c-2d04e662328e None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:41.715957 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92d23f-a27e-45b4-948c-2d04e662328e None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:41.716555 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92d23f-a27e-45b4-948c-2d04e662328e None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:41.718351 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 511/1018] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:41.724849 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b2f3f-bd8d-458a-abd0-14fe6f64a340 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:41.725601 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b2f3f-bd8d-458a-abd0-14fe6f64a340 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:41.726057 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b2f3f-bd8d-458a-abd0-14fe6f64a340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:41.750858 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-7c4b2f3f-bd8d-458a-abd0-14fe6f64a340 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:41.752556 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-7c4b2f3f-bd8d-458a-abd0-14fe6f64a340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:41.851625 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 508/1019] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:41 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:42.201435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92d23f-a27e-45b4-948c-2d04e662328e None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:42.313417 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:42.366878 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92d23f-a27e-45b4-948c-2d04e662328e None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:42.430838 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ffa85c-aa03-4d9d-a2c6-ba262e6245b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:42.431746 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffa85c-aa03-4d9d-a2c6-ba262e6245b2 None admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:42.432229 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffa85c-aa03-4d9d-a2c6-ba262e6245b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:42.432695 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffa85c-aa03-4d9d-a2c6-ba262e6245b2 None admin] PATH_INFO: `/v3/services` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:42.433923 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ffa85c-aa03-4d9d-a2c6-ba262e6245b2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:42.435836 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ffa85c-aa03-4d9d-a2c6-ba262e6245b2 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:42.461413 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 512/1020] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 24 04:37:42 2022] POST /identity/v3/services => generated 242 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:37:43.002247 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61366eaa-5c04-48ca-b0a6-42dacd903d80 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:43.002777 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61366eaa-5c04-48ca-b0a6-42dacd903d80 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:43.002856 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61366eaa-5c04-48ca-b0a6-42dacd903d80 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:43.004221 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 509/1021] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:43.009625 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d96cd6-a5ca-4c62-a8d9-d20bc05f94f2 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:43.009920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d96cd6-a5ca-4c62-a8d9-d20bc05f94f2 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:43.010188 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d96cd6-a5ca-4c62-a8d9-d20bc05f94f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:43.029826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-63d96cd6-a5ca-4c62-a8d9-d20bc05f94f2 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:43.031065 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-63d96cd6-a5ca-4c62-a8d9-d20bc05f94f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:43.142133 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 513/1022] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:43.481422 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61366eaa-5c04-48ca-b0a6-42dacd903d80 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:43.606792 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:43.616885 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61366eaa-5c04-48ca-b0a6-42dacd903d80 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:43.655626 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5446c24-a2ae-4ee9-b538-5c6f0ddd17ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:43.656274 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5446c24-a2ae-4ee9-b538-5c6f0ddd17ba None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:43.656582 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5446c24-a2ae-4ee9-b538-5c6f0ddd17ba None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:43.656856 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5446c24-a2ae-4ee9-b538-5c6f0ddd17ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:43.657973 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5446c24-a2ae-4ee9-b538-5c6f0ddd17ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:43.659425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5446c24-a2ae-4ee9-b538-5c6f0ddd17ba None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:43.661195 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 510/1023] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:43.667260 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d96cd6-a5ca-4c62-a8d9-d20bc05f94f2 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:43.730084 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:43.790989 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d96cd6-a5ca-4c62-a8d9-d20bc05f94f2 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:43.793524 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27751a9-55d6-485e-aced-8a6dd036254d None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:43.793807 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27751a9-55d6-485e-aced-8a6dd036254d None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:43.794079 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27751a9-55d6-485e-aced-8a6dd036254d None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:43.795582 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 511/1024] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:37:43.800991 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b6f52-716e-4c89-9635-df1972f6ef37 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:43.801258 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b6f52-716e-4c89-9635-df1972f6ef37 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:43.801561 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b6f52-716e-4c89-9635-df1972f6ef37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:43.820110 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-0b1b6f52-716e-4c89-9635-df1972f6ef37 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:43.821591 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-0b1b6f52-716e-4c89-9635-df1972f6ef37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:43.839713 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcce9c8-e33f-4f00-a5a3-3b3076b12e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:43.840397 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcce9c8-e33f-4f00-a5a3-3b3076b12e25 None admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:43.840622 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcce9c8-e33f-4f00-a5a3-3b3076b12e25 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:43.840894 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcce9c8-e33f-4f00-a5a3-3b3076b12e25 None admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:43.841589 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcce9c8-e33f-4f00-a5a3-3b3076b12e25 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:43.843055 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcce9c8-e33f-4f00-a5a3-3b3076b12e25 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:43.873559 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 514/1025] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 24 04:37:43 2022] POST /identity/v3/users => generated 285 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:37:43.906786 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 512/1026] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:37:44.176786 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcce9c8-e33f-4f00-a5a3-3b3076b12e25 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:44.320689 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcce9c8-e33f-4f00-a5a3-3b3076b12e25 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:44.331635 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:44.365463 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450151e-5cd8-4bd9-9d02-2be1b0f31f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:44.366405 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450151e-5cd8-4bd9-9d02-2be1b0f31f6c None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:44.366773 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450151e-5cd8-4bd9-9d02-2be1b0f31f6c None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:44.367170 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450151e-5cd8-4bd9-9d02-2be1b0f31f6c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:44.380770 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3450151e-5cd8-4bd9-9d02-2be1b0f31f6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:37:44.385802 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-3450151e-5cd8-4bd9-9d02-2be1b0f31f6c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:37:44.385802 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:44.385802 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:44.385802 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:44.385802 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:44.385802 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:44.385802 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:44.385802 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:44.385802 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:44.385802 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:44.385802 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:44.385802 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:44.385802 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:37:44.385802 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:37:44.385802 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:37:44.385802 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:37:44.387246 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:37:44.387246 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:37:44.387246 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:37:44.387246 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:37:44.387246 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:44.387246 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:44.387246 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:44.387246 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:44.387246 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:44.387246 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:44.387246 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:44.387246 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:44.387246 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:44.387246 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:44.387246 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:44.387246 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:44.388302 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:44.388302 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:44.388302 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:44.388302 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:44.388302 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:37:44.388302 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:37:44.388302 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:37:44.388302 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:37:44.388302 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:37:44.388302 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:37:44.388302 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:37:44.388302 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:44.388302 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 515/1027] 10.222.0.49 () {56 vars in 1120 bytes} [Wed Aug 24 04:37:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:44.395525 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b6f52-716e-4c89-9635-df1972f6ef37 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:44.439357 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddde37-74d1-4003-9b35-d60322936e2a None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:44.439566 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddde37-74d1-4003-9b35-d60322936e2a None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:44.439806 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acddde37-74d1-4003-9b35-d60322936e2a None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:44.441918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 516/1028] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:37:44.447283 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2442a-5e2e-41bc-97ef-7f48feecb42b None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:44.447566 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2442a-5e2e-41bc-97ef-7f48feecb42b None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:44.447859 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2442a-5e2e-41bc-97ef-7f48feecb42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:44.467069 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-b5d2442a-5e2e-41bc-97ef-7f48feecb42b None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:44.467911 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-b5d2442a-5e2e-41bc-97ef-7f48feecb42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:44.512098 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:44.519756 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b6f52-716e-4c89-9635-df1972f6ef37 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:44.549391 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 517/1029] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:44.559305 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b35a8c-9a60-4ed3-8726-84987d8c0b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:44.559934 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b35a8c-9a60-4ed3-8726-84987d8c0b07 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:44.560208 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b35a8c-9a60-4ed3-8726-84987d8c0b07 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:44.560655 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b35a8c-9a60-4ed3-8726-84987d8c0b07 None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:44.561374 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b35a8c-9a60-4ed3-8726-84987d8c0b07 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:44.561678 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b35a8c-9a60-4ed3-8726-84987d8c0b07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:44.563081 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b35a8c-9a60-4ed3-8726-84987d8c0b07 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:44.573279 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 513/1030] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Aug 24 04:37:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:44.579649 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2442a-5e2e-41bc-97ef-7f48feecb42b None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:44.688079 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:44.693458 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2442a-5e2e-41bc-97ef-7f48feecb42b None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:44.730854 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13adcdb0-b32c-443c-9a0a-f1acb73bb09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:44.731491 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13adcdb0-b32c-443c-9a0a-f1acb73bb09b None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:44.731772 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13adcdb0-b32c-443c-9a0a-f1acb73bb09b None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:44.732028 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13adcdb0-b32c-443c-9a0a-f1acb73bb09b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:44.743185 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13adcdb0-b32c-443c-9a0a-f1acb73bb09b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:44.744647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13adcdb0-b32c-443c-9a0a-f1acb73bb09b None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:44.760594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-13adcdb0-b32c-443c-9a0a-f1acb73bb09b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:44.760594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:44.760594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:44.760594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:44.760594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:44.760594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:44.760594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:44.760594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:44.760594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:44.760594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:44.760594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:44.760594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:44.760594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:37:44.760594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:37:44.760594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:37:44.760594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:37:44.761649 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:44.761649 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:44.761649 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:44.761649 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:44.761649 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:44.761649 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:44.761649 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:44.761649 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:44.761649 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:44.761649 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:44.761649 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:44.761649 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:44.761649 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:44.761649 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:44.761649 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:44.761649 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:44.761649 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:37:44.769773 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:37:44.769773 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:44.769773 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:44.769773 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 518/1031] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:44.770023 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b35a8c-9a60-4ed3-8726-84987d8c0b07 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:44.819557 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13adcdb0-b32c-443c-9a0a-f1acb73bb09b None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:44.896291 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b35a8c-9a60-4ed3-8726-84987d8c0b07 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:44.933635 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13adcdb0-b32c-443c-9a0a-f1acb73bb09b None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:44.938752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ac6f5-96b3-4cd2-a70d-2c0e893b15a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:44.939371 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ac6f5-96b3-4cd2-a70d-2c0e893b15a3 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:44.939643 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ac6f5-96b3-4cd2-a70d-2c0e893b15a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:44.939912 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ac6f5-96b3-4cd2-a70d-2c0e893b15a3 None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:44.940573 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ac6f5-96b3-4cd2-a70d-2c0e893b15a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:44.940924 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ac6f5-96b3-4cd2-a70d-2c0e893b15a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:44.942299 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ac6f5-96b3-4cd2-a70d-2c0e893b15a3 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:44.955557 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 514/1032] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:44.961719 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ac6f5-96b3-4cd2-a70d-2c0e893b15a3 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:44.977018 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a057b1d-d632-48a2-bf22-893782e1c7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:44.977683 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a057b1d-d632-48a2-bf22-893782e1c7dc None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:44.977967 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a057b1d-d632-48a2-bf22-893782e1c7dc None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:44.978231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a057b1d-d632-48a2-bf22-893782e1c7dc None admin] PATH_INFO: `/v3/services/image` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:44.978821 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a057b1d-d632-48a2-bf22-893782e1c7dc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:44.980194 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a057b1d-d632-48a2-bf22-893782e1c7dc None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:44.982390 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:44.990042 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-8a057b1d-d632-48a2-bf22-893782e1c7dc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:37:44.990042 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:44.990042 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:37:44.990042 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:37:44.990042 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:37:44.990042 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:37:44.990042 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:37:44.990042 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:44.990042 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:37:44.990042 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:44.990042 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:37:44.990042 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:44.990042 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:44.990042 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:44.990042 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:44.990042 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:44.990042 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:44.991242 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:44.991242 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:44.991242 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:44.991242 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:44.991242 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:44.991242 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:44.991242 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:37:44.991242 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:37:44.991242 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:37:44.991242 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:37:44.991242 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:44.991242 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:44.991242 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:44.991242 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:44.991242 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:44.991242 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:44.992312 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:44.992312 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:44.992312 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:44.992312 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:44.992312 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:44.992312 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:44.992312 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:44.992312 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:44.992312 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:44.992312 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:44.992312 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:37:44.992312 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:44.992312 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:37:44.992312 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:44.994439 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 519/1033] 10.222.0.49 () {56 vars in 1105 bytes} [Wed Aug 24 04:37:44 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:37:45.000994 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a057b1d-d632-48a2-bf22-893782e1c7dc None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:45.018854 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:45.084233 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ac6f5-96b3-4cd2-a70d-2c0e893b15a3 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:45.120772 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a057b1d-d632-48a2-bf22-893782e1c7dc None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:45.124225 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a4bc6-e5d4-49e3-8260-c53c0c833571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:45.125147 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a4bc6-e5d4-49e3-8260-c53c0c833571 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:45.125662 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a4bc6-e5d4-49e3-8260-c53c0c833571 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:45.126121 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a4bc6-e5d4-49e3-8260-c53c0c833571 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:45.139786 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a4bc6-e5d4-49e3-8260-c53c0c833571 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:45.141382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a4bc6-e5d4-49e3-8260-c53c0c833571 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:45.155359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-4e1a4bc6-e5d4-49e3-8260-c53c0c833571 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:37:45.155359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:45.155359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:45.155359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:45.155359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:45.155359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:45.155359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:45.155359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:45.155359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:45.155359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:45.155359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:45.155359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:45.155359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:37:45.155359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:37:45.155359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:37:45.155359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:37:45.156362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:45.156362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:45.156362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:37:45.156362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:37:45.156362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:37:45.156362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:37:45.156362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:45.156362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:45.156362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:45.156362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:45.156362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:45.156362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:45.156362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:45.156362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:45.156362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:45.156362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:45.156362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:45.156362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:45.157282 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:45.157282 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:45.157282 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:37:45.157282 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:37:45.157282 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:37:45.157282 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:37:45.157282 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:37:45.157282 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:37:45.157282 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:37:45.157282 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:45.163942 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 515/1034] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Aug 24 04:37:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:37:45.164031 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a63ae-9e4b-4e97-8ac0-dca6b8c20529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:45.164031 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a63ae-9e4b-4e97-8ac0-dca6b8c20529 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:45.164031 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a63ae-9e4b-4e97-8ac0-dca6b8c20529 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:45.164031 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a63ae-9e4b-4e97-8ac0-dca6b8c20529 None admin] PATH_INFO: `/v3/services` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:45.164490 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a4bc6-e5d4-49e3-8260-c53c0c833571 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:45.164652 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a63ae-9e4b-4e97-8ac0-dca6b8c20529 None admin] RBAC: Adding query filter params (name=image) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:45.164956 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a63ae-9e4b-4e97-8ac0-dca6b8c20529 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:45.166453 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a63ae-9e4b-4e97-8ac0-dca6b8c20529 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:45.177559 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 520/1035] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:45.179775 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a63ae-9e4b-4e97-8ac0-dca6b8c20529 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:45.267838 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:45.283205 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:45.306548 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a4bc6-e5d4-49e3-8260-c53c0c833571 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:45.313850 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a63ae-9e4b-4e97-8ac0-dca6b8c20529 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:45.355391 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9435c-55dd-456c-aa6e-34e0d0f567ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:45.356018 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9435c-55dd-456c-aa6e-34e0d0f567ca None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:45.356122 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ff65b-4d98-4c2a-813c-70f00554a512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:45.356320 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9435c-55dd-456c-aa6e-34e0d0f567ca None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:45.356559 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9435c-55dd-456c-aa6e-34e0d0f567ca None admin] PATH_INFO: `/v3/services` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:45.357056 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ff65b-4d98-4c2a-813c-70f00554a512 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:45.357212 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9435c-55dd-456c-aa6e-34e0d0f567ca None admin] RBAC: Adding query filter params (type=image) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:45.357525 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9435c-55dd-456c-aa6e-34e0d0f567ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:45.357653 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ff65b-4d98-4c2a-813c-70f00554a512 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:45.358050 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ff65b-4d98-4c2a-813c-70f00554a512 None admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:45.359135 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9435c-55dd-456c-aa6e-34e0d0f567ca None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:45.359429 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ff65b-4d98-4c2a-813c-70f00554a512 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:45.359970 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ff65b-4d98-4c2a-813c-70f00554a512 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:45.363058 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ff65b-4d98-4c2a-813c-70f00554a512 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:45.365432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 521/1036] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:45.371502 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9435c-55dd-456c-aa6e-34e0d0f567ca None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:45.388518 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 516/1037] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Aug 24 04:37:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:45.394533 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ff65b-4d98-4c2a-813c-70f00554a512 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:45.518923 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ff65b-4d98-4c2a-813c-70f00554a512 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:45.527312 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9435c-55dd-456c-aa6e-34e0d0f567ca None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:45.560410 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09155a8-36a1-420b-8506-5525d41e90fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:45.561025 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09155a8-36a1-420b-8506-5525d41e90fa None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:45.561300 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09155a8-36a1-420b-8506-5525d41e90fa None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:45.561609 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09155a8-36a1-420b-8506-5525d41e90fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:45.564531 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:45.587538 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4405221-2e6f-4540-a6d2-17cd6b472d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:45.588574 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4405221-2e6f-4540-a6d2-17cd6b472d0f None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:45.589059 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4405221-2e6f-4540-a6d2-17cd6b472d0f None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:45.589576 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4405221-2e6f-4540-a6d2-17cd6b472d0f None admin] PATH_INFO: `/v3/endpoints` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:45.590823 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4405221-2e6f-4540-a6d2-17cd6b472d0f None admin] RBAC: Adding query filter params (interface=public, service_id=d95579c197c34070b95ee1baad73837f, region_id=RegionOne) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:45.591352 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4405221-2e6f-4540-a6d2-17cd6b472d0f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:45.594009 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4405221-2e6f-4540-a6d2-17cd6b472d0f None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:45.605388 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 522/1038] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Aug 24 04:37:45 2022] GET /identity/v3/endpoints?service_id=d95579c197c34070b95ee1baad73837f&interface=public®ion_id=RegionOne => generated 194 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:45.610205 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4405221-2e6f-4540-a6d2-17cd6b472d0f None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:45.621892 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:45.659502 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09155a8-36a1-420b-8506-5525d41e90fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:45.662075 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09155a8-36a1-420b-8506-5525d41e90fa None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:45.731430 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4405221-2e6f-4540-a6d2-17cd6b472d0f None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:45.776118 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0416b5-350a-4fee-8c1d-cdaf0b9b1163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:45.776642 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0416b5-350a-4fee-8c1d-cdaf0b9b1163 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:45.776914 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0416b5-350a-4fee-8c1d-cdaf0b9b1163 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:45.777187 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0416b5-350a-4fee-8c1d-cdaf0b9b1163 None admin] PATH_INFO: `/v3/services` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:45.777827 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0416b5-350a-4fee-8c1d-cdaf0b9b1163 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:45.779216 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0416b5-350a-4fee-8c1d-cdaf0b9b1163 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:45.786964 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 523/1039] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Aug 24 04:37:45 2022] GET /identity/v3/services => generated 1957 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:37:45.801445 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 517/1040] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:37:45 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 04:37:45.807579 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0416b5-350a-4fee-8c1d-cdaf0b9b1163 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:45.897744 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:45.940258 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0416b5-350a-4fee-8c1d-cdaf0b9b1163 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:45.983587 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe651fd-0233-46cf-86e5-e546b86f07bc None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:45.983929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe651fd-0233-46cf-86e5-e546b86f07bc None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:45.984424 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe651fd-0233-46cf-86e5-e546b86f07bc None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:45.986239 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 518/1041] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:45.988599 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04b208-8cfb-4575-b52d-fec60a481201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:45.989256 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04b208-8cfb-4575-b52d-fec60a481201 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:45.989568 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04b208-8cfb-4575-b52d-fec60a481201 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:45.989842 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c04b208-8cfb-4575-b52d-fec60a481201 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:45.993830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f40fb-334d-4011-a592-2c58fa3a41d9 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:45.993830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f40fb-334d-4011-a592-2c58fa3a41d9 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:45.993830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f40fb-334d-4011-a592-2c58fa3a41d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:46.002672 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04b208-8cfb-4575-b52d-fec60a481201 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:46.004257 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c04b208-8cfb-4575-b52d-fec60a481201 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:46.019864 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-3c04b208-8cfb-4575-b52d-fec60a481201 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:46.019864 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:46.019864 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:46.019864 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:46.019864 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:46.019864 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:46.019864 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:46.019864 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:46.019864 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:46.019864 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:46.019864 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:46.019864 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:46.019864 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:37:46.019864 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:37:46.019864 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:37:46.019864 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:37:46.021199 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:46.021199 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:46.021199 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:46.021199 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:46.021199 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:46.021199 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:46.021199 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:46.021199 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:46.021199 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:46.021199 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:46.021199 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:46.021199 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:46.021199 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:46.021199 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:46.021199 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:46.021199 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:46.021199 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:37:46.022793 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:37:46.022793 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:46.022793 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:46.022793 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 524/1042] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:46.024047 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-442f40fb-334d-4011-a592-2c58fa3a41d9 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:46.026059 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-442f40fb-334d-4011-a592-2c58fa3a41d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:46.027194 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04b208-8cfb-4575-b52d-fec60a481201 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:46.067157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:46.126588 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 519/1043] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:37:46.175130 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c04b208-8cfb-4575-b52d-fec60a481201 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:46.202693 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:46.215296 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c894208-82fb-4223-b34b-d33fbcac6618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:46.215919 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c894208-82fb-4223-b34b-d33fbcac6618 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:46.216194 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c894208-82fb-4223-b34b-d33fbcac6618 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:46.216461 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c894208-82fb-4223-b34b-d33fbcac6618 None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:46.217108 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c894208-82fb-4223-b34b-d33fbcac6618 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:46.217440 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c894208-82fb-4223-b34b-d33fbcac6618 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:46.218819 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c894208-82fb-4223-b34b-d33fbcac6618 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:46.232899 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 525/1044] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:46.241136 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f40fb-334d-4011-a592-2c58fa3a41d9 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:46.368548 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f40fb-334d-4011-a592-2c58fa3a41d9 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:46.406147 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a042b-f93a-40e1-bdf5-8f70cea8a15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:46.406838 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a042b-f93a-40e1-bdf5-8f70cea8a15c None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:46.407119 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a042b-f93a-40e1-bdf5-8f70cea8a15c None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:46.407394 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a042b-f93a-40e1-bdf5-8f70cea8a15c None admin] PATH_INFO: `/v3/projects/service` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:46.415925 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a042b-f93a-40e1-bdf5-8f70cea8a15c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:46.423076 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a042b-f93a-40e1-bdf5-8f70cea8a15c None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:46.441441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-059a042b-f93a-40e1-bdf5-8f70cea8a15c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:37:46.441441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:46.441441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:46.441441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:46.441441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:46.441441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:46.441441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:46.441441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:46.441441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:46.441441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:46.441441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:46.441441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:46.441441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:37:46.441441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:37:46.441441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:37:46.442443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:37:46.442443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:46.442443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:46.442443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:46.442443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:46.442443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:46.442443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:46.442443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:46.442443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:46.442443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:46.442443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:46.442443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:46.442443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:46.442443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:46.442443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:46.442443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:46.442443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:46.448667 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:37:46.448667 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:37:46.448667 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:37:46.448667 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:37:46.448667 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:37:46.448667 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:37:46.448667 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:37:46.448667 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:46.448667 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 520/1045] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:37:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:46.449489 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c894208-82fb-4223-b34b-d33fbcac6618 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:46.455676 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a042b-f93a-40e1-bdf5-8f70cea8a15c None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:46.491202 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:46.579025 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c894208-82fb-4223-b34b-d33fbcac6618 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:46.582556 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a042b-f93a-40e1-bdf5-8f70cea8a15c None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:46.619751 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7dbdb-0ca8-43aa-b970-bfa45be1ce52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:46.620301 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7dbdb-0ca8-43aa-b970-bfa45be1ce52 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:46.620580 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7dbdb-0ca8-43aa-b970-bfa45be1ce52 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:46.620851 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7dbdb-0ca8-43aa-b970-bfa45be1ce52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:46.621280 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e10b1-77fe-4c75-bb08-dc09c9bffb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:46.622146 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e10b1-77fe-4c75-bb08-dc09c9bffb0b None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:46.622732 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e10b1-77fe-4c75-bb08-dc09c9bffb0b None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:46.623215 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e10b1-77fe-4c75-bb08-dc09c9bffb0b None admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:46.624154 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e10b1-77fe-4c75-bb08-dc09c9bffb0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:46.624648 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e10b1-77fe-4c75-bb08-dc09c9bffb0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:46.626322 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e10b1-77fe-4c75-bb08-dc09c9bffb0b None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:46.632090 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7dbdb-0ca8-43aa-b970-bfa45be1ce52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:37:46.636862 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-0ec7dbdb-0ca8-43aa-b970-bfa45be1ce52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:37:46.636862 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:46.636862 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:46.636862 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:46.636862 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:46.636862 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:46.636862 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:46.636862 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:46.636862 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:46.636862 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:46.636862 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:46.636862 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:46.636862 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:37:46.636862 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:37:46.636862 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:37:46.636862 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:37:46.640971 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:37:46.640971 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:37:46.640971 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:37:46.640971 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:37:46.640971 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:46.640971 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:46.640971 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:46.640971 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:46.640971 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:46.640971 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:46.640971 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:46.640971 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:46.640971 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:46.640971 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:46.640971 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:46.640971 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:46.642014 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:46.642014 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:46.642014 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:46.642014 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:46.642014 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:37:46.642014 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:37:46.642014 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:37:46.642014 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:37:46.642014 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:37:46.642014 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:37:46.642014 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:37:46.642014 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:46.642014 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 521/1046] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 24 04:37:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:46.643640 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 526/1047] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 24 04:37:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:46.647472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7dbdb-0ca8-43aa-b970-bfa45be1ce52 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:46.649605 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e10b1-77fe-4c75-bb08-dc09c9bffb0b None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:46.697270 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:46.749512 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:46.770362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7dbdb-0ca8-43aa-b970-bfa45be1ce52 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:46.774039 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e10b1-77fe-4c75-bb08-dc09c9bffb0b None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:46.807298 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb625e-1bdb-41b3-95d7-a844b7c04543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:46.807915 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb625e-1bdb-41b3-95d7-a844b7c04543 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:46.808193 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb625e-1bdb-41b3-95d7-a844b7c04543 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:46.808461 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb625e-1bdb-41b3-95d7-a844b7c04543 None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:46.809139 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb625e-1bdb-41b3-95d7-a844b7c04543 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:46.809468 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb625e-1bdb-41b3-95d7-a844b7c04543 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:46.810981 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb625e-1bdb-41b3-95d7-a844b7c04543 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:46.812377 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45d9ce-3e08-4a60-9e5c-994e64144a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:46.813113 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45d9ce-3e08-4a60-9e5c-994e64144a62 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:46.813412 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45d9ce-3e08-4a60-9e5c-994e64144a62 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:46.813909 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45d9ce-3e08-4a60-9e5c-994e64144a62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:46.814522 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45d9ce-3e08-4a60-9e5c-994e64144a62 None admin] RBAC: Adding query filter params (role.id=ebe27ef209074cbb99d86cc8dde4c5d9, scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62, user.id=9dc9a3cf381e4a2da36ed82b407a2d94) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:46.814826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45d9ce-3e08-4a60-9e5c-994e64144a62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:46.816255 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d45d9ce-3e08-4a60-9e5c-994e64144a62 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:46.820722 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 522/1048] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:37:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:46.832786 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 527/1049] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:37:46 2022] GET /identity/v3/role_assignments?user.id=9dc9a3cf381e4a2da36ed82b407a2d94&scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62&role.id=ebe27ef209074cbb99d86cc8dde4c5d9 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:46.833024 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb625e-1bdb-41b3-95d7-a844b7c04543 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:46.964534 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb625e-1bdb-41b3-95d7-a844b7c04543 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:47.004857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1b00d-6f94-44a7-b86e-0680e371b4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:47.005882 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1b00d-6f94-44a7-b86e-0680e371b4e0 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:47.006160 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1b00d-6f94-44a7-b86e-0680e371b4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:47.006430 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1b00d-6f94-44a7-b86e-0680e371b4e0 None admin] PATH_INFO: `/v3/users/5132ab3babef46f8b9030f4818edde7e` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:47.022189 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf1b00d-6f94-44a7-b86e-0680e371b4e0 None admin] RBAC: Authorizing `identity:get_user(user_id=5132ab3babef46f8b9030f4818edde7e)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:47.023745 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf1b00d-6f94-44a7-b86e-0680e371b4e0 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:47.025752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 523/1050] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:37:46 2022] GET /identity/v3/users/5132ab3babef46f8b9030f4818edde7e => generated 285 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:47.031615 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45d9ce-3e08-4a60-9e5c-994e64144a62 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:47.147389 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45d9ce-3e08-4a60-9e5c-994e64144a62 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:47.156710 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:47.189968 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d8576-bfc6-4755-a69c-e9df655d051b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:47.190646 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d8576-bfc6-4755-a69c-e9df655d051b None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:47.190927 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d8576-bfc6-4755-a69c-e9df655d051b None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:47.191189 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d8576-bfc6-4755-a69c-e9df655d051b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:47.264832 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d8576-bfc6-4755-a69c-e9df655d051b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:47.266264 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d8576-bfc6-4755-a69c-e9df655d051b None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:47.381383 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 528/1051] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:37:47 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 04:37:47.382726 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1b00d-6f94-44a7-b86e-0680e371b4e0 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:47.387898 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:47.502603 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1b00d-6f94-44a7-b86e-0680e371b4e0 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:47.542020 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b8238-dba9-4704-9177-4459dfbd3a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:47.542578 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b8238-dba9-4704-9177-4459dfbd3a2e None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:47.542859 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b8238-dba9-4704-9177-4459dfbd3a2e None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:47.543132 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b8238-dba9-4704-9177-4459dfbd3a2e None admin] PATH_INFO: `/v3/projects/30880bd43a8f4f50bd88590105ed5a3c` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:47.544269 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b8238-dba9-4704-9177-4459dfbd3a2e None admin] RBAC: Authorizing `identity:get_project(project_id=30880bd43a8f4f50bd88590105ed5a3c)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:47.545753 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b8238-dba9-4704-9177-4459dfbd3a2e None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:47.547822 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 524/1052] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:37:47 2022] GET /identity/v3/projects/30880bd43a8f4f50bd88590105ed5a3c => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:47.553956 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d8576-bfc6-4755-a69c-e9df655d051b None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:47.563253 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:47.660677 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d8576-bfc6-4755-a69c-e9df655d051b None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:47.700958 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1c478-7d21-4648-a6eb-f8ed5d0832e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:47.701600 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1c478-7d21-4648-a6eb-f8ed5d0832e4 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:47.701876 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1c478-7d21-4648-a6eb-f8ed5d0832e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:47.702146 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1c478-7d21-4648-a6eb-f8ed5d0832e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:47.702885 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1c478-7d21-4648-a6eb-f8ed5d0832e4 None admin] RBAC: Adding query filter params (role.id=74ce7b72bcc94a8a8ad65c3db928e6ac, scope.project.id=30880bd43a8f4f50bd88590105ed5a3c, user.id=5132ab3babef46f8b9030f4818edde7e) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:47.703188 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1c478-7d21-4648-a6eb-f8ed5d0832e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:47.704636 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1c478-7d21-4648-a6eb-f8ed5d0832e4 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:47.711099 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 529/1053] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:37:47 2022] GET /identity/v3/role_assignments?user.id=5132ab3babef46f8b9030f4818edde7e&scope.project.id=30880bd43a8f4f50bd88590105ed5a3c&role.id=74ce7b72bcc94a8a8ad65c3db928e6ac => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:47.853049 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d6afc-6a13-4ac2-a34f-5085fe6e9782 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:47.853845 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d6afc-6a13-4ac2-a34f-5085fe6e9782 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:47.853845 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d6afc-6a13-4ac2-a34f-5085fe6e9782 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:47.855215 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 525/1054] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:47.863591 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938cb14-cffe-4f23-988b-3d98f0adb21b None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:47.864103 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938cb14-cffe-4f23-988b-3d98f0adb21b None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:47.864103 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938cb14-cffe-4f23-988b-3d98f0adb21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:47.884591 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-8938cb14-cffe-4f23-988b-3d98f0adb21b None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:47.885861 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-8938cb14-cffe-4f23-988b-3d98f0adb21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:47.968320 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:47.981424 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 530/1055] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:48.246744 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d6afc-6a13-4ac2-a34f-5085fe6e9782 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:48.343344 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:48.389298 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d6afc-6a13-4ac2-a34f-5085fe6e9782 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:48.428397 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bf55e-7d91-4e74-a3a3-36487259a86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:48.428940 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bf55e-7d91-4e74-a3a3-36487259a86d None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:48.429214 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bf55e-7d91-4e74-a3a3-36487259a86d None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:48.429545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bf55e-7d91-4e74-a3a3-36487259a86d None admin] PATH_INFO: `/v3/services/image` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:48.430137 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9bf55e-7d91-4e74-a3a3-36487259a86d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:48.431566 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9bf55e-7d91-4e74-a3a3-36487259a86d None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:48.441444 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-fe9bf55e-7d91-4e74-a3a3-36487259a86d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:37:48.441444 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:48.441444 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:37:48.441444 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:37:48.441444 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:37:48.441444 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:37:48.441444 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:37:48.441444 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:48.441444 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:37:48.441444 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:48.441444 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:37:48.441444 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:48.441444 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:48.441444 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:48.441444 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:48.441444 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:48.441444 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:48.442471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:48.442471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:48.442471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:48.442471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:48.442471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:48.442471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:48.442471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:37:48.442471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:37:48.442471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:37:48.442471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:37:48.442471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:48.442471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:48.442471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:48.442471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:48.442471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:48.442471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:48.443281 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:48.443281 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:48.443281 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:48.443281 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:48.443281 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:48.443281 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:48.443281 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:48.443281 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:48.443281 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:48.443281 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:48.443281 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:37:48.443281 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:37:48.443281 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:37:48.443281 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:48.444857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 526/1056] 10.222.0.49 () {56 vars in 1105 bytes} [Wed Aug 24 04:37:48 2022] GET /identity/v3/services/image => generated 86 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:48.448727 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938cb14-cffe-4f23-988b-3d98f0adb21b None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:48.571070 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938cb14-cffe-4f23-988b-3d98f0adb21b None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:48.610862 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec2a01-33ee-4f1e-89bb-4b859a60f316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:48.611511 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec2a01-33ee-4f1e-89bb-4b859a60f316 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:48.611786 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec2a01-33ee-4f1e-89bb-4b859a60f316 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:48.612056 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec2a01-33ee-4f1e-89bb-4b859a60f316 None admin] PATH_INFO: `/v3/services` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:48.612752 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec2a01-33ee-4f1e-89bb-4b859a60f316 None admin] RBAC: Adding query filter params (name=image) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:48.613057 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec2a01-33ee-4f1e-89bb-4b859a60f316 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:48.614490 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec2a01-33ee-4f1e-89bb-4b859a60f316 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:48.625402 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 531/1057] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:48.626435 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bf55e-7d91-4e74-a3a3-36487259a86d None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:48.739261 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bf55e-7d91-4e74-a3a3-36487259a86d None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:48.776727 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdaf35-fd4f-49af-9423-d123c6b066be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:48.777360 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdaf35-fd4f-49af-9423-d123c6b066be None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:48.777647 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdaf35-fd4f-49af-9423-d123c6b066be None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:48.777909 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdaf35-fd4f-49af-9423-d123c6b066be None admin] PATH_INFO: `/v3/services` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:48.778559 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdaf35-fd4f-49af-9423-d123c6b066be None admin] RBAC: Adding query filter params (type=image) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:48.778852 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdaf35-fd4f-49af-9423-d123c6b066be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:48.780303 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdaf35-fd4f-49af-9423-d123c6b066be None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:48.782588 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:48.791990 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 527/1058] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:48.793597 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec2a01-33ee-4f1e-89bb-4b859a60f316 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:48.862703 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:48.867718 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa55fc1-53ef-46c5-b227-cedb8b7ecee2 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:48.868221 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa55fc1-53ef-46c5-b227-cedb8b7ecee2 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:48.868329 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa55fc1-53ef-46c5-b227-cedb8b7ecee2 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:48.870510 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 528/1059] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:48.875964 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766b3cf-e223-4b3b-a848-e9e378cebe20 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:48.876240 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766b3cf-e223-4b3b-a848-e9e378cebe20 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:48.876551 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766b3cf-e223-4b3b-a848-e9e378cebe20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:48.897656 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-b766b3cf-e223-4b3b-a848-e9e378cebe20 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:48.899029 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-b766b3cf-e223-4b3b-a848-e9e378cebe20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:48.906018 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec2a01-33ee-4f1e-89bb-4b859a60f316 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:48.945376 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23643cc-1174-4e28-9097-54421e411059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:48.946061 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23643cc-1174-4e28-9097-54421e411059 None admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:48.946283 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23643cc-1174-4e28-9097-54421e411059 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:48.946485 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23643cc-1174-4e28-9097-54421e411059 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:48.947152 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23643cc-1174-4e28-9097-54421e411059 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:48.948532 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23643cc-1174-4e28-9097-54421e411059 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:48.971215 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 532/1060] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:37:48 2022] POST /identity/v3/endpoints => generated 327 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:37:48.993480 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 529/1061] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:49.280265 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23643cc-1174-4e28-9097-54421e411059 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:49.400074 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23643cc-1174-4e28-9097-54421e411059 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:49.424460 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:49.446647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437c848-0669-482b-ac2b-0a6cce49c50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:49.447326 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437c848-0669-482b-ac2b-0a6cce49c50b None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:49.447601 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437c848-0669-482b-ac2b-0a6cce49c50b None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:49.447870 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437c848-0669-482b-ac2b-0a6cce49c50b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:49.463043 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437c848-0669-482b-ac2b-0a6cce49c50b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:37:49.467814 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-d437c848-0669-482b-ac2b-0a6cce49c50b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:37:49.467814 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:49.467814 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:49.467814 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:49.467814 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:49.467814 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:49.467814 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:49.467814 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:49.467814 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:49.467814 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:49.467814 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:49.467814 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:49.467814 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:37:49.467814 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:37:49.467814 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:37:49.467814 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:37:49.468830 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:37:49.468830 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:37:49.468830 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:37:49.468830 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:37:49.468830 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:49.468830 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:49.468830 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:49.468830 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:49.468830 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:49.468830 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:49.468830 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:49.468830 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:49.468830 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:49.468830 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:49.468830 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:49.468830 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:49.469728 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:49.469728 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:49.469728 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:49.469728 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:49.469728 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:37:49.469728 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:37:49.469728 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:37:49.469728 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:37:49.469728 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:37:49.469728 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:37:49.469728 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:37:49.469728 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:49.469728 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 533/1062] 10.222.0.49 () {56 vars in 1120 bytes} [Wed Aug 24 04:37:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:49.477450 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766b3cf-e223-4b3b-a848-e9e378cebe20 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:49.603995 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766b3cf-e223-4b3b-a848-e9e378cebe20 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:49.635728 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:49.648833 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b9a6a-be91-49c0-adf3-78ad10a833ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:49.649491 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b9a6a-be91-49c0-adf3-78ad10a833ab None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:49.649767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b9a6a-be91-49c0-adf3-78ad10a833ab None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:49.650033 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b9a6a-be91-49c0-adf3-78ad10a833ab None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:49.650707 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b9a6a-be91-49c0-adf3-78ad10a833ab None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:49.651004 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b9a6a-be91-49c0-adf3-78ad10a833ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:49.652402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b9a6a-be91-49c0-adf3-78ad10a833ab None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:49.654915 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d867d4-6e30-412f-a444-b8ac62b3a13b None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:49.655273 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d867d4-6e30-412f-a444-b8ac62b3a13b None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:49.655639 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d867d4-6e30-412f-a444-b8ac62b3a13b None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:49.657304 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 534/1063] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:49.663011 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 530/1064] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Aug 24 04:37:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:49.663268 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037beba6-fff9-493c-9ceb-c160ae1d3190 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:49.663405 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037beba6-fff9-493c-9ceb-c160ae1d3190 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:49.663780 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037beba6-fff9-493c-9ceb-c160ae1d3190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:49.668855 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b9a6a-be91-49c0-adf3-78ad10a833ab None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:49.683924 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-037beba6-fff9-493c-9ceb-c160ae1d3190 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:49.685185 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-037beba6-fff9-493c-9ceb-c160ae1d3190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:49.766325 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 535/1065] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:37:49.796421 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b9a6a-be91-49c0-adf3-78ad10a833ab None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:49.835705 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c19ad70-3653-4f6e-8b26-cd2ff5ec9391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:49.836346 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19ad70-3653-4f6e-8b26-cd2ff5ec9391 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:49.836620 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19ad70-3653-4f6e-8b26-cd2ff5ec9391 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:49.836883 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19ad70-3653-4f6e-8b26-cd2ff5ec9391 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:49.849067 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c19ad70-3653-4f6e-8b26-cd2ff5ec9391 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:49.850880 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c19ad70-3653-4f6e-8b26-cd2ff5ec9391 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:49.869735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-6c19ad70-3653-4f6e-8b26-cd2ff5ec9391 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:49.869735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:49.869735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:49.869735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:49.869735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:49.869735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:49.869735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:49.869735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:49.869735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:49.869735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:49.869735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:49.869735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:49.869735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:37:49.869735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:37:49.869735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:37:49.869735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:37:49.871198 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:49.871198 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:49.871198 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:49.871198 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:49.871198 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:49.871198 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:49.871198 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:49.871198 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:49.871198 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:49.871198 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:49.871198 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:49.871198 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:49.871198 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:49.871198 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:49.871198 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:49.871198 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:49.871198 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:37:49.872118 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:37:49.872118 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:49.872118 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:49.873756 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 531/1066] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:49.877934 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037beba6-fff9-493c-9ceb-c160ae1d3190 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:50.003090 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037beba6-fff9-493c-9ceb-c160ae1d3190 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:50.015127 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:50.034817 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c19ad70-3653-4f6e-8b26-cd2ff5ec9391 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:50.042370 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674bf8ec-6099-4739-870b-eac564b18c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:50.043004 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bf8ec-6099-4739-870b-eac564b18c8a None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:50.043261 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bf8ec-6099-4739-870b-eac564b18c8a None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:50.043562 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674bf8ec-6099-4739-870b-eac564b18c8a None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:50.044205 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674bf8ec-6099-4739-870b-eac564b18c8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:50.044481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674bf8ec-6099-4739-870b-eac564b18c8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:50.045921 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674bf8ec-6099-4739-870b-eac564b18c8a None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:50.059342 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 536/1067] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:50.065025 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674bf8ec-6099-4739-870b-eac564b18c8a None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:50.087019 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:50.161014 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c19ad70-3653-4f6e-8b26-cd2ff5ec9391 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:50.190030 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674bf8ec-6099-4739-870b-eac564b18c8a None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:50.200694 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75469ae7-b05e-4e6e-86b2-81cf1e8d7cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:50.201355 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75469ae7-b05e-4e6e-86b2-81cf1e8d7cbf None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:50.201802 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75469ae7-b05e-4e6e-86b2-81cf1e8d7cbf None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:50.201912 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75469ae7-b05e-4e6e-86b2-81cf1e8d7cbf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:50.215400 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75469ae7-b05e-4e6e-86b2-81cf1e8d7cbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:37:50.220472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-75469ae7-b05e-4e6e-86b2-81cf1e8d7cbf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:37:50.220472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:50.220472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:50.220472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:50.220472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:50.220472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:50.220472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:50.220472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:50.220472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:50.220472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:50.220472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:50.220472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:50.220472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:37:50.220472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:37:50.220472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:37:50.220472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:37:50.221691 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:37:50.221691 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:37:50.221691 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:37:50.221691 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:37:50.221691 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:50.221691 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:50.221691 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:50.221691 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:50.221691 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:50.221691 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:50.221691 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:50.221691 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:50.221691 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:50.221691 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:50.221691 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:50.221691 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:50.222556 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:50.222556 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:50.222556 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:50.222556 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:50.222556 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:37:50.222556 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:37:50.222556 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:37:50.222556 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:37:50.222556 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:37:50.222556 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:37:50.222556 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:37:50.222556 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:50.222556 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 532/1068] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 24 04:37:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:50.229960 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75469ae7-b05e-4e6e-86b2-81cf1e8d7cbf None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:50.235057 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8a807-abb0-4641-a2c4-2c8bd4d8a350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:50.235862 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8a807-abb0-4641-a2c4-2c8bd4d8a350 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:50.236265 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8a807-abb0-4641-a2c4-2c8bd4d8a350 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:50.236674 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8a807-abb0-4641-a2c4-2c8bd4d8a350 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:50.245478 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8a807-abb0-4641-a2c4-2c8bd4d8a350 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:50.247028 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8a807-abb0-4641-a2c4-2c8bd4d8a350 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:50.261383 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-3ff8a807-abb0-4641-a2c4-2c8bd4d8a350 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:37:50.261383 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:50.261383 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:50.261383 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:50.261383 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:50.261383 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:50.261383 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:50.261383 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:50.261383 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:50.261383 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:50.261383 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:50.261383 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:50.261383 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:37:50.261383 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:37:50.261383 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:37:50.261383 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:37:50.262375 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:50.262375 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:50.262375 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:37:50.262375 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:37:50.262375 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:37:50.262375 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:37:50.262375 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:50.262375 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:50.262375 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:50.262375 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:50.262375 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:50.262375 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:50.262375 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:50.262375 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:50.262375 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:50.262375 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:50.262375 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:50.262375 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:50.263342 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:50.263342 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:50.263342 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:37:50.263342 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:37:50.263342 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:37:50.263342 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:37:50.263342 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:37:50.263342 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:37:50.263342 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:37:50.263342 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:50.263342 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 537/1069] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Aug 24 04:37:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:50.268808 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8a807-abb0-4641-a2c4-2c8bd4d8a350 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:50.311878 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:50.353599 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:50.360000 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75469ae7-b05e-4e6e-86b2-81cf1e8d7cbf None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:50.404687 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8a807-abb0-4641-a2c4-2c8bd4d8a350 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:50.407994 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4bfa3-aeb1-4916-8514-40a00504b3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:50.408631 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4bfa3-aeb1-4916-8514-40a00504b3b8 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:50.408895 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4bfa3-aeb1-4916-8514-40a00504b3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:50.409288 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4bfa3-aeb1-4916-8514-40a00504b3b8 None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:50.409957 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc4bfa3-aeb1-4916-8514-40a00504b3b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:50.410268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc4bfa3-aeb1-4916-8514-40a00504b3b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:50.411672 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc4bfa3-aeb1-4916-8514-40a00504b3b8 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:50.427953 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 533/1070] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:37:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:50.428822 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4bfa3-aeb1-4916-8514-40a00504b3b8 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:50.443762 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72220120-0563-455a-972a-db1d1c769d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:50.444669 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72220120-0563-455a-972a-db1d1c769d2d None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:50.445104 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72220120-0563-455a-972a-db1d1c769d2d None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:50.445606 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72220120-0563-455a-972a-db1d1c769d2d None admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:50.446678 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72220120-0563-455a-972a-db1d1c769d2d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:50.447171 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72220120-0563-455a-972a-db1d1c769d2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:50.449141 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72220120-0563-455a-972a-db1d1c769d2d None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:50.471859 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 538/1071] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Aug 24 04:37:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:50.477928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72220120-0563-455a-972a-db1d1c769d2d None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:50.558365 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4bfa3-aeb1-4916-8514-40a00504b3b8 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:50.584725 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:50.600549 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72220120-0563-455a-972a-db1d1c769d2d None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:50.605989 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c73867-636c-458a-a459-cb5389d3244f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:50.606964 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c73867-636c-458a-a459-cb5389d3244f None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:50.607587 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c73867-636c-458a-a459-cb5389d3244f None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:50.608051 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c73867-636c-458a-a459-cb5389d3244f None admin] PATH_INFO: `/v3/users/5132ab3babef46f8b9030f4818edde7e` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:50.609745 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c73867-636c-458a-a459-cb5389d3244f None admin] RBAC: Authorizing `identity:get_user(user_id=5132ab3babef46f8b9030f4818edde7e)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:50.611430 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c73867-636c-458a-a459-cb5389d3244f None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:50.613267 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 534/1072] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:37:50 2022] GET /identity/v3/users/5132ab3babef46f8b9030f4818edde7e => generated 285 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:50.619879 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c73867-636c-458a-a459-cb5389d3244f None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:50.638083 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4653e-74c2-46ba-b587-ee6f95b8bc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:50.638717 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4653e-74c2-46ba-b587-ee6f95b8bc4f None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:50.638997 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4653e-74c2-46ba-b587-ee6f95b8bc4f None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:50.639268 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4653e-74c2-46ba-b587-ee6f95b8bc4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:50.649713 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4653e-74c2-46ba-b587-ee6f95b8bc4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:50.651184 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4653e-74c2-46ba-b587-ee6f95b8bc4f None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:50.657743 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:50.666976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-90d4653e-74c2-46ba-b587-ee6f95b8bc4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:50.666976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:50.666976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:50.666976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:50.666976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:50.666976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:50.666976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:50.666976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:50.666976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:50.666976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:50.666976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:50.666976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:50.666976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:37:50.666976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:37:50.666976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:37:50.666976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:37:50.667951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:50.667951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:50.667951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:50.667951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:50.667951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:50.667951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:50.667951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:50.667951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:50.667951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:50.667951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:50.667951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:50.667951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:50.667951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:50.667951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:50.667951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:50.667951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:50.667951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:37:50.668824 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:37:50.668824 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:50.668824 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:50.673479 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 539/1073] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:37:50.674314 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4653e-74c2-46ba-b587-ee6f95b8bc4f None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:50.744317 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c73867-636c-458a-a459-cb5389d3244f None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:50.784816 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4fcfd-43f6-48c7-9ef3-47f165f29a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:50.785795 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4fcfd-43f6-48c7-9ef3-47f165f29a2e None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:50.786205 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4fcfd-43f6-48c7-9ef3-47f165f29a2e None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:50.786613 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4fcfd-43f6-48c7-9ef3-47f165f29a2e None admin] PATH_INFO: `/v3/projects/30880bd43a8f4f50bd88590105ed5a3c` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:50.788263 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad4fcfd-43f6-48c7-9ef3-47f165f29a2e None admin] RBAC: Authorizing `identity:get_project(project_id=30880bd43a8f4f50bd88590105ed5a3c)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:50.789790 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4653e-74c2-46ba-b587-ee6f95b8bc4f None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:50.790650 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad4fcfd-43f6-48c7-9ef3-47f165f29a2e None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:50.793375 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 535/1074] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:37:50 2022] GET /identity/v3/projects/30880bd43a8f4f50bd88590105ed5a3c => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:50.799323 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4fcfd-43f6-48c7-9ef3-47f165f29a2e None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:50.828858 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4d23d-12e8-4dcc-b6ec-3eb7271c188e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:50.829524 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4d23d-12e8-4dcc-b6ec-3eb7271c188e None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:50.829805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4d23d-12e8-4dcc-b6ec-3eb7271c188e None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:50.830079 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e4d23d-12e8-4dcc-b6ec-3eb7271c188e None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:50.830753 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4d23d-12e8-4dcc-b6ec-3eb7271c188e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:50.831058 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4d23d-12e8-4dcc-b6ec-3eb7271c188e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:50.832495 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e4d23d-12e8-4dcc-b6ec-3eb7271c188e None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:50.843741 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:50.853073 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 540/1075] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:50.854214 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4d23d-12e8-4dcc-b6ec-3eb7271c188e None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:50.916248 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:50.924427 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4fcfd-43f6-48c7-9ef3-47f165f29a2e None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:50.967650 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3b1d2-2383-4822-bc20-7a712309f348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:50.968334 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3b1d2-2383-4822-bc20-7a712309f348 None admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:50.968611 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3b1d2-2383-4822-bc20-7a712309f348 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:50.968843 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e4d23d-12e8-4dcc-b6ec-3eb7271c188e None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:50.968941 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3b1d2-2383-4822-bc20-7a712309f348 None admin] PATH_INFO: `/v3/projects/30880bd43a8f4f50bd88590105ed5a3c/users/5132ab3babef46f8b9030f4818edde7e/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:50.970900 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca3b1d2-2383-4822-bc20-7a712309f348 None admin] RBAC: Authorizing `identity:create_grant(project_id=30880bd43a8f4f50bd88590105ed5a3c, user_id=5132ab3babef46f8b9030f4818edde7e, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:50.972374 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca3b1d2-2383-4822-bc20-7a712309f348 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:50.988623 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 536/1076] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 24 04:37:50 2022] PUT /identity/v3/projects/30880bd43a8f4f50bd88590105ed5a3c/users/5132ab3babef46f8b9030f4818edde7e/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:37:50.990314 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c599e-1014-415e-9245-7e89e5f48c53 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:50.990727 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c599e-1014-415e-9245-7e89e5f48c53 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:50.991210 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c599e-1014-415e-9245-7e89e5f48c53 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:50.992732 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 537/1077] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:50.998885 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e0361-ccfd-4012-b7a8-0aeb24517e10 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:50.999257 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e0361-ccfd-4012-b7a8-0aeb24517e10 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:50.999543 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e0361-ccfd-4012-b7a8-0aeb24517e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:51.019071 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-138e0361-ccfd-4012-b7a8-0aeb24517e10 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:51.020350 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-138e0361-ccfd-4012-b7a8-0aeb24517e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:51.026333 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ff5b2-2028-43a8-8a60-7dea9bcd4f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:51.027034 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ff5b2-2028-43a8-8a60-7dea9bcd4f27 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:51.027267 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ff5b2-2028-43a8-8a60-7dea9bcd4f27 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:51.027538 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ff5b2-2028-43a8-8a60-7dea9bcd4f27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:51.038091 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ff5b2-2028-43a8-8a60-7dea9bcd4f27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:51.040197 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ff5b2-2028-43a8-8a60-7dea9bcd4f27 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:51.058003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-d52ff5b2-2028-43a8-8a60-7dea9bcd4f27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:37:51.058003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:51.058003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:51.058003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:51.058003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:51.058003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:51.058003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:51.058003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:51.058003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:51.058003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:51.058003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:51.058003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:51.058003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:37:51.058003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:37:51.058003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:37:51.059038 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:37:51.059038 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:51.059038 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:51.059038 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:51.059038 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:51.059038 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:51.059038 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:51.059038 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:51.059038 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:51.059038 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:51.059038 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:51.059038 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:51.059038 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:51.059038 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:51.059038 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:51.059038 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:51.059038 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:51.059944 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:37:51.059944 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:37:51.059944 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:37:51.059944 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:37:51.059944 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:37:51.059944 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:37:51.059944 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:37:51.059944 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:51.061589 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 541/1078] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:37:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:51.067127 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ff5b2-2028-43a8-8a60-7dea9bcd4f27 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:51.117373 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 538/1079] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:37:51.159289 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:51.206061 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ff5b2-2028-43a8-8a60-7dea9bcd4f27 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:51.242066 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c6208-3fb0-4051-b2d6-6d36206d6615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:51.242738 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c6208-3fb0-4051-b2d6-6d36206d6615 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:51.243021 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c6208-3fb0-4051-b2d6-6d36206d6615 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:51.243295 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c6208-3fb0-4051-b2d6-6d36206d6615 None admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:51.244009 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c6208-3fb0-4051-b2d6-6d36206d6615 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:51.244313 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c6208-3fb0-4051-b2d6-6d36206d6615 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:51.245834 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c6208-3fb0-4051-b2d6-6d36206d6615 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:51.261061 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 542/1080] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 24 04:37:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:51.267190 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e0361-ccfd-4012-b7a8-0aeb24517e10 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:51.359034 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:51.372632 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e0361-ccfd-4012-b7a8-0aeb24517e10 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:51.408483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c6208-3fb0-4051-b2d6-6d36206d6615 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:51.409511 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f988e-4d04-4ed4-9e2c-f9f45ed7f9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:51.410225 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f988e-4d04-4ed4-9e2c-f9f45ed7f9c4 None admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:51.410504 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f988e-4d04-4ed4-9e2c-f9f45ed7f9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:51.410775 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f988e-4d04-4ed4-9e2c-f9f45ed7f9c4 None admin] PATH_INFO: `/v3/projects/08755f450e6c47dcaaaa754a6aa2ec62/users/9dc9a3cf381e4a2da36ed82b407a2d94/roles/ebe27ef209074cbb99d86cc8dde4c5d9` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:51.412982 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f988e-4d04-4ed4-9e2c-f9f45ed7f9c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=08755f450e6c47dcaaaa754a6aa2ec62, user_id=9dc9a3cf381e4a2da36ed82b407a2d94, role_id=ebe27ef209074cbb99d86cc8dde4c5d9)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:51.414616 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f988e-4d04-4ed4-9e2c-f9f45ed7f9c4 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:51.430956 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 539/1081] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 24 04:37:51 2022] PUT /identity/v3/projects/08755f450e6c47dcaaaa754a6aa2ec62/users/9dc9a3cf381e4a2da36ed82b407a2d94/roles/ebe27ef209074cbb99d86cc8dde4c5d9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:37:51.541571 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c6208-3fb0-4051-b2d6-6d36206d6615 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:51.567332 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:51.593247 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6122424-6848-4122-a846-27b2fbe8d062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:51.593928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6122424-6848-4122-a846-27b2fbe8d062 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:51.594214 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6122424-6848-4122-a846-27b2fbe8d062 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:51.594483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6122424-6848-4122-a846-27b2fbe8d062 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:51.668675 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6122424-6848-4122-a846-27b2fbe8d062 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:51.669258 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6122424-6848-4122-a846-27b2fbe8d062 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:51.779507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 543/1082] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:37:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 04:37:51.781668 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f988e-4d04-4ed4-9e2c-f9f45ed7f9c4 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:51.886874 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f988e-4d04-4ed4-9e2c-f9f45ed7f9c4 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:51.923380 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4763615-8da3-432a-a159-61c404e06275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:51.924030 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4763615-8da3-432a-a159-61c404e06275 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:51.924274 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4763615-8da3-432a-a159-61c404e06275 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:51.924544 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4763615-8da3-432a-a159-61c404e06275 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:51.934927 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4763615-8da3-432a-a159-61c404e06275 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:51.936510 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4763615-8da3-432a-a159-61c404e06275 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:51.947821 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:51.955896 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-c4763615-8da3-432a-a159-61c404e06275 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:51.955896 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:51.955896 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:51.955896 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:51.955896 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:51.955896 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:51.955896 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:51.955896 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:51.955896 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:51.955896 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:51.955896 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:51.955896 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:51.955896 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:37:51.955896 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:37:51.955896 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:37:51.955896 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:37:51.957038 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:51.957038 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:51.957038 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:51.957038 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:51.957038 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:51.957038 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:51.957038 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:51.957038 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:51.957038 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:51.957038 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:51.957038 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:51.957038 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:51.957038 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:51.957038 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:51.957038 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:51.957038 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:51.957038 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:37:51.958200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:37:51.958200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:51.958200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:51.960033 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 540/1083] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:51.966237 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6122424-6848-4122-a846-27b2fbe8d062 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:51.988813 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:52.078914 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6122424-6848-4122-a846-27b2fbe8d062 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:52.115813 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe210f0-a450-4a77-b362-39e09dcac8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:52.116424 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe210f0-a450-4a77-b362-39e09dcac8cc None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:52.116699 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe210f0-a450-4a77-b362-39e09dcac8cc None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:52.116969 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe210f0-a450-4a77-b362-39e09dcac8cc None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:52.117674 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe210f0-a450-4a77-b362-39e09dcac8cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:52.117975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe210f0-a450-4a77-b362-39e09dcac8cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:52.119349 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe210f0-a450-4a77-b362-39e09dcac8cc None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:52.131645 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 544/1084] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:52.912012 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c9514-9b86-4398-8a83-1c3142257e6b None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:52.912397 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c9514-9b86-4398-8a83-1c3142257e6b None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:52.912668 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c9514-9b86-4398-8a83-1c3142257e6b None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:52.914077 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 541/1085] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:52.919602 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8a804-f28c-4098-91b1-d0060476988f None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:52.919891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8a804-f28c-4098-91b1-d0060476988f None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:52.920165 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed8a804-f28c-4098-91b1-d0060476988f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:52.938879 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-9ed8a804-f28c-4098-91b1-d0060476988f None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:52.940056 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-9ed8a804-f28c-4098-91b1-d0060476988f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:53.010177 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 545/1086] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:53.276786 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c9514-9b86-4398-8a83-1c3142257e6b None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:53.348329 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830a074-3a8e-4435-b558-2fa96e806600 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:53.348876 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830a074-3a8e-4435-b558-2fa96e806600 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:53.348876 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830a074-3a8e-4435-b558-2fa96e806600 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:53.350640 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 546/1087] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:37:53.355840 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8419f-73de-4b21-bd70-1876c8bbe733 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:53.356126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8419f-73de-4b21-bd70-1876c8bbe733 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:53.356404 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8419f-73de-4b21-bd70-1876c8bbe733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:53.378472 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-5ed8419f-73de-4b21-bd70-1876c8bbe733 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:53.379690 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-5ed8419f-73de-4b21-bd70-1876c8bbe733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:53.382663 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:53.389408 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c9514-9b86-4398-8a83-1c3142257e6b None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:53.425783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834baa7-16ef-4b95-8b9a-a4c53657cafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:53.426426 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834baa7-16ef-4b95-8b9a-a4c53657cafe None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:53.426710 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834baa7-16ef-4b95-8b9a-a4c53657cafe None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:53.426985 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834baa7-16ef-4b95-8b9a-a4c53657cafe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:53.437572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8834baa7-16ef-4b95-8b9a-a4c53657cafe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:37:53.442287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-8834baa7-16ef-4b95-8b9a-a4c53657cafe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:37:53.442287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:53.442287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:53.442287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:53.442287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:53.442287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:53.442287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:53.442287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:53.442287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:53.442287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:53.442287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:53.442287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:53.442287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:37:53.442287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:37:53.442287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:37:53.442287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:37:53.443278 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:37:53.443278 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:37:53.443278 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:37:53.443278 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:37:53.443278 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:53.443278 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:53.443278 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:53.443278 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:53.443278 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:53.443278 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:53.443278 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:53.443278 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:53.443278 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:53.443278 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:53.443278 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:53.443278 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:53.444115 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:53.444115 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:53.444115 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:53.444115 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:53.444115 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:37:53.444115 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:37:53.444115 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:37:53.444115 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:37:53.444115 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:37:53.444115 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:37:53.444115 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:37:53.444115 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:53.444115 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 542/1088] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 24 04:37:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:53.449620 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834baa7-16ef-4b95-8b9a-a4c53657cafe None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:53.450586 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 547/1089] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:37:53.510904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:53.554961 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834baa7-16ef-4b95-8b9a-a4c53657cafe None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:53.590726 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a18d5a-cf8e-4a9a-8ec2-2f668b17897f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:53.591338 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a18d5a-cf8e-4a9a-8ec2-2f668b17897f None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:53.591616 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a18d5a-cf8e-4a9a-8ec2-2f668b17897f None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:53.591887 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a18d5a-cf8e-4a9a-8ec2-2f668b17897f None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:53.592545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a18d5a-cf8e-4a9a-8ec2-2f668b17897f None admin] RBAC: Adding query filter params (name=admin) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:53.592849 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a18d5a-cf8e-4a9a-8ec2-2f668b17897f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:53.594264 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a18d5a-cf8e-4a9a-8ec2-2f668b17897f None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:53.603797 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 543/1090] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:37:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:53.609746 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8419f-73de-4b21-bd70-1876c8bbe733 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:53.711493 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8419f-73de-4b21-bd70-1876c8bbe733 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:53.714131 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a18d5a-cf8e-4a9a-8ec2-2f668b17897f None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:53.745704 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae7f59-df69-4265-9437-ba34c12c784a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:53.746357 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae7f59-df69-4265-9437-ba34c12c784a None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:53.746633 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae7f59-df69-4265-9437-ba34c12c784a None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:53.746893 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae7f59-df69-4265-9437-ba34c12c784a None admin] PATH_INFO: `/v3/users/5132ab3babef46f8b9030f4818edde7e` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:53.748023 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae7f59-df69-4265-9437-ba34c12c784a None admin] RBAC: Authorizing `identity:get_user(user_id=5132ab3babef46f8b9030f4818edde7e)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:53.749522 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae7f59-df69-4265-9437-ba34c12c784a None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:53.751187 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 548/1091] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:37:53 2022] GET /identity/v3/users/5132ab3babef46f8b9030f4818edde7e => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:53.757244 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae7f59-df69-4265-9437-ba34c12c784a None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:53.767997 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:53.816840 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a18d5a-cf8e-4a9a-8ec2-2f668b17897f None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:53.840121 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:53.853089 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d7a9c-4e33-405d-92ef-ee52a67a5aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:53.853750 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d7a9c-4e33-405d-92ef-ee52a67a5aba None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:53.854023 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d7a9c-4e33-405d-92ef-ee52a67a5aba None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:53.854288 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d7a9c-4e33-405d-92ef-ee52a67a5aba None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:53.858811 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae7f59-df69-4265-9437-ba34c12c784a None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:53.864304 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d7a9c-4e33-405d-92ef-ee52a67a5aba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:37:53.869040 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-c30d7a9c-4e33-405d-92ef-ee52a67a5aba None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:37:53.869040 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:53.869040 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:53.869040 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:53.869040 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:53.869040 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:53.869040 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:53.869040 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:53.869040 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:53.869040 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:53.869040 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:53.869040 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:53.869040 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:37:53.869040 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:37:53.869040 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:37:53.869040 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:37:53.870172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:37:53.870172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:37:53.870172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:37:53.870172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:37:53.870172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:53.870172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:53.870172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:53.870172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:53.870172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:53.870172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:53.870172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:53.870172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:53.870172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:53.870172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:53.870172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:53.870172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:53.871145 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:53.871145 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:53.871145 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:53.871145 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:53.871145 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:37:53.871145 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:37:53.871145 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:37:53.871145 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:37:53.871145 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:37:53.871145 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:37:53.871145 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:37:53.871145 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:53.871145 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 544/1092] 10.222.0.49 () {56 vars in 1120 bytes} [Wed Aug 24 04:37:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:53.876363 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d7a9c-4e33-405d-92ef-ee52a67a5aba None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:53.895647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc101cb7-d3a4-4370-9aff-814a13e7dacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:53.896284 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc101cb7-d3a4-4370-9aff-814a13e7dacd None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:53.896589 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc101cb7-d3a4-4370-9aff-814a13e7dacd None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:53.896863 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc101cb7-d3a4-4370-9aff-814a13e7dacd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:53.963059 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc101cb7-d3a4-4370-9aff-814a13e7dacd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:53.964503 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc101cb7-d3a4-4370-9aff-814a13e7dacd None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:53.974351 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:53.979279 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d7a9c-4e33-405d-92ef-ee52a67a5aba None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:54.013563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cc8d7-a3a3-4930-bb02-4eb265f0d9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:54.014206 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cc8d7-a3a3-4930-bb02-4eb265f0d9b4 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:54.014488 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cc8d7-a3a3-4930-bb02-4eb265f0d9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:54.014760 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cc8d7-a3a3-4930-bb02-4eb265f0d9b4 None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:54.015432 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cc8d7-a3a3-4930-bb02-4eb265f0d9b4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:54.015741 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cc8d7-a3a3-4930-bb02-4eb265f0d9b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:54.017114 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cc8d7-a3a3-4930-bb02-4eb265f0d9b4 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:54.029967 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 545/1093] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Aug 24 04:37:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:54.031470 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cc8d7-a3a3-4930-bb02-4eb265f0d9b4 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:54.071782 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 549/1094] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:37:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 04:37:54.077790 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc101cb7-d3a4-4370-9aff-814a13e7dacd None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:54.078380 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:54.137772 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cc8d7-a3a3-4930-bb02-4eb265f0d9b4 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:54.172805 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3724f27-f07d-4448-b7a6-25d7fd915521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:54.173476 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3724f27-f07d-4448-b7a6-25d7fd915521 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:54.173755 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3724f27-f07d-4448-b7a6-25d7fd915521 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:54.174026 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3724f27-f07d-4448-b7a6-25d7fd915521 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:54.180430 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc101cb7-d3a4-4370-9aff-814a13e7dacd None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:54.184894 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3724f27-f07d-4448-b7a6-25d7fd915521 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:54.186390 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3724f27-f07d-4448-b7a6-25d7fd915521 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:54.190945 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:54.200720 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-c3724f27-f07d-4448-b7a6-25d7fd915521 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:54.200720 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:54.200720 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:54.200720 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:54.200720 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:54.200720 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:54.200720 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:54.200720 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:54.200720 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:54.200720 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:54.200720 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:54.200720 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:54.200720 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:37:54.200720 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:37:54.200720 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:37:54.200720 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:37:54.201767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:54.201767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:54.201767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:54.201767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:54.201767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:54.201767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:54.201767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:54.201767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:54.201767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:54.201767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:54.201767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:54.201767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:54.201767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:54.201767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:54.201767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:54.201767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:54.201767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:37:54.202831 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:37:54.202831 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:54.202831 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:54.202831 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 546/1095] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:54.207975 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3724f27-f07d-4448-b7a6-25d7fd915521 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:54.218674 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064366da-009e-41a9-915f-b760fcafb951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:54.219341 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064366da-009e-41a9-915f-b760fcafb951 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:54.219625 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064366da-009e-41a9-915f-b760fcafb951 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:54.219889 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064366da-009e-41a9-915f-b760fcafb951 None admin] PATH_INFO: `/v3/projects/30880bd43a8f4f50bd88590105ed5a3c` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:54.221049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064366da-009e-41a9-915f-b760fcafb951 None admin] RBAC: Authorizing `identity:get_project(project_id=30880bd43a8f4f50bd88590105ed5a3c)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:54.222566 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064366da-009e-41a9-915f-b760fcafb951 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:54.224308 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 550/1096] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:37:54 2022] GET /identity/v3/projects/30880bd43a8f4f50bd88590105ed5a3c => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:54.230957 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064366da-009e-41a9-915f-b760fcafb951 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:54.308055 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:54.314624 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3724f27-f07d-4448-b7a6-25d7fd915521 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:54.336905 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064366da-009e-41a9-915f-b760fcafb951 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:54.350072 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d3dd3-2903-451c-bc82-8f5d135817e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:54.351099 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d3dd3-2903-451c-bc82-8f5d135817e9 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:54.351351 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d3dd3-2903-451c-bc82-8f5d135817e9 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:54.351691 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d3dd3-2903-451c-bc82-8f5d135817e9 None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:54.352389 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d3dd3-2903-451c-bc82-8f5d135817e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:54.352947 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d3dd3-2903-451c-bc82-8f5d135817e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:54.354122 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d3dd3-2903-451c-bc82-8f5d135817e9 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:54.367982 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 547/1097] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:54.372807 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239c016-2f0a-42f5-add2-9eaa2addf9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:54.373483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239c016-2f0a-42f5-add2-9eaa2addf9d9 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:54.373716 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d3dd3-2903-451c-bc82-8f5d135817e9 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:54.373837 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239c016-2f0a-42f5-add2-9eaa2addf9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:54.374031 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239c016-2f0a-42f5-add2-9eaa2addf9d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:54.374757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6239c016-2f0a-42f5-add2-9eaa2addf9d9 None admin] RBAC: Adding query filter params (role.id=74ce7b72bcc94a8a8ad65c3db928e6ac, scope.project.id=30880bd43a8f4f50bd88590105ed5a3c, user.id=5132ab3babef46f8b9030f4818edde7e) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:54.375068 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6239c016-2f0a-42f5-add2-9eaa2addf9d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:54.376481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6239c016-2f0a-42f5-add2-9eaa2addf9d9 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:54.382684 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 551/1098] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:37:54 2022] GET /identity/v3/role_assignments?user.id=5132ab3babef46f8b9030f4818edde7e&scope.project.id=30880bd43a8f4f50bd88590105ed5a3c&role.id=74ce7b72bcc94a8a8ad65c3db928e6ac => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:37:54.490935 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d3dd3-2903-451c-bc82-8f5d135817e9 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:54.533701 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72784c-f9b5-4193-bd39-ffbc2fbb2486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:54.534355 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72784c-f9b5-4193-bd39-ffbc2fbb2486 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:54.534632 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72784c-f9b5-4193-bd39-ffbc2fbb2486 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:54.534901 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72784c-f9b5-4193-bd39-ffbc2fbb2486 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:54.543216 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e72784c-f9b5-4193-bd39-ffbc2fbb2486 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:54.544680 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e72784c-f9b5-4193-bd39-ffbc2fbb2486 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:54.557172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-6e72784c-f9b5-4193-bd39-ffbc2fbb2486 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:37:54.557172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:54.557172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:54.557172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:54.557172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:54.557172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:54.557172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:54.557172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:54.557172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:54.557172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:54.557172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:54.557172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:54.557172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:37:54.557172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:37:54.557172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:37:54.557172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:37:54.558475 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:54.558475 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:54.558475 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:37:54.558475 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:37:54.558475 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:37:54.558475 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:37:54.558475 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:54.558475 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:54.558475 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:54.558475 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:54.558475 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:54.558475 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:54.558475 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:54.558475 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:54.558475 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:54.558475 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:54.558475 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:54.558475 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:54.559904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:54.559904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:54.559904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:37:54.559904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:37:54.559904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:37:54.559904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:37:54.559904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:37:54.559904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:37:54.559904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:37:54.559904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:37:54.559904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 548/1099] 10.222.0.49 () {56 vars in 1093 bytes} [Wed Aug 24 04:37:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:37:54.564455 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239c016-2f0a-42f5-add2-9eaa2addf9d9 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:54.613051 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:54.691371 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239c016-2f0a-42f5-add2-9eaa2addf9d9 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:54.729934 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82955dcd-74af-4123-b44f-2f07248b2476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:54.730540 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82955dcd-74af-4123-b44f-2f07248b2476 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:54.730813 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82955dcd-74af-4123-b44f-2f07248b2476 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:54.731073 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82955dcd-74af-4123-b44f-2f07248b2476 None admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:54.731812 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82955dcd-74af-4123-b44f-2f07248b2476 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:54.732129 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82955dcd-74af-4123-b44f-2f07248b2476 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:54.733586 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82955dcd-74af-4123-b44f-2f07248b2476 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:54.752565 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 552/1100] 10.222.0.49 () {56 vars in 1133 bytes} [Wed Aug 24 04:37:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:54.758629 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72784c-f9b5-4193-bd39-ffbc2fbb2486 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:54.779924 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:54.882648 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72784c-f9b5-4193-bd39-ffbc2fbb2486 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:54.920736 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bec6e2-2d24-45c9-817c-1b7f0aff4cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:54.921382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bec6e2-2d24-45c9-817c-1b7f0aff4cad None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:54.921661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bec6e2-2d24-45c9-817c-1b7f0aff4cad None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:54.921935 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bec6e2-2d24-45c9-817c-1b7f0aff4cad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:55.004617 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bec6e2-2d24-45c9-817c-1b7f0aff4cad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:55.006493 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bec6e2-2d24-45c9-817c-1b7f0aff4cad None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:55.028971 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:55.136635 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 549/1101] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:37:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:37:55.142518 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82955dcd-74af-4123-b44f-2f07248b2476 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:55.260303 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:55.267150 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82955dcd-74af-4123-b44f-2f07248b2476 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:55.305320 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a70177-8cdf-4303-8204-f8309354effb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:55.305973 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a70177-8cdf-4303-8204-f8309354effb None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:55.306253 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a70177-8cdf-4303-8204-f8309354effb None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:55.306522 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a70177-8cdf-4303-8204-f8309354effb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:55.317569 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a70177-8cdf-4303-8204-f8309354effb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:55.319069 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a70177-8cdf-4303-8204-f8309354effb None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:55.334140 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-10a70177-8cdf-4303-8204-f8309354effb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:55.334140 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:55.334140 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:55.334140 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:55.334140 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:55.334140 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:55.334140 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:55.334140 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:55.334140 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:55.334140 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:55.334140 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:55.334140 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:55.334140 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:37:55.334140 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:37:55.334140 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:37:55.334140 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:37:55.335158 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:55.335158 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:55.335158 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:55.335158 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:55.335158 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:55.335158 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:55.335158 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:55.335158 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:55.335158 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:55.335158 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:55.335158 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:55.335158 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:55.335158 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:55.335158 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:55.335158 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:55.335158 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:55.335158 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:37:55.336048 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:37:55.336048 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:37:55.336048 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:55.336048 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 553/1102] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:55.341183 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bec6e2-2d24-45c9-817c-1b7f0aff4cad None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:55.445932 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bec6e2-2d24-45c9-817c-1b7f0aff4cad None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:55.462990 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:55.481966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff8574-3923-42c8-be5c-8e547a078034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:55.482576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff8574-3923-42c8-be5c-8e547a078034 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:55.482850 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff8574-3923-42c8-be5c-8e547a078034 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:55.483118 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff8574-3923-42c8-be5c-8e547a078034 None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:55.483761 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff8574-3923-42c8-be5c-8e547a078034 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:55.484055 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff8574-3923-42c8-be5c-8e547a078034 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:55.485446 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff8574-3923-42c8-be5c-8e547a078034 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:55.498013 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 550/1103] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:55.503970 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a70177-8cdf-4303-8204-f8309354effb None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:55.620073 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a70177-8cdf-4303-8204-f8309354effb None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:55.656224 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21659a5e-3ece-4c74-9973-10523d17d034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:55.656869 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21659a5e-3ece-4c74-9973-10523d17d034 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:55.657145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21659a5e-3ece-4c74-9973-10523d17d034 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:55.657441 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21659a5e-3ece-4c74-9973-10523d17d034 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:55.664997 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21659a5e-3ece-4c74-9973-10523d17d034 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:55.666508 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21659a5e-3ece-4c74-9973-10523d17d034 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:55.678078 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-21659a5e-3ece-4c74-9973-10523d17d034 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:37:55.678078 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:37:55.678078 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:37:55.678078 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:37:55.678078 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:37:55.678078 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:37:55.678078 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:37:55.678078 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:37:55.678078 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:37:55.678078 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:37:55.678078 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:37:55.678078 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:37:55.678078 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:37:55.678078 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:37:55.678078 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:37:55.679262 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:37:55.679262 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:37:55.679262 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:37:55.679262 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:37:55.679262 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:37:55.679262 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:37:55.679262 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:37:55.679262 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:37:55.679262 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:37:55.679262 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:37:55.679262 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:37:55.679262 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:37:55.679262 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:37:55.679262 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:37:55.679262 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:37:55.679262 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:37:55.679262 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:37:55.680208 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:37:55.680208 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:37:55.680208 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:37:55.680208 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:37:55.680208 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:37:55.680208 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:37:55.680208 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:37:55.680208 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:37:55.680208 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 554/1104] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:37:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:37:55.685146 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff8574-3923-42c8-be5c-8e547a078034 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:55.794046 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff8574-3923-42c8-be5c-8e547a078034 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:55.830773 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f904661-88f8-4f59-b440-6c9611ebd17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:55.831404 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f904661-88f8-4f59-b440-6c9611ebd17d None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:55.831682 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f904661-88f8-4f59-b440-6c9611ebd17d None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:55.831955 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f904661-88f8-4f59-b440-6c9611ebd17d None admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:55.832667 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f904661-88f8-4f59-b440-6c9611ebd17d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:55.832980 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f904661-88f8-4f59-b440-6c9611ebd17d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:55.834444 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f904661-88f8-4f59-b440-6c9611ebd17d None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:55.846864 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 551/1105] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 24 04:37:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:55.853724 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21659a5e-3ece-4c74-9973-10523d17d034 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:55.867092 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:55.962510 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21659a5e-3ece-4c74-9973-10523d17d034 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:55.998117 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b13cd-86a3-4c12-98a8-ac04de9f4f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:55.998731 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b13cd-86a3-4c12-98a8-ac04de9f4f54 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:55.999004 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b13cd-86a3-4c12-98a8-ac04de9f4f54 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:55.999274 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b13cd-86a3-4c12-98a8-ac04de9f4f54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:56.000006 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b13cd-86a3-4c12-98a8-ac04de9f4f54 None admin] RBAC: Adding query filter params (role.id=ebe27ef209074cbb99d86cc8dde4c5d9, scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62, user.id=9dc9a3cf381e4a2da36ed82b407a2d94) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:37:56.000311 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b13cd-86a3-4c12-98a8-ac04de9f4f54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:56.001782 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b13cd-86a3-4c12-98a8-ac04de9f4f54 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:56.008510 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 555/1106] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:37:55 2022] GET /identity/v3/role_assignments?user.id=9dc9a3cf381e4a2da36ed82b407a2d94&scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62&role.id=ebe27ef209074cbb99d86cc8dde4c5d9 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:56.371283 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13c6fc-5533-448b-b500-a7163ec5577e None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:56.371815 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13c6fc-5533-448b-b500-a7163ec5577e None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:56.371815 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13c6fc-5533-448b-b500-a7163ec5577e None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:56.373230 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 552/1107] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:56.379289 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0d488-3323-45d1-a98b-edf442bfd5ba None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:56.379669 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0d488-3323-45d1-a98b-edf442bfd5ba None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:56.379984 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0d488-3323-45d1-a98b-edf442bfd5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:56.402429 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-d9a0d488-3323-45d1-a98b-edf442bfd5ba None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:56.403649 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-d9a0d488-3323-45d1-a98b-edf442bfd5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:56.483947 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 556/1108] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:56.758078 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13c6fc-5533-448b-b500-a7163ec5577e None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:56.796807 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:56.870918 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13c6fc-5533-448b-b500-a7163ec5577e None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:56.906849 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2197293-4f73-49cf-8f17-afa585256f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:56.907488 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2197293-4f73-49cf-8f17-afa585256f28 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:56.907767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2197293-4f73-49cf-8f17-afa585256f28 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:56.908037 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2197293-4f73-49cf-8f17-afa585256f28 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:56.909142 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2197293-4f73-49cf-8f17-afa585256f28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:56.910667 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2197293-4f73-49cf-8f17-afa585256f28 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:56.912283 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 553/1109] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:37:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:56.919923 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0d488-3323-45d1-a98b-edf442bfd5ba None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:56.924209 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:57.026127 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0d488-3323-45d1-a98b-edf442bfd5ba None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:57.066438 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d770c2-dcc2-4697-b9c0-e4f7333af9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:57.067130 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d770c2-dcc2-4697-b9c0-e4f7333af9c2 None admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:57.067410 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d770c2-dcc2-4697-b9c0-e4f7333af9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:57.067682 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d770c2-dcc2-4697-b9c0-e4f7333af9c2 None admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:57.068361 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d770c2-dcc2-4697-b9c0-e4f7333af9c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:57.069854 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d770c2-dcc2-4697-b9c0-e4f7333af9c2 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:57.096766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 557/1110] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 24 04:37:56 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:37:59.039371 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bfd58-c5d3-44bd-a66c-5fb376189fab None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:59.039984 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bfd58-c5d3-44bd-a66c-5fb376189fab None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:59.039984 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bfd58-c5d3-44bd-a66c-5fb376189fab None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:59.042106 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 554/1111] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:37:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:37:59.047780 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe30206-56c8-42c0-894b-f9a474803f29 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:59.048216 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe30206-56c8-42c0-894b-f9a474803f29 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:59.048306 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe30206-56c8-42c0-894b-f9a474803f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:59.068398 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-0fe30206-56c8-42c0-894b-f9a474803f29 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:37:59.069741 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-0fe30206-56c8-42c0-894b-f9a474803f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:37:59.133592 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:59.151843 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 558/1112] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:37:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:37:59.415986 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5bfd58-c5d3-44bd-a66c-5fb376189fab None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:59.540837 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5bfd58-c5d3-44bd-a66c-5fb376189fab None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:59.544203 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:37:59.583400 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee124fe2-2e35-4687-990a-e6c7506324e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:59.584044 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee124fe2-2e35-4687-990a-e6c7506324e6 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:59.584318 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee124fe2-2e35-4687-990a-e6c7506324e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:59.584586 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee124fe2-2e35-4687-990a-e6c7506324e6 None admin] PATH_INFO: `/v3/roles/3c2269f848184abd93ef97d02f6553e4` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:59.586202 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee124fe2-2e35-4687-990a-e6c7506324e6 None admin] RBAC: Authorizing `identity:get_role(role_id=3c2269f848184abd93ef97d02f6553e4)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:59.587582 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee124fe2-2e35-4687-990a-e6c7506324e6 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:59.588982 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 555/1113] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:37:59 2022] GET /identity/v3/roles/3c2269f848184abd93ef97d02f6553e4 => generated 223 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:59.595688 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe30206-56c8-42c0-894b-f9a474803f29 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:59.712550 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe30206-56c8-42c0-894b-f9a474803f29 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:59.752215 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53847541-5136-4360-aaa6-6a5f913fe966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:59.752873 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53847541-5136-4360-aaa6-6a5f913fe966 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:59.754028 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53847541-5136-4360-aaa6-6a5f913fe966 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:59.754028 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53847541-5136-4360-aaa6-6a5f913fe966 None admin] PATH_INFO: `/v3/users/ffe82b6e36c043e791d411cc326423f3` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:59.771170 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53847541-5136-4360-aaa6-6a5f913fe966 None admin] RBAC: Authorizing `identity:get_user(user_id=ffe82b6e36c043e791d411cc326423f3)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:37:59.772640 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53847541-5136-4360-aaa6-6a5f913fe966 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:37:59.774572 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 559/1114] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:37:59 2022] GET /identity/v3/users/ffe82b6e36c043e791d411cc326423f3 => generated 286 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:37:59.781595 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee124fe2-2e35-4687-990a-e6c7506324e6 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:37:59.893144 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee124fe2-2e35-4687-990a-e6c7506324e6 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:37:59.929468 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a42fb2-10ff-43cf-bb7b-85c4366dcff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:37:59.930081 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a42fb2-10ff-43cf-bb7b-85c4366dcff7 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:37:59.930398 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a42fb2-10ff-43cf-bb7b-85c4366dcff7 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:37:59.930704 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a42fb2-10ff-43cf-bb7b-85c4366dcff7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:37:59.978805 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:00.007985 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a42fb2-10ff-43cf-bb7b-85c4366dcff7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:00.009493 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a42fb2-10ff-43cf-bb7b-85c4366dcff7 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:00.131179 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 556/1115] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:37:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:38:00.137660 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53847541-5136-4360-aaa6-6a5f913fe966 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:00.204291 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:00.258212 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53847541-5136-4360-aaa6-6a5f913fe966 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:00.307509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b08a0-4b4c-49b0-b5c9-97d319af676a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:00.308169 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b08a0-4b4c-49b0-b5c9-97d319af676a None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:00.308443 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b08a0-4b4c-49b0-b5c9-97d319af676a None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:00.308715 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b08a0-4b4c-49b0-b5c9-97d319af676a None admin] PATH_INFO: `/v3/projects/30880bd43a8f4f50bd88590105ed5a3c` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:00.309930 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b08a0-4b4c-49b0-b5c9-97d319af676a None admin] RBAC: Authorizing `identity:get_project(project_id=30880bd43a8f4f50bd88590105ed5a3c)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:00.311421 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b08a0-4b4c-49b0-b5c9-97d319af676a None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:00.313142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 560/1116] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:38:00 2022] GET /identity/v3/projects/30880bd43a8f4f50bd88590105ed5a3c => generated 311 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:38:00.322688 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a42fb2-10ff-43cf-bb7b-85c4366dcff7 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:00.416352 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:00.448943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a42fb2-10ff-43cf-bb7b-85c4366dcff7 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:00.490041 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeac81e-7578-4f10-8747-f9800cef2610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:00.490903 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeac81e-7578-4f10-8747-f9800cef2610 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:00.491263 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeac81e-7578-4f10-8747-f9800cef2610 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:00.491628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeac81e-7578-4f10-8747-f9800cef2610 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:00.492776 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeac81e-7578-4f10-8747-f9800cef2610 None admin] RBAC: Adding query filter params (role.id=3c2269f848184abd93ef97d02f6553e4, scope.project.id=30880bd43a8f4f50bd88590105ed5a3c, user.id=ffe82b6e36c043e791d411cc326423f3) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:38:00.493176 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeac81e-7578-4f10-8747-f9800cef2610 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:00.495418 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeac81e-7578-4f10-8747-f9800cef2610 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:00.503812 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 557/1117] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:38:00 2022] GET /identity/v3/role_assignments?user.id=ffe82b6e36c043e791d411cc326423f3&scope.project.id=30880bd43a8f4f50bd88590105ed5a3c&role.id=3c2269f848184abd93ef97d02f6553e4 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:38:02.402819 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc5a05-d0d1-437f-866b-8da22a5c11a0 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:02.403447 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc5a05-d0d1-437f-866b-8da22a5c11a0 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:02.403447 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc5a05-d0d1-437f-866b-8da22a5c11a0 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:02.404714 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 561/1118] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:38:02.411898 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3308b69-a23e-4b37-83aa-687b47c3dd7e None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:02.412498 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3308b69-a23e-4b37-83aa-687b47c3dd7e None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:02.412873 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3308b69-a23e-4b37-83aa-687b47c3dd7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:02.443986 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-c3308b69-a23e-4b37-83aa-687b47c3dd7e None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:38:02.446137 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-c3308b69-a23e-4b37-83aa-687b47c3dd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:02.533671 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 558/1119] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:38:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:38:02.796031 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc5a05-d0d1-437f-866b-8da22a5c11a0 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:02.939094 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc5a05-d0d1-437f-866b-8da22a5c11a0 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:02.960096 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:02.985184 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516374e2-f9ab-4c7a-bc70-427d316c7de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:02.985867 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516374e2-f9ab-4c7a-bc70-427d316c7de9 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:02.986139 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516374e2-f9ab-4c7a-bc70-427d316c7de9 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:02.986415 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516374e2-f9ab-4c7a-bc70-427d316c7de9 None admin] PATH_INFO: `/v3/roles/3c2269f848184abd93ef97d02f6553e4` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:02.987890 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516374e2-f9ab-4c7a-bc70-427d316c7de9 None admin] RBAC: Authorizing `identity:get_role(role_id=3c2269f848184abd93ef97d02f6553e4)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:02.989322 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516374e2-f9ab-4c7a-bc70-427d316c7de9 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:02.990758 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 562/1120] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:38:02 2022] GET /identity/v3/roles/3c2269f848184abd93ef97d02f6553e4 => generated 223 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:38:03.000153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3308b69-a23e-4b37-83aa-687b47c3dd7e None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:03.074097 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:03.116919 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3308b69-a23e-4b37-83aa-687b47c3dd7e None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:03.156815 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2862eff-57ad-4357-aebc-b0325d298f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:03.157514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2862eff-57ad-4357-aebc-b0325d298f03 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:03.157796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2862eff-57ad-4357-aebc-b0325d298f03 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:03.158067 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2862eff-57ad-4357-aebc-b0325d298f03 None admin] PATH_INFO: `/v3/users/ffe82b6e36c043e791d411cc326423f3` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:03.159217 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2862eff-57ad-4357-aebc-b0325d298f03 None admin] RBAC: Authorizing `identity:get_user(user_id=ffe82b6e36c043e791d411cc326423f3)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:03.160691 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2862eff-57ad-4357-aebc-b0325d298f03 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:03.162436 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 559/1121] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:38:02 2022] GET /identity/v3/users/ffe82b6e36c043e791d411cc326423f3 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:38:03.168916 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516374e2-f9ab-4c7a-bc70-427d316c7de9 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:03.286362 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516374e2-f9ab-4c7a-bc70-427d316c7de9 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:03.323594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ae586-e053-4877-9658-365a7d3d2737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:03.324333 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ae586-e053-4877-9658-365a7d3d2737 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:03.324529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ae586-e053-4877-9658-365a7d3d2737 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:03.324799 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ae586-e053-4877-9658-365a7d3d2737 None admin] PATH_INFO: `/v3/projects/30880bd43a8f4f50bd88590105ed5a3c` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:03.325966 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ae586-e053-4877-9658-365a7d3d2737 None admin] RBAC: Authorizing `identity:get_project(project_id=30880bd43a8f4f50bd88590105ed5a3c)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:03.327604 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ae586-e053-4877-9658-365a7d3d2737 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:03.329305 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 563/1122] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:38:03 2022] GET /identity/v3/projects/30880bd43a8f4f50bd88590105ed5a3c => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:38:03.336220 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2862eff-57ad-4357-aebc-b0325d298f03 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:03.445114 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2862eff-57ad-4357-aebc-b0325d298f03 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:03.483668 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ffb73-d471-40fe-bb70-657c5ca798f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:03.484340 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ffb73-d471-40fe-bb70-657c5ca798f8 None admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:03.484629 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ffb73-d471-40fe-bb70-657c5ca798f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:03.484903 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ffb73-d471-40fe-bb70-657c5ca798f8 None admin] PATH_INFO: `/v3/projects/30880bd43a8f4f50bd88590105ed5a3c/users/ffe82b6e36c043e791d411cc326423f3/roles/3c2269f848184abd93ef97d02f6553e4` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:03.487133 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ffb73-d471-40fe-bb70-657c5ca798f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=30880bd43a8f4f50bd88590105ed5a3c, user_id=ffe82b6e36c043e791d411cc326423f3, role_id=3c2269f848184abd93ef97d02f6553e4)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:03.488591 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ffb73-d471-40fe-bb70-657c5ca798f8 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:03.491060 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:03.504487 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 560/1123] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 24 04:38:03 2022] PUT /identity/v3/projects/30880bd43a8f4f50bd88590105ed5a3c/users/ffe82b6e36c043e791d411cc326423f3/roles/3c2269f848184abd93ef97d02f6553e4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:38:05.438247 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d9838-ef0d-415e-875a-a7c2a1afa1fb None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:05.438791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d9838-ef0d-415e-875a-a7c2a1afa1fb None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:05.438791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d9838-ef0d-415e-875a-a7c2a1afa1fb None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:05.440137 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 564/1124] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:38:05.446621 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58180630-807d-479a-80c9-1352a51fa774 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:05.447373 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58180630-807d-479a-80c9-1352a51fa774 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:05.447735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58180630-807d-479a-80c9-1352a51fa774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:05.478559 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-58180630-807d-479a-80c9-1352a51fa774 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:38:05.479811 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-58180630-807d-479a-80c9-1352a51fa774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:05.555044 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 561/1125] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:38:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:38:05.825854 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d9838-ef0d-415e-875a-a7c2a1afa1fb None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:05.892268 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:05.961210 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d9838-ef0d-415e-875a-a7c2a1afa1fb None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:05.999630 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4223920-4cd7-4ce6-83a2-02133003650a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:06.000259 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4223920-4cd7-4ce6-83a2-02133003650a None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:06.000535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4223920-4cd7-4ce6-83a2-02133003650a None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:06.000803 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4223920-4cd7-4ce6-83a2-02133003650a None admin] PATH_INFO: `/v3/roles/3c2269f848184abd93ef97d02f6553e4` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:06.002275 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4223920-4cd7-4ce6-83a2-02133003650a None admin] RBAC: Authorizing `identity:get_role(role_id=3c2269f848184abd93ef97d02f6553e4)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:06.003661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4223920-4cd7-4ce6-83a2-02133003650a None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:06.005009 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 565/1126] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:38:05 2022] GET /identity/v3/roles/3c2269f848184abd93ef97d02f6553e4 => generated 223 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:38:06.011154 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58180630-807d-479a-80c9-1352a51fa774 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:06.118715 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58180630-807d-479a-80c9-1352a51fa774 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:06.144725 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:06.157460 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60ed75-da56-40c7-b5e9-e3d56194e132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:06.158103 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60ed75-da56-40c7-b5e9-e3d56194e132 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:06.158378 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60ed75-da56-40c7-b5e9-e3d56194e132 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:06.158648 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60ed75-da56-40c7-b5e9-e3d56194e132 None admin] PATH_INFO: `/v3/users/ffe82b6e36c043e791d411cc326423f3` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:06.159843 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60ed75-da56-40c7-b5e9-e3d56194e132 None admin] RBAC: Authorizing `identity:get_user(user_id=ffe82b6e36c043e791d411cc326423f3)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:06.161281 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad60ed75-da56-40c7-b5e9-e3d56194e132 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:06.162999 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 562/1127] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:38:06 2022] GET /identity/v3/users/ffe82b6e36c043e791d411cc326423f3 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:38:06.169256 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4223920-4cd7-4ce6-83a2-02133003650a None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:06.283706 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4223920-4cd7-4ce6-83a2-02133003650a None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:06.305504 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:06.321479 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d06e56-591c-4c08-b94f-adb35046db16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:06.322166 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d06e56-591c-4c08-b94f-adb35046db16 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:06.322446 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d06e56-591c-4c08-b94f-adb35046db16 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:06.322715 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d06e56-591c-4c08-b94f-adb35046db16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:06.395232 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d06e56-591c-4c08-b94f-adb35046db16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:06.396616 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d06e56-591c-4c08-b94f-adb35046db16 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:06.502500 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 566/1128] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:38:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:38:06.509010 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60ed75-da56-40c7-b5e9-e3d56194e132 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:06.629090 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad60ed75-da56-40c7-b5e9-e3d56194e132 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:06.675909 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa163e5-c4e9-48f5-a793-3447bef990f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:06.676498 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa163e5-c4e9-48f5-a793-3447bef990f7 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:06.676773 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa163e5-c4e9-48f5-a793-3447bef990f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:06.677042 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa163e5-c4e9-48f5-a793-3447bef990f7 None admin] PATH_INFO: `/v3/projects/30880bd43a8f4f50bd88590105ed5a3c` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:06.678295 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa163e5-c4e9-48f5-a793-3447bef990f7 None admin] RBAC: Authorizing `identity:get_project(project_id=30880bd43a8f4f50bd88590105ed5a3c)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:06.679762 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa163e5-c4e9-48f5-a793-3447bef990f7 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:06.681572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 563/1129] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:38:06 2022] GET /identity/v3/projects/30880bd43a8f4f50bd88590105ed5a3c => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:38:06.688444 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d06e56-591c-4c08-b94f-adb35046db16 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:06.714297 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:06.800136 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d06e56-591c-4c08-b94f-adb35046db16 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:06.838491 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5402007-1101-4511-8eff-f5e91d4a8403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:06.839083 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5402007-1101-4511-8eff-f5e91d4a8403 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:06.839359 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5402007-1101-4511-8eff-f5e91d4a8403 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:06.839621 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5402007-1101-4511-8eff-f5e91d4a8403 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:06.840348 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5402007-1101-4511-8eff-f5e91d4a8403 None admin] RBAC: Adding query filter params (role.id=3c2269f848184abd93ef97d02f6553e4, scope.project.id=30880bd43a8f4f50bd88590105ed5a3c, user.id=ffe82b6e36c043e791d411cc326423f3) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:38:06.840647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5402007-1101-4511-8eff-f5e91d4a8403 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:06.842106 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5402007-1101-4511-8eff-f5e91d4a8403 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:06.848219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 567/1130] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:38:06 2022] GET /identity/v3/role_assignments?user.id=ffe82b6e36c043e791d411cc326423f3&scope.project.id=30880bd43a8f4f50bd88590105ed5a3c&role.id=3c2269f848184abd93ef97d02f6553e4 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:38:08.799146 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d549f5-70b5-4d2e-9ee1-32cef1c170b8 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:08.799706 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d549f5-70b5-4d2e-9ee1-32cef1c170b8 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:08.799706 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d549f5-70b5-4d2e-9ee1-32cef1c170b8 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:08.801731 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 564/1131] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:38:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:38:08.807401 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4ee06-890d-45bd-b1f5-20d37e689189 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:08.807839 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4ee06-890d-45bd-b1f5-20d37e689189 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:08.807933 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4ee06-890d-45bd-b1f5-20d37e689189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:08.827611 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-51d4ee06-890d-45bd-b1f5-20d37e689189 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:38:08.828875 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-51d4ee06-890d-45bd-b1f5-20d37e689189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:08.903616 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 568/1132] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:38:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:38:09.188381 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d549f5-70b5-4d2e-9ee1-32cef1c170b8 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:09.258772 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:09.303240 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d549f5-70b5-4d2e-9ee1-32cef1c170b8 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:09.340488 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e18fe-ca05-4c45-8fff-31d1141acbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:09.341269 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e18fe-ca05-4c45-8fff-31d1141acbd8 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:09.341662 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e18fe-ca05-4c45-8fff-31d1141acbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:09.342074 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e18fe-ca05-4c45-8fff-31d1141acbd8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:09.343473 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e18fe-ca05-4c45-8fff-31d1141acbd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:09.345032 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e18fe-ca05-4c45-8fff-31d1141acbd8 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:09.346689 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 565/1133] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:38:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:38:09.354305 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4ee06-890d-45bd-b1f5-20d37e689189 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:09.371286 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:09.459219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4ee06-890d-45bd-b1f5-20d37e689189 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:09.500808 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e2737-9d4d-4d9c-a9a1-460847b7e310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:09.501626 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e2737-9d4d-4d9c-a9a1-460847b7e310 None admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:09.501910 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e2737-9d4d-4d9c-a9a1-460847b7e310 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:09.502188 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e2737-9d4d-4d9c-a9a1-460847b7e310 None admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:09.502862 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e2737-9d4d-4d9c-a9a1-460847b7e310 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:09.504328 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e2737-9d4d-4d9c-a9a1-460847b7e310 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:09.544766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 569/1134] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 24 04:38:09 2022] POST /identity/v3/projects => generated 311 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:38:11.448140 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e0e2c-4275-404b-8a0f-677c7948206d None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:11.448967 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e0e2c-4275-404b-8a0f-677c7948206d None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:11.448967 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e0e2c-4275-404b-8a0f-677c7948206d None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:11.451141 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 566/1135] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:38:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:38:11.459264 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d04fd-e438-4056-b890-889dc70277b9 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:11.459739 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d04fd-e438-4056-b890-889dc70277b9 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:11.459838 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d04fd-e438-4056-b890-889dc70277b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:11.480552 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-4e6d04fd-e438-4056-b890-889dc70277b9 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:38:11.481769 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-4e6d04fd-e438-4056-b890-889dc70277b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:11.547365 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:11.556534 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 570/1136] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:38:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:38:11.818639 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e0e2c-4275-404b-8a0f-677c7948206d None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:11.933257 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e0e2c-4275-404b-8a0f-677c7948206d None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:11.966104 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:11.975661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2726ae-49c8-45bc-8ffc-7c9bc6615333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:11.976302 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2726ae-49c8-45bc-8ffc-7c9bc6615333 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:11.976582 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2726ae-49c8-45bc-8ffc-7c9bc6615333 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:11.976855 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2726ae-49c8-45bc-8ffc-7c9bc6615333 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:11.978413 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2726ae-49c8-45bc-8ffc-7c9bc6615333 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:11.979863 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2726ae-49c8-45bc-8ffc-7c9bc6615333 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:11.981503 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 567/1137] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:38:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:38:11.990883 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d04fd-e438-4056-b890-889dc70277b9 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:12.115433 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d04fd-e438-4056-b890-889dc70277b9 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:12.150856 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472c52b-cb32-4dfa-9e16-7d5865b4919f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:12.151472 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472c52b-cb32-4dfa-9e16-7d5865b4919f None admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:12.151749 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472c52b-cb32-4dfa-9e16-7d5865b4919f None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:12.152021 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472c52b-cb32-4dfa-9e16-7d5865b4919f None admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:12.152662 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472c52b-cb32-4dfa-9e16-7d5865b4919f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:12.154135 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472c52b-cb32-4dfa-9e16-7d5865b4919f None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:12.180089 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 571/1138] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 24 04:38:11 2022] POST /identity/v3/users => generated 286 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:38:14.096935 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717701bf-9983-4acb-89df-32e33f0ff56d None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:14.097898 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717701bf-9983-4acb-89df-32e33f0ff56d None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:14.097898 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717701bf-9983-4acb-89df-32e33f0ff56d None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:14.100210 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 568/1139] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:38:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:38:14.106934 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad1140-745e-46af-a2dc-d358b9168b20 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:14.107379 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad1140-745e-46af-a2dc-d358b9168b20 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:14.107515 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad1140-745e-46af-a2dc-d358b9168b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:14.130740 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-2aad1140-745e-46af-a2dc-d358b9168b20 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:38:14.131938 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-2aad1140-745e-46af-a2dc-d358b9168b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:14.184943 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:14.219201 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 572/1140] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:38:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:38:14.485471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717701bf-9983-4acb-89df-32e33f0ff56d None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:14.608861 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717701bf-9983-4acb-89df-32e33f0ff56d None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:14.644713 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffef01-d947-4e26-b0fc-b18da85a43ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:14.645377 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffef01-d947-4e26-b0fc-b18da85a43ab None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:14.645648 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffef01-d947-4e26-b0fc-b18da85a43ab None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:14.645918 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffef01-d947-4e26-b0fc-b18da85a43ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:14.656720 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ffef01-d947-4e26-b0fc-b18da85a43ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:38:14.661382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-23ffef01-d947-4e26-b0fc-b18da85a43ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:38:14.661382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:38:14.661382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:38:14.661382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:38:14.661382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:38:14.661382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:38:14.661382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:38:14.661382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:38:14.661382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:38:14.661382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:38:14.661382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:38:14.661382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:38:14.661382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:38:14.661382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:38:14.661382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:38:14.661382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:38:14.662525 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:38:14.662525 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:38:14.662525 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:38:14.662525 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:38:14.662525 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:38:14.662525 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:38:14.662525 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:38:14.662525 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:38:14.662525 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:38:14.662525 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:38:14.662525 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:38:14.662525 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:38:14.662525 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:38:14.662525 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:38:14.662525 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:38:14.662525 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:38:14.663416 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:38:14.663416 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:38:14.663416 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:38:14.663416 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:38:14.663416 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:38:14.663416 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:38:14.663416 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:38:14.663416 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:38:14.663416 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:38:14.663416 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:38:14.663416 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:38:14.663416 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:38:14.663416 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 569/1141] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 24 04:38:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:38:14.669313 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad1140-745e-46af-a2dc-d358b9168b20 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:14.772194 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad1140-745e-46af-a2dc-d358b9168b20 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:14.806345 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89c44d-0968-40e7-b3ee-f03d35a8eac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:14.806938 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89c44d-0968-40e7-b3ee-f03d35a8eac1 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:14.807210 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89c44d-0968-40e7-b3ee-f03d35a8eac1 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:14.807473 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89c44d-0968-40e7-b3ee-f03d35a8eac1 None admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:14.808129 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de89c44d-0968-40e7-b3ee-f03d35a8eac1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:38:14.808425 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de89c44d-0968-40e7-b3ee-f03d35a8eac1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:14.809895 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de89c44d-0968-40e7-b3ee-f03d35a8eac1 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:14.817869 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 573/1142] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:38:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:38:14.827328 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffef01-d947-4e26-b0fc-b18da85a43ab None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:14.898622 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:14.945890 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffef01-d947-4e26-b0fc-b18da85a43ab None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:14.980962 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34485314-7dea-4d1c-8528-91aa2e0b3515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:14.981614 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34485314-7dea-4d1c-8528-91aa2e0b3515 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:14.981889 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34485314-7dea-4d1c-8528-91aa2e0b3515 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:14.982156 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34485314-7dea-4d1c-8528-91aa2e0b3515 None admin] PATH_INFO: `/v3/users/6f9d77ba3fea4a96b798e3d3f059dcac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:14.996478 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34485314-7dea-4d1c-8528-91aa2e0b3515 None admin] RBAC: Authorizing `identity:get_user(user_id=6f9d77ba3fea4a96b798e3d3f059dcac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:14.997968 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34485314-7dea-4d1c-8528-91aa2e0b3515 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:14.999608 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 570/1143] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:38:14 2022] GET /identity/v3/users/6f9d77ba3fea4a96b798e3d3f059dcac => generated 286 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:38:15.006492 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89c44d-0968-40e7-b3ee-f03d35a8eac1 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:15.062888 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:15.124817 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89c44d-0968-40e7-b3ee-f03d35a8eac1 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:15.161431 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8af32-cd21-4c1c-9b7a-a665f5810041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:15.162020 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8af32-cd21-4c1c-9b7a-a665f5810041 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:15.162292 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8af32-cd21-4c1c-9b7a-a665f5810041 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:15.162558 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8af32-cd21-4c1c-9b7a-a665f5810041 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:15.235212 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8af32-cd21-4c1c-9b7a-a665f5810041 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:15.236886 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8af32-cd21-4c1c-9b7a-a665f5810041 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:15.281398 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:15.344870 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 574/1144] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:38:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:38:15.355192 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34485314-7dea-4d1c-8528-91aa2e0b3515 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:15.464691 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34485314-7dea-4d1c-8528-91aa2e0b3515 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:15.480489 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:15.504896 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b3b7c-9d25-450b-bc0c-ebbd97c166a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:15.505984 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b3b7c-9d25-450b-bc0c-ebbd97c166a9 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:15.506447 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b3b7c-9d25-450b-bc0c-ebbd97c166a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:15.506894 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b3b7c-9d25-450b-bc0c-ebbd97c166a9 None admin] PATH_INFO: `/v3/projects/b85fbac924414a35811ff7c6a747c57d` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:15.508764 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b3b7c-9d25-450b-bc0c-ebbd97c166a9 None admin] RBAC: Authorizing `identity:get_project(project_id=b85fbac924414a35811ff7c6a747c57d)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:15.511203 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b3b7c-9d25-450b-bc0c-ebbd97c166a9 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:15.514052 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 571/1145] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:38:15 2022] GET /identity/v3/projects/b85fbac924414a35811ff7c6a747c57d => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:38:15.524006 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8af32-cd21-4c1c-9b7a-a665f5810041 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:15.629978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8af32-cd21-4c1c-9b7a-a665f5810041 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:15.667017 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21206693-df9c-4d45-9731-02dd079ff95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:15.667626 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21206693-df9c-4d45-9731-02dd079ff95b None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:15.667902 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21206693-df9c-4d45-9731-02dd079ff95b None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:15.668167 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21206693-df9c-4d45-9731-02dd079ff95b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:15.668940 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21206693-df9c-4d45-9731-02dd079ff95b None admin] RBAC: Adding query filter params (role.id=74ce7b72bcc94a8a8ad65c3db928e6ac, scope.project.id=b85fbac924414a35811ff7c6a747c57d, user.id=6f9d77ba3fea4a96b798e3d3f059dcac) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:38:15.669247 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21206693-df9c-4d45-9731-02dd079ff95b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:15.670719 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21206693-df9c-4d45-9731-02dd079ff95b None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:15.676818 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 575/1146] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:38:15 2022] GET /identity/v3/role_assignments?user.id=6f9d77ba3fea4a96b798e3d3f059dcac&scope.project.id=b85fbac924414a35811ff7c6a747c57d&role.id=74ce7b72bcc94a8a8ad65c3db928e6ac => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:38:17.549914 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94450cb-34bf-478b-bb8e-854a74b8a2cd None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:17.550573 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94450cb-34bf-478b-bb8e-854a74b8a2cd None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:17.550573 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94450cb-34bf-478b-bb8e-854a74b8a2cd None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:17.552453 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 572/1147] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:38:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:38:17.558290 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17363365-14f3-4d33-a292-ca300b58be17 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:17.558752 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17363365-14f3-4d33-a292-ca300b58be17 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:17.558852 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17363365-14f3-4d33-a292-ca300b58be17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:17.578718 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-17363365-14f3-4d33-a292-ca300b58be17 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:38:17.579945 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-17363365-14f3-4d33-a292-ca300b58be17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:17.581939 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:17.658632 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 576/1148] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:38:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:38:17.931171 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94450cb-34bf-478b-bb8e-854a74b8a2cd None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:18.046729 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94450cb-34bf-478b-bb8e-854a74b8a2cd None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:18.083018 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60d213-56f3-4dcf-9368-03f460ac5f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:18.083635 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60d213-56f3-4dcf-9368-03f460ac5f64 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:18.083910 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60d213-56f3-4dcf-9368-03f460ac5f64 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:18.084181 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e60d213-56f3-4dcf-9368-03f460ac5f64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:18.094602 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e60d213-56f3-4dcf-9368-03f460ac5f64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:38:18.099249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-7e60d213-56f3-4dcf-9368-03f460ac5f64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:38:18.099249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:38:18.099249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:38:18.099249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:38:18.099249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:38:18.099249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:38:18.099249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:38:18.099249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:38:18.099249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:38:18.099249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:38:18.099249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:38:18.099249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:38:18.099249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:38:18.099249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:38:18.099249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:38:18.099249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:38:18.100310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:38:18.100310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:38:18.100310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:38:18.100310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:38:18.100310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:38:18.100310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:38:18.100310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:38:18.100310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:38:18.100310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:38:18.100310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:38:18.100310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:38:18.100310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:38:18.100310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:38:18.100310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:38:18.100310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:38:18.100310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:38:18.101203 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:38:18.101203 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:38:18.101203 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:38:18.101203 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:38:18.101203 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:38:18.101203 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:38:18.101203 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:38:18.101203 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:38:18.101203 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:38:18.101203 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:38:18.101203 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:38:18.101203 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:38:18.101203 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 573/1149] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 24 04:38:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:38:18.107178 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17363365-14f3-4d33-a292-ca300b58be17 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:18.215435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17363365-14f3-4d33-a292-ca300b58be17 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:18.255613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ce8a2-4863-4d83-b38c-c4b49cf520b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:18.256224 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ce8a2-4863-4d83-b38c-c4b49cf520b0 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:18.256499 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ce8a2-4863-4d83-b38c-c4b49cf520b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:18.256769 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ce8a2-4863-4d83-b38c-c4b49cf520b0 None admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:18.257468 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8ce8a2-4863-4d83-b38c-c4b49cf520b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:38:18.257769 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8ce8a2-4863-4d83-b38c-c4b49cf520b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:18.259381 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8ce8a2-4863-4d83-b38c-c4b49cf520b0 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:18.265680 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:18.269795 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 577/1150] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:38:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:38:18.280393 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60d213-56f3-4dcf-9368-03f460ac5f64 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:18.335091 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:18.393614 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e60d213-56f3-4dcf-9368-03f460ac5f64 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:18.430503 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c22f09-6f70-43d9-a16f-cdb082de312c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:18.431125 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c22f09-6f70-43d9-a16f-cdb082de312c None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:18.431407 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c22f09-6f70-43d9-a16f-cdb082de312c None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:18.431676 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c22f09-6f70-43d9-a16f-cdb082de312c None admin] PATH_INFO: `/v3/users/6f9d77ba3fea4a96b798e3d3f059dcac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:18.432926 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c22f09-6f70-43d9-a16f-cdb082de312c None admin] RBAC: Authorizing `identity:get_user(user_id=6f9d77ba3fea4a96b798e3d3f059dcac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:18.434482 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c22f09-6f70-43d9-a16f-cdb082de312c None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:18.436115 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 574/1151] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:38:18 2022] GET /identity/v3/users/6f9d77ba3fea4a96b798e3d3f059dcac => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:38:18.445624 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ce8a2-4863-4d83-b38c-c4b49cf520b0 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:18.554299 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ce8a2-4863-4d83-b38c-c4b49cf520b0 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:18.595191 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7861f63-e5af-485c-bb5c-4c1d73bb9815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:18.595898 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7861f63-e5af-485c-bb5c-4c1d73bb9815 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:18.596107 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7861f63-e5af-485c-bb5c-4c1d73bb9815 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:18.596379 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7861f63-e5af-485c-bb5c-4c1d73bb9815 None admin] PATH_INFO: `/v3/projects/b85fbac924414a35811ff7c6a747c57d` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:18.597692 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7861f63-e5af-485c-bb5c-4c1d73bb9815 None admin] RBAC: Authorizing `identity:get_project(project_id=b85fbac924414a35811ff7c6a747c57d)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:18.599152 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7861f63-e5af-485c-bb5c-4c1d73bb9815 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:18.600846 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 578/1152] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:38:18 2022] GET /identity/v3/projects/b85fbac924414a35811ff7c6a747c57d => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:38:18.607907 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c22f09-6f70-43d9-a16f-cdb082de312c None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:18.717587 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c22f09-6f70-43d9-a16f-cdb082de312c None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:18.729325 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:18.756975 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853ad3a-c9f5-4258-82ee-529a6010367e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:18.757678 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853ad3a-c9f5-4258-82ee-529a6010367e None admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:18.757957 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853ad3a-c9f5-4258-82ee-529a6010367e None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:18.758226 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853ad3a-c9f5-4258-82ee-529a6010367e None admin] PATH_INFO: `/v3/projects/b85fbac924414a35811ff7c6a747c57d/users/6f9d77ba3fea4a96b798e3d3f059dcac/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:18.760425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c853ad3a-c9f5-4258-82ee-529a6010367e None admin] RBAC: Authorizing `identity:create_grant(project_id=b85fbac924414a35811ff7c6a747c57d, user_id=6f9d77ba3fea4a96b798e3d3f059dcac, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:18.761956 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c853ad3a-c9f5-4258-82ee-529a6010367e None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:18.778588 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 575/1153] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 24 04:38:18 2022] PUT /identity/v3/projects/b85fbac924414a35811ff7c6a747c57d/users/6f9d77ba3fea4a96b798e3d3f059dcac/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:38:20.612222 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094b1e2-4767-4f86-baa0-6c5b54535720 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:20.613108 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094b1e2-4767-4f86-baa0-6c5b54535720 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:20.613108 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094b1e2-4767-4f86-baa0-6c5b54535720 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:20.615345 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 579/1154] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:38:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:38:20.621898 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc037fd-4d37-4744-9769-ae8c268c7bfe None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:20.622764 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc037fd-4d37-4744-9769-ae8c268c7bfe None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:20.622764 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc037fd-4d37-4744-9769-ae8c268c7bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:20.647799 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-8dc037fd-4d37-4744-9769-ae8c268c7bfe None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:38:20.649020 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-8dc037fd-4d37-4744-9769-ae8c268c7bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:20.721816 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 576/1155] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:38:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:38:20.984486 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094b1e2-4767-4f86-baa0-6c5b54535720 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:21.065700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:21.102334 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094b1e2-4767-4f86-baa0-6c5b54535720 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:21.139347 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8172621-8c08-458b-b31b-ff8947188909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:21.140000 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8172621-8c08-458b-b31b-ff8947188909 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:21.140282 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8172621-8c08-458b-b31b-ff8947188909 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:21.140552 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8172621-8c08-458b-b31b-ff8947188909 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:21.152390 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8172621-8c08-458b-b31b-ff8947188909 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:38:21.157142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-c8172621-8c08-458b-b31b-ff8947188909 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:38:21.157142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:38:21.157142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:38:21.157142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:38:21.157142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:38:21.157142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:38:21.157142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:38:21.157142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:38:21.157142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:38:21.157142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:38:21.157142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:38:21.157142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:38:21.157142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:38:21.157142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:38:21.157142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:38:21.157142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:38:21.158245 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:38:21.158245 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:38:21.158245 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:38:21.158245 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:38:21.158245 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:38:21.158245 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:38:21.158245 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:38:21.158245 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:38:21.158245 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:38:21.158245 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:38:21.158245 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:38:21.158245 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:38:21.158245 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:38:21.158245 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:38:21.158245 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:38:21.158245 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:38:21.162440 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:38:21.162440 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:38:21.162440 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:38:21.162440 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:38:21.162440 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:38:21.162440 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:38:21.162440 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:38:21.162440 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:38:21.162440 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:38:21.162440 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:38:21.162440 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:38:21.162440 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:38:21.162440 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 580/1156] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 24 04:38:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:38:21.164399 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc037fd-4d37-4744-9769-ae8c268c7bfe None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:21.273490 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:21.277048 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc037fd-4d37-4744-9769-ae8c268c7bfe None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:21.318817 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d4afa-7c2f-4a4a-a618-3b3c595f2058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:21.319421 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d4afa-7c2f-4a4a-a618-3b3c595f2058 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:21.319695 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d4afa-7c2f-4a4a-a618-3b3c595f2058 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:21.319960 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d4afa-7c2f-4a4a-a618-3b3c595f2058 None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:21.320623 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d4afa-7c2f-4a4a-a618-3b3c595f2058 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:38:21.320916 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d4afa-7c2f-4a4a-a618-3b3c595f2058 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:21.322324 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d4afa-7c2f-4a4a-a618-3b3c595f2058 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:21.330994 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 577/1157] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:38:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:38:21.337146 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8172621-8c08-458b-b31b-ff8947188909 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:21.448426 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8172621-8c08-458b-b31b-ff8947188909 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:21.475224 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:21.495267 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c3550-6ccb-4c28-bc1a-493af1ce95e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:21.496237 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c3550-6ccb-4c28-bc1a-493af1ce95e6 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:21.496665 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c3550-6ccb-4c28-bc1a-493af1ce95e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:21.497082 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736c3550-6ccb-4c28-bc1a-493af1ce95e6 None admin] PATH_INFO: `/v3/users/6f9d77ba3fea4a96b798e3d3f059dcac` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:21.498656 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c3550-6ccb-4c28-bc1a-493af1ce95e6 None admin] RBAC: Authorizing `identity:get_user(user_id=6f9d77ba3fea4a96b798e3d3f059dcac)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:21.500131 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736c3550-6ccb-4c28-bc1a-493af1ce95e6 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:21.501833 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 581/1158] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:38:21 2022] GET /identity/v3/users/6f9d77ba3fea4a96b798e3d3f059dcac => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:38:21.508432 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d4afa-7c2f-4a4a-a618-3b3c595f2058 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:21.625710 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d4afa-7c2f-4a4a-a618-3b3c595f2058 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:21.666085 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35fdae-9cb8-4f3a-b46b-e20b3677620e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:21.666700 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35fdae-9cb8-4f3a-b46b-e20b3677620e None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:21.666972 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35fdae-9cb8-4f3a-b46b-e20b3677620e None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:21.667232 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35fdae-9cb8-4f3a-b46b-e20b3677620e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:21.707041 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:21.755193 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35fdae-9cb8-4f3a-b46b-e20b3677620e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:21.756695 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35fdae-9cb8-4f3a-b46b-e20b3677620e None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:21.869427 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 578/1159] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:38:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:38:21.879369 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c3550-6ccb-4c28-bc1a-493af1ce95e6 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:21.995586 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736c3550-6ccb-4c28-bc1a-493af1ce95e6 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:22.040480 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b5b18-1cbe-41eb-8d11-64f9ca0ea505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:22.041122 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b5b18-1cbe-41eb-8d11-64f9ca0ea505 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:22.041402 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b5b18-1cbe-41eb-8d11-64f9ca0ea505 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:22.041705 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b5b18-1cbe-41eb-8d11-64f9ca0ea505 None admin] PATH_INFO: `/v3/projects/b85fbac924414a35811ff7c6a747c57d` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:22.042906 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b5b18-1cbe-41eb-8d11-64f9ca0ea505 None admin] RBAC: Authorizing `identity:get_project(project_id=b85fbac924414a35811ff7c6a747c57d)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:22.044481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b5b18-1cbe-41eb-8d11-64f9ca0ea505 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:22.046214 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 582/1160] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:38:21 2022] GET /identity/v3/projects/b85fbac924414a35811ff7c6a747c57d => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:38:22.056018 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35fdae-9cb8-4f3a-b46b-e20b3677620e None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:22.127774 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:22.169793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35fdae-9cb8-4f3a-b46b-e20b3677620e None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:22.210246 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47258c-ad7f-4ad7-b50b-7e41860c5cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:22.210885 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47258c-ad7f-4ad7-b50b-7e41860c5cc7 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:22.211163 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47258c-ad7f-4ad7-b50b-7e41860c5cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:22.211435 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47258c-ad7f-4ad7-b50b-7e41860c5cc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:22.212164 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f47258c-ad7f-4ad7-b50b-7e41860c5cc7 None admin] RBAC: Adding query filter params (role.id=74ce7b72bcc94a8a8ad65c3db928e6ac, scope.project.id=b85fbac924414a35811ff7c6a747c57d, user.id=6f9d77ba3fea4a96b798e3d3f059dcac) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:38:22.212472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f47258c-ad7f-4ad7-b50b-7e41860c5cc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:22.213968 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f47258c-ad7f-4ad7-b50b-7e41860c5cc7 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:22.221314 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 579/1161] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:38:22 2022] GET /identity/v3/role_assignments?user.id=6f9d77ba3fea4a96b798e3d3f059dcac&scope.project.id=b85fbac924414a35811ff7c6a747c57d&role.id=74ce7b72bcc94a8a8ad65c3db928e6ac => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:38:24.142319 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdea50-438b-47e7-afaf-c11d338f102f None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:24.143202 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdea50-438b-47e7-afaf-c11d338f102f None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:24.143202 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdea50-438b-47e7-afaf-c11d338f102f None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:24.145115 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 583/1162] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:38:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:38:24.153255 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b224a46-ad40-4196-bc11-df7e295eede6 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:24.153845 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b224a46-ad40-4196-bc11-df7e295eede6 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:24.153845 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b224a46-ad40-4196-bc11-df7e295eede6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:24.178596 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-3b224a46-ad40-4196-bc11-df7e295eede6 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:38:24.179815 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-3b224a46-ad40-4196-bc11-df7e295eede6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:24.259580 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 580/1163] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:38:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:38:24.525908 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbdea50-438b-47e7-afaf-c11d338f102f None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:24.606376 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:24.651130 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbdea50-438b-47e7-afaf-c11d338f102f None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:24.685887 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659906d-02db-4748-afb3-c84f7c2a2688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:24.686496 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659906d-02db-4748-afb3-c84f7c2a2688 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:24.686777 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659906d-02db-4748-afb3-c84f7c2a2688 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:24.687051 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2659906d-02db-4748-afb3-c84f7c2a2688 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:24.756732 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659906d-02db-4748-afb3-c84f7c2a2688 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:24.758230 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2659906d-02db-4748-afb3-c84f7c2a2688 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:24.821464 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:24.865356 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 584/1164] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:38:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:38:24.873214 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b224a46-ad40-4196-bc11-df7e295eede6 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:24.940880 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:24.987253 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b224a46-ad40-4196-bc11-df7e295eede6 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:25.023225 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9bd32-fc43-41bf-99e1-634f5fd4318a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:25.023868 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9bd32-fc43-41bf-99e1-634f5fd4318a None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:25.024143 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9bd32-fc43-41bf-99e1-634f5fd4318a None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:25.024415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9bd32-fc43-41bf-99e1-634f5fd4318a None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:25.034754 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c9bd32-fc43-41bf-99e1-634f5fd4318a None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:25.036834 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c9bd32-fc43-41bf-99e1-634f5fd4318a None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:25.052310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-44c9bd32-fc43-41bf-99e1-634f5fd4318a None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 04:38:25.052310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:38:25.052310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 24 04:38:25.052310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 24 04:38:25.052310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:38:25.052310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:38:25.052310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:38:25.052310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:38:25.052310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 24 04:38:25.052310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:38:25.052310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:38:25.052310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:38:25.052310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:38:25.052310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:38:25.052310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:38:25.052310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:38:25.052310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:38:25.054126 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:38:25.054126 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:38:25.054126 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:38:25.054126 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:38:25.054126 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:38:25.054126 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:38:25.054126 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:38:25.054126 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:38:25.054126 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:38:25.054126 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:38:25.054126 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:38:25.054126 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:38:25.054126 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:38:25.054126 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:38:25.054126 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:38:25.054126 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:38:25.055626 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:38:25.055626 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:38:25.055626 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:38:25.055626 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:38:25.055626 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:38:25.055626 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:38:25.055626 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:38:25.055626 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:38:25.055626 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:38:25.055626 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:38:25.055626 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 24 04:38:25.055626 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:38:25.055626 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 04:38:25.055626 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:38:25.055626 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 581/1165] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Aug 24 04:38:24 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:38:25.062821 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659906d-02db-4748-afb3-c84f7c2a2688 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:25.178571 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2659906d-02db-4748-afb3-c84f7c2a2688 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:25.216562 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8bd5cd-3424-47f9-ab5d-6110b8843a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:25.217201 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8bd5cd-3424-47f9-ab5d-6110b8843a3e None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:25.217493 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8bd5cd-3424-47f9-ab5d-6110b8843a3e None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:25.217787 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8bd5cd-3424-47f9-ab5d-6110b8843a3e None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:25.218455 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8bd5cd-3424-47f9-ab5d-6110b8843a3e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:38:25.218751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8bd5cd-3424-47f9-ab5d-6110b8843a3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:25.220123 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8bd5cd-3424-47f9-ab5d-6110b8843a3e None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:25.227730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 585/1166] 10.222.0.49 () {56 vars in 1115 bytes} [Wed Aug 24 04:38:25 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:38:27.093970 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ced72e-e4e2-4df7-9e56-6c08dd2fcb3e None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:27.094639 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ced72e-e4e2-4df7-9e56-6c08dd2fcb3e None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:27.094639 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ced72e-e4e2-4df7-9e56-6c08dd2fcb3e None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:27.095906 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 582/1167] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:38:27.102344 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d993434-ebaa-456b-8437-50e6b492087f None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:27.102808 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d993434-ebaa-456b-8437-50e6b492087f None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:27.102907 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d993434-ebaa-456b-8437-50e6b492087f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:27.124771 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-3d993434-ebaa-456b-8437-50e6b492087f None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:38:27.126013 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-3d993434-ebaa-456b-8437-50e6b492087f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:27.152316 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:27.200005 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 586/1168] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:38:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:38:27.465774 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ced72e-e4e2-4df7-9e56-6c08dd2fcb3e None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:27.580258 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ced72e-e4e2-4df7-9e56-6c08dd2fcb3e None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:27.598615 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:27.620305 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d9a12-5371-4e0f-a936-fa07843dda81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:27.620913 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d9a12-5371-4e0f-a936-fa07843dda81 None admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:27.621193 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d9a12-5371-4e0f-a936-fa07843dda81 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:27.621501 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d9a12-5371-4e0f-a936-fa07843dda81 None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:27.622171 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d9a12-5371-4e0f-a936-fa07843dda81 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:27.623621 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d9a12-5371-4e0f-a936-fa07843dda81 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:27.641738 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 583/1169] 10.222.0.49 () {60 vars in 1138 bytes} [Wed Aug 24 04:38:27 2022] POST /identity/v3/domains => generated 267 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:38:29.556341 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef954e4-08ff-42d2-a32c-915332b1ffc0 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:29.557187 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef954e4-08ff-42d2-a32c-915332b1ffc0 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:29.557187 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef954e4-08ff-42d2-a32c-915332b1ffc0 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:29.559352 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 587/1170] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:38:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:38:29.568458 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7544e7-99f3-4822-9c13-a9d5d8323d90 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:29.568910 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7544e7-99f3-4822-9c13-a9d5d8323d90 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:29.569009 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7544e7-99f3-4822-9c13-a9d5d8323d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:29.591476 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-8c7544e7-99f3-4822-9c13-a9d5d8323d90 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:38:29.592806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-8c7544e7-99f3-4822-9c13-a9d5d8323d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:29.668679 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 584/1171] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:38:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:38:29.934055 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef954e4-08ff-42d2-a32c-915332b1ffc0 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:30.045086 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef954e4-08ff-42d2-a32c-915332b1ffc0 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:30.081497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f551e-26e4-4c02-b986-0255e70e4067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:30.082113 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f551e-26e4-4c02-b986-0255e70e4067 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:30.082394 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f551e-26e4-4c02-b986-0255e70e4067 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:30.082662 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f551e-26e4-4c02-b986-0255e70e4067 None admin] PATH_INFO: `/v3/domains/69b31f67af354d80b54b8966d0264f8b` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:30.093804 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f551e-26e4-4c02-b986-0255e70e4067 None admin] RBAC: Authorizing `identity:get_domain(domain_id=69b31f67af354d80b54b8966d0264f8b)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:30.095233 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f551e-26e4-4c02-b986-0255e70e4067 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:30.096826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 588/1172] 10.222.0.49 () {56 vars in 1183 bytes} [Wed Aug 24 04:38:29 2022] GET /identity/v3/domains/69b31f67af354d80b54b8966d0264f8b => generated 267 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:38:30.103619 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7544e7-99f3-4822-9c13-a9d5d8323d90 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:30.211663 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7544e7-99f3-4822-9c13-a9d5d8323d90 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:30.219194 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:30.257974 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60baf061-2c8c-4853-9a04-c769ada3396c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:30.258579 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60baf061-2c8c-4853-9a04-c769ada3396c None admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:30.258854 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60baf061-2c8c-4853-9a04-c769ada3396c None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:30.259119 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60baf061-2c8c-4853-9a04-c769ada3396c None admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:30.259755 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60baf061-2c8c-4853-9a04-c769ada3396c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:30.261195 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60baf061-2c8c-4853-9a04-c769ada3396c None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:30.293192 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 585/1173] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 24 04:38:30 2022] POST /identity/v3/projects => generated 361 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:38:32.177516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55879c7c-8ea2-4fa8-a8bd-675ab47059c0 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:32.178046 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55879c7c-8ea2-4fa8-a8bd-675ab47059c0 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:32.178046 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55879c7c-8ea2-4fa8-a8bd-675ab47059c0 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:32.179444 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 589/1174] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:38:32.184850 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8daa2e-fcd0-4dc0-9d41-a78b6760dc25 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:32.185299 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8daa2e-fcd0-4dc0-9d41-a78b6760dc25 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:32.185434 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8daa2e-fcd0-4dc0-9d41-a78b6760dc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:32.204157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-cc8daa2e-fcd0-4dc0-9d41-a78b6760dc25 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:38:32.205365 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-cc8daa2e-fcd0-4dc0-9d41-a78b6760dc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:32.274246 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 586/1175] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:38:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:38:32.539559 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55879c7c-8ea2-4fa8-a8bd-675ab47059c0 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:32.566258 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:32.667460 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55879c7c-8ea2-4fa8-a8bd-675ab47059c0 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:32.702798 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1a506-b14a-4b50-a855-70c35bec2e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:32.703411 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1a506-b14a-4b50-a855-70c35bec2e5e None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:32.703684 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1a506-b14a-4b50-a855-70c35bec2e5e None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:32.703954 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1a506-b14a-4b50-a855-70c35bec2e5e None admin] PATH_INFO: `/v3/domains/69b31f67af354d80b54b8966d0264f8b` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:32.705167 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba1a506-b14a-4b50-a855-70c35bec2e5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=69b31f67af354d80b54b8966d0264f8b)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:32.706607 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba1a506-b14a-4b50-a855-70c35bec2e5e None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:32.708322 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 590/1176] 10.222.0.49 () {56 vars in 1183 bytes} [Wed Aug 24 04:38:32 2022] GET /identity/v3/domains/69b31f67af354d80b54b8966d0264f8b => generated 267 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:38:32.714473 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8daa2e-fcd0-4dc0-9d41-a78b6760dc25 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:32.808287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:32.821578 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8daa2e-fcd0-4dc0-9d41-a78b6760dc25 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:32.861168 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b5e1e-1631-4e3f-a56a-5fb3828f47fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:32.861786 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b5e1e-1631-4e3f-a56a-5fb3828f47fc None admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:32.862058 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b5e1e-1631-4e3f-a56a-5fb3828f47fc None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:32.862333 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b5e1e-1631-4e3f-a56a-5fb3828f47fc None admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:32.862988 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b5e1e-1631-4e3f-a56a-5fb3828f47fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:32.864424 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b5e1e-1631-4e3f-a56a-5fb3828f47fc None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:32.890495 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 587/1177] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 24 04:38:32 2022] POST /identity/v3/users => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:38:34.835590 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045c600-db7d-4e7a-905d-8a1c6f37ee26 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:34.836155 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045c600-db7d-4e7a-905d-8a1c6f37ee26 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:34.836155 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045c600-db7d-4e7a-905d-8a1c6f37ee26 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:34.837507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 591/1178] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:38:34.843114 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fe548-11cb-40cc-9716-ff3b422f2df6 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:34.843581 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fe548-11cb-40cc-9716-ff3b422f2df6 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:34.843688 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1fe548-11cb-40cc-9716-ff3b422f2df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:34.863892 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-9b1fe548-11cb-40cc-9716-ff3b422f2df6 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:38:34.865080 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-9b1fe548-11cb-40cc-9716-ff3b422f2df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:34.938174 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 588/1179] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:38:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:38:35.205082 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045c600-db7d-4e7a-905d-8a1c6f37ee26 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:35.304949 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:35.326318 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045c600-db7d-4e7a-905d-8a1c6f37ee26 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:35.366123 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab336a-fadc-41fc-a182-45ddc80a6362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:35.366747 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab336a-fadc-41fc-a182-45ddc80a6362 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:35.366992 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab336a-fadc-41fc-a182-45ddc80a6362 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:35.367287 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab336a-fadc-41fc-a182-45ddc80a6362 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:35.377955 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ab336a-fadc-41fc-a182-45ddc80a6362 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:38:35.382641 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-05ab336a-fadc-41fc-a182-45ddc80a6362 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:38:35.382641 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:38:35.382641 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:38:35.382641 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:38:35.382641 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:38:35.382641 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:38:35.382641 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:38:35.382641 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:38:35.382641 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:38:35.382641 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:38:35.382641 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:38:35.382641 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:38:35.382641 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:38:35.382641 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:38:35.382641 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:38:35.382641 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:38:35.383812 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:38:35.383812 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:38:35.383812 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:38:35.383812 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:38:35.383812 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:38:35.383812 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:38:35.383812 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:38:35.383812 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:38:35.383812 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:38:35.383812 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:38:35.383812 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:38:35.383812 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:38:35.383812 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:38:35.383812 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:38:35.383812 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:38:35.383812 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:38:35.385106 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:38:35.385106 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:38:35.385106 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:38:35.385106 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:38:35.385106 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:38:35.385106 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:38:35.385106 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:38:35.385106 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:38:35.385106 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:38:35.385106 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:38:35.385106 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:38:35.385106 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:38:35.385106 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 592/1180] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 24 04:38:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:38:35.391582 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fe548-11cb-40cc-9716-ff3b422f2df6 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:35.475928 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:35.507713 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1fe548-11cb-40cc-9716-ff3b422f2df6 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:35.550517 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbcda29-d70c-48a2-a9bf-532ed95ae0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:35.551113 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcda29-d70c-48a2-a9bf-532ed95ae0be None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:35.551390 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcda29-d70c-48a2-a9bf-532ed95ae0be None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:35.551657 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcda29-d70c-48a2-a9bf-532ed95ae0be None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:35.552317 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbcda29-d70c-48a2-a9bf-532ed95ae0be None admin] RBAC: Adding query filter params (name=admin) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:38:35.552615 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbcda29-d70c-48a2-a9bf-532ed95ae0be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:35.554029 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbcda29-d70c-48a2-a9bf-532ed95ae0be None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:35.562422 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 589/1181] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:38:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:38:35.571148 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab336a-fadc-41fc-a182-45ddc80a6362 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:35.675217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab336a-fadc-41fc-a182-45ddc80a6362 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:35.710801 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a9dbe-c9b8-47e2-83f8-9a0618e0e2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:35.711403 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a9dbe-c9b8-47e2-83f8-9a0618e0e2bb None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:35.711683 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a9dbe-c9b8-47e2-83f8-9a0618e0e2bb None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:35.711973 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a9dbe-c9b8-47e2-83f8-9a0618e0e2bb None admin] PATH_INFO: `/v3/users/04c696ba07ef47eb901e3d642c399026` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:35.725491 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a9dbe-c9b8-47e2-83f8-9a0618e0e2bb None admin] RBAC: Authorizing `identity:get_user(user_id=04c696ba07ef47eb901e3d642c399026)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:35.726992 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a9dbe-c9b8-47e2-83f8-9a0618e0e2bb None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:35.728543 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 593/1182] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:38:35 2022] GET /identity/v3/users/04c696ba07ef47eb901e3d642c399026 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:38:35.737145 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbcda29-d70c-48a2-a9bf-532ed95ae0be None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:35.845935 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbcda29-d70c-48a2-a9bf-532ed95ae0be None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:35.880916 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e6223-2011-487d-be13-ce4e18ca9238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:35.881538 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e6223-2011-487d-be13-ce4e18ca9238 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:35.881813 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e6223-2011-487d-be13-ce4e18ca9238 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:35.882084 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e6223-2011-487d-be13-ce4e18ca9238 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:35.885505 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:35.950376 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e6223-2011-487d-be13-ce4e18ca9238 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:35.951831 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e6223-2011-487d-be13-ce4e18ca9238 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:36.052157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 590/1183] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:38:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:38:36.058398 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a9dbe-c9b8-47e2-83f8-9a0618e0e2bb None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:36.062659 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:36.171253 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a9dbe-c9b8-47e2-83f8-9a0618e0e2bb None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:36.207048 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45c0ad-0148-44ab-b0c4-d4ec51784782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:36.207667 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45c0ad-0148-44ab-b0c4-d4ec51784782 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:36.207945 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45c0ad-0148-44ab-b0c4-d4ec51784782 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:36.208215 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45c0ad-0148-44ab-b0c4-d4ec51784782 None admin] PATH_INFO: `/v3/projects/38e186a403294175836abc56a280af6f` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:36.209481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45c0ad-0148-44ab-b0c4-d4ec51784782 None admin] RBAC: Authorizing `identity:get_project(project_id=38e186a403294175836abc56a280af6f)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:36.210919 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45c0ad-0148-44ab-b0c4-d4ec51784782 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:36.212554 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 594/1184] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:38:36 2022] GET /identity/v3/projects/38e186a403294175836abc56a280af6f => generated 361 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:38:36.219192 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e6223-2011-487d-be13-ce4e18ca9238 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:36.255806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:36.324166 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e6223-2011-487d-be13-ce4e18ca9238 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:36.360716 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132207f8-a108-4e20-9735-d57ad036119c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:36.361310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132207f8-a108-4e20-9735-d57ad036119c None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:36.361612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132207f8-a108-4e20-9735-d57ad036119c None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:36.361884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132207f8-a108-4e20-9735-d57ad036119c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:36.362614 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132207f8-a108-4e20-9735-d57ad036119c None admin] RBAC: Adding query filter params (role.id=74ce7b72bcc94a8a8ad65c3db928e6ac, scope.project.id=38e186a403294175836abc56a280af6f, user.id=04c696ba07ef47eb901e3d642c399026) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:38:36.362923 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132207f8-a108-4e20-9735-d57ad036119c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:36.364354 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132207f8-a108-4e20-9735-d57ad036119c None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:36.370457 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 591/1185] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:38:36 2022] GET /identity/v3/role_assignments?user.id=04c696ba07ef47eb901e3d642c399026&scope.project.id=38e186a403294175836abc56a280af6f&role.id=74ce7b72bcc94a8a8ad65c3db928e6ac => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:38:38.233367 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5265c-6319-4492-9029-b654383a031e None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:38.233901 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5265c-6319-4492-9029-b654383a031e None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:38.233901 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5265c-6319-4492-9029-b654383a031e None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:38.235942 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 595/1186] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:38:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:38:38.244475 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e12ce4-334a-4435-bb05-83ee9d0526ef None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:38.244958 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e12ce4-334a-4435-bb05-83ee9d0526ef None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:38.245109 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e12ce4-334a-4435-bb05-83ee9d0526ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:38.266758 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-68e12ce4-334a-4435-bb05-83ee9d0526ef None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:38:38.267963 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-68e12ce4-334a-4435-bb05-83ee9d0526ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:38.341978 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 592/1187] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:38:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:38:38.607099 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5265c-6319-4492-9029-b654383a031e None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:38.684123 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:38.722947 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5265c-6319-4492-9029-b654383a031e None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:38.768411 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99cf10-3260-4a87-a94a-aa88a9625a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:38.769308 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99cf10-3260-4a87-a94a-aa88a9625a79 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:38.769794 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99cf10-3260-4a87-a94a-aa88a9625a79 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:38.770180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99cf10-3260-4a87-a94a-aa88a9625a79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:38.782318 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e99cf10-3260-4a87-a94a-aa88a9625a79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:38:38.786990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-2e99cf10-3260-4a87-a94a-aa88a9625a79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:38:38.786990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:38:38.786990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:38:38.786990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:38:38.786990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:38:38.786990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:38:38.786990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:38:38.786990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:38:38.786990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:38:38.786990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:38:38.786990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:38:38.786990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:38:38.786990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:38:38.786990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:38:38.786990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:38:38.786990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:38:38.788060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:38:38.788060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:38:38.788060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:38:38.788060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:38:38.788060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:38:38.788060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:38:38.788060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:38:38.788060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:38:38.788060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:38:38.788060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:38:38.788060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:38:38.788060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:38:38.788060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:38:38.788060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:38:38.788060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:38:38.788060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:38:38.788930 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:38:38.788930 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:38:38.788930 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:38:38.788930 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:38:38.788930 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:38:38.788930 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:38:38.788930 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:38:38.788930 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:38:38.788930 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:38:38.788930 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:38:38.788930 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:38:38.788930 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:38:38.788930 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 596/1188] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 24 04:38:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:38:38.796781 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e12ce4-334a-4435-bb05-83ee9d0526ef None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:38.832044 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:38.910327 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e12ce4-334a-4435-bb05-83ee9d0526ef None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:38.945655 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a547ef2-a890-4d2b-bd36-f84335c0d7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:38.946260 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a547ef2-a890-4d2b-bd36-f84335c0d7a6 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:38.946537 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a547ef2-a890-4d2b-bd36-f84335c0d7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:38.946810 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a547ef2-a890-4d2b-bd36-f84335c0d7a6 None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:38.947475 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a547ef2-a890-4d2b-bd36-f84335c0d7a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:38:38.947778 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a547ef2-a890-4d2b-bd36-f84335c0d7a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:38.949148 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a547ef2-a890-4d2b-bd36-f84335c0d7a6 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:38.957445 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 593/1189] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:38:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:38:38.964623 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99cf10-3260-4a87-a94a-aa88a9625a79 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:39.096138 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99cf10-3260-4a87-a94a-aa88a9625a79 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:39.138060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:39.145035 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ea1a2-66e5-46e6-b4d5-ca2be83de99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:39.145713 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ea1a2-66e5-46e6-b4d5-ca2be83de99c None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:39.145992 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ea1a2-66e5-46e6-b4d5-ca2be83de99c None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:39.146258 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ea1a2-66e5-46e6-b4d5-ca2be83de99c None admin] PATH_INFO: `/v3/users/04c696ba07ef47eb901e3d642c399026` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:39.147529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ea1a2-66e5-46e6-b4d5-ca2be83de99c None admin] RBAC: Authorizing `identity:get_user(user_id=04c696ba07ef47eb901e3d642c399026)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:39.148973 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ea1a2-66e5-46e6-b4d5-ca2be83de99c None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:39.150628 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 597/1190] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:38:38 2022] GET /identity/v3/users/04c696ba07ef47eb901e3d642c399026 => generated 311 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:38:39.156676 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a547ef2-a890-4d2b-bd36-f84335c0d7a6 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:39.257517 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:39.267454 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a547ef2-a890-4d2b-bd36-f84335c0d7a6 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:39.301980 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82969f91-7e85-4881-8ccc-e0e0e0b56131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:39.302596 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82969f91-7e85-4881-8ccc-e0e0e0b56131 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:39.302874 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82969f91-7e85-4881-8ccc-e0e0e0b56131 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:39.303145 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82969f91-7e85-4881-8ccc-e0e0e0b56131 None admin] PATH_INFO: `/v3/projects/38e186a403294175836abc56a280af6f` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:39.304385 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82969f91-7e85-4881-8ccc-e0e0e0b56131 None admin] RBAC: Authorizing `identity:get_project(project_id=38e186a403294175836abc56a280af6f)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:39.305864 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82969f91-7e85-4881-8ccc-e0e0e0b56131 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:39.307536 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 594/1191] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:38:39 2022] GET /identity/v3/projects/38e186a403294175836abc56a280af6f => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:38:39.314552 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ea1a2-66e5-46e6-b4d5-ca2be83de99c None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:39.419795 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ea1a2-66e5-46e6-b4d5-ca2be83de99c None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:39.455205 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da39b03-b4f1-4a79-ba8a-1e065de13503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:39.456081 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da39b03-b4f1-4a79-ba8a-1e065de13503 None admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:39.456081 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da39b03-b4f1-4a79-ba8a-1e065de13503 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:39.456647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da39b03-b4f1-4a79-ba8a-1e065de13503 None admin] PATH_INFO: `/v3/projects/38e186a403294175836abc56a280af6f/users/04c696ba07ef47eb901e3d642c399026/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:39.458564 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da39b03-b4f1-4a79-ba8a-1e065de13503 None admin] RBAC: Authorizing `identity:create_grant(project_id=38e186a403294175836abc56a280af6f, user_id=04c696ba07ef47eb901e3d642c399026, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:39.460001 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da39b03-b4f1-4a79-ba8a-1e065de13503 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:39.476181 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 598/1192] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 24 04:38:39 2022] PUT /identity/v3/projects/38e186a403294175836abc56a280af6f/users/04c696ba07ef47eb901e3d642c399026/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:38:41.349156 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3c318-4de7-4f6c-a329-d4ed067b3d7a None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:41.350100 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3c318-4de7-4f6c-a329-d4ed067b3d7a None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:41.350100 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3c318-4de7-4f6c-a329-d4ed067b3d7a None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:41.352253 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 595/1193] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:38:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:38:41.360418 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073dcb58-e6d2-49e5-84d8-0ee46e056662 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:41.360870 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073dcb58-e6d2-49e5-84d8-0ee46e056662 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:41.360969 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073dcb58-e6d2-49e5-84d8-0ee46e056662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:41.379558 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-073dcb58-e6d2-49e5-84d8-0ee46e056662 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:38:41.380765 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-073dcb58-e6d2-49e5-84d8-0ee46e056662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:38:41.439044 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:41.454433 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 599/1194] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:38:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:38:41.719890 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3c318-4de7-4f6c-a329-d4ed067b3d7a None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:41.835176 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3c318-4de7-4f6c-a329-d4ed067b3d7a None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:41.875740 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e76fd-ee30-46a5-bae5-07a099dd8920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:41.876376 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e76fd-ee30-46a5-bae5-07a099dd8920 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:41.876652 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e76fd-ee30-46a5-bae5-07a099dd8920 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:41.876904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e76fd-ee30-46a5-bae5-07a099dd8920 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:41.888078 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e76fd-ee30-46a5-bae5-07a099dd8920 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:38:41.892764 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-e26e76fd-ee30-46a5-bae5-07a099dd8920 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:38:41.892764 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:38:41.892764 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:38:41.892764 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:38:41.892764 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:38:41.892764 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:38:41.892764 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:38:41.892764 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:38:41.892764 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:38:41.892764 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:38:41.892764 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:38:41.892764 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:38:41.892764 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:38:41.892764 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:38:41.892764 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:38:41.892764 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:38:41.894057 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:38:41.894057 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:38:41.894057 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:38:41.894057 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:38:41.894057 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:38:41.894057 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:38:41.894057 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:38:41.894057 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:38:41.894057 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:38:41.894057 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:38:41.894057 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:38:41.894057 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:38:41.894057 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:38:41.894057 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:38:41.894057 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:38:41.894057 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:38:41.895004 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:38:41.895004 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:38:41.895004 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:38:41.895004 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:38:41.895004 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:38:41.895004 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:38:41.895004 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:38:41.895004 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:38:41.895004 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:38:41.895004 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:38:41.895004 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:38:41.895004 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:38:41.895004 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 596/1195] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 24 04:38:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:38:41.900900 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073dcb58-e6d2-49e5-84d8-0ee46e056662 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:42.016691 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073dcb58-e6d2-49e5-84d8-0ee46e056662 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:42.051246 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab8c20-f109-44c3-a793-d2330ab8ce66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:42.051870 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab8c20-f109-44c3-a793-d2330ab8ce66 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:42.052142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab8c20-f109-44c3-a793-d2330ab8ce66 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:42.052407 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab8c20-f109-44c3-a793-d2330ab8ce66 None admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:42.053071 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab8c20-f109-44c3-a793-d2330ab8ce66 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:38:42.053380 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab8c20-f109-44c3-a793-d2330ab8ce66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:42.054755 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ab8c20-f109-44c3-a793-d2330ab8ce66 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:42.063061 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 600/1196] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:38:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:38:42.069139 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e76fd-ee30-46a5-bae5-07a099dd8920 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:42.091909 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:42.176313 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e76fd-ee30-46a5-bae5-07a099dd8920 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:42.217044 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9a0b5-fb90-4182-beac-bb4f312d0b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:42.217723 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9a0b5-fb90-4182-beac-bb4f312d0b31 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:42.217991 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9a0b5-fb90-4182-beac-bb4f312d0b31 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:42.218256 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9a0b5-fb90-4182-beac-bb4f312d0b31 None admin] PATH_INFO: `/v3/users/04c696ba07ef47eb901e3d642c399026` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:42.219444 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf9a0b5-fb90-4182-beac-bb4f312d0b31 None admin] RBAC: Authorizing `identity:get_user(user_id=04c696ba07ef47eb901e3d642c399026)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:42.220866 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf9a0b5-fb90-4182-beac-bb4f312d0b31 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:42.222473 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 597/1197] 10.222.0.49 () {56 vars in 1177 bytes} [Wed Aug 24 04:38:42 2022] GET /identity/v3/users/04c696ba07ef47eb901e3d642c399026 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:38:42.228934 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab8c20-f109-44c3-a793-d2330ab8ce66 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:42.299856 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:42.359433 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab8c20-f109-44c3-a793-d2330ab8ce66 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:42.397602 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784a4ff-15c2-4a3c-b349-a19da2ea7c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:42.398303 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784a4ff-15c2-4a3c-b349-a19da2ea7c45 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:42.398499 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784a4ff-15c2-4a3c-b349-a19da2ea7c45 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:42.398776 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784a4ff-15c2-4a3c-b349-a19da2ea7c45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:42.487383 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784a4ff-15c2-4a3c-b349-a19da2ea7c45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:42.488833 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784a4ff-15c2-4a3c-b349-a19da2ea7c45 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:42.548161 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:42.612021 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 601/1198] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:38:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:38:42.621687 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9a0b5-fb90-4182-beac-bb4f312d0b31 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:42.715422 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:42.733504 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9a0b5-fb90-4182-beac-bb4f312d0b31 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:42.772535 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476c82a-96dd-4c7d-b2d6-58ecdf54667a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:42.773152 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476c82a-96dd-4c7d-b2d6-58ecdf54667a None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:42.773463 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476c82a-96dd-4c7d-b2d6-58ecdf54667a None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:42.773734 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476c82a-96dd-4c7d-b2d6-58ecdf54667a None admin] PATH_INFO: `/v3/projects/38e186a403294175836abc56a280af6f` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:42.774961 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476c82a-96dd-4c7d-b2d6-58ecdf54667a None admin] RBAC: Authorizing `identity:get_project(project_id=38e186a403294175836abc56a280af6f)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:42.776388 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476c82a-96dd-4c7d-b2d6-58ecdf54667a None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:42.778087 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 598/1199] 10.222.0.49 () {56 vars in 1186 bytes} [Wed Aug 24 04:38:42 2022] GET /identity/v3/projects/38e186a403294175836abc56a280af6f => generated 361 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:38:42.785357 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784a4ff-15c2-4a3c-b349-a19da2ea7c45 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:38:42.901079 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784a4ff-15c2-4a3c-b349-a19da2ea7c45 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:38:42.937834 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704205b-f18e-466b-9a6d-19a801b4991c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:38:42.938440 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704205b-f18e-466b-9a6d-19a801b4991c None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:38:42.938715 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704205b-f18e-466b-9a6d-19a801b4991c None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:38:42.938978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704205b-f18e-466b-9a6d-19a801b4991c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:38:42.939702 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b704205b-f18e-466b-9a6d-19a801b4991c None admin] RBAC: Adding query filter params (role.id=74ce7b72bcc94a8a8ad65c3db928e6ac, scope.project.id=38e186a403294175836abc56a280af6f, user.id=04c696ba07ef47eb901e3d642c399026) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:38:42.940003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b704205b-f18e-466b-9a6d-19a801b4991c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:38:42.941460 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b704205b-f18e-466b-9a6d-19a801b4991c None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:38:42.948681 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 602/1200] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:38:42 2022] GET /identity/v3/role_assignments?user.id=04c696ba07ef47eb901e3d642c399026&scope.project.id=38e186a403294175836abc56a280af6f&role.id=74ce7b72bcc94a8a8ad65c3db928e6ac => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:38:52.766841 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=22 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:38:52.945647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=92 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:38.464440 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a087fb9-720a-4393-a1e4-5e6ccb282b80 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:38.464440 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a087fb9-720a-4393-a1e4-5e6ccb282b80 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:38.464440 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a087fb9-720a-4393-a1e4-5e6ccb282b80 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:38.464440 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 599/1201] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:38.473753 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfabb0-5a8d-4b5a-b7c7-f46ac2c29fdf None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:38.474275 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfabb0-5a8d-4b5a-b7c7-f46ac2c29fdf None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:38.474368 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfabb0-5a8d-4b5a-b7c7-f46ac2c29fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:38.496620 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-0fdfabb0-5a8d-4b5a-b7c7-f46ac2c29fdf None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:38.498260 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-0fdfabb0-5a8d-4b5a-b7c7-f46ac2c29fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:38.588864 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 603/1202] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:39:38.870322 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a087fb9-720a-4393-a1e4-5e6ccb282b80 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:39.005214 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a087fb9-720a-4393-a1e4-5e6ccb282b80 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:39.050514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b262c94-9548-4770-985b-2b3d4d09fb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:39.051535 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b262c94-9548-4770-985b-2b3d4d09fb20 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:39.051703 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b262c94-9548-4770-985b-2b3d4d09fb20 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:39.051912 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b262c94-9548-4770-985b-2b3d4d09fb20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:39.064915 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b262c94-9548-4770-985b-2b3d4d09fb20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:39.067028 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b262c94-9548-4770-985b-2b3d4d09fb20 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:39.083929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-7b262c94-9548-4770-985b-2b3d4d09fb20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:39.083929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:39.083929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:39.083929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:39.083929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:39.083929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:39.083929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:39.083929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:39.083929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:39.083929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:39.083929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:39.083929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:39.083929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:39:39.083929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:39:39.083929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:39:39.083929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:39:39.085515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:39.085515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:39.085515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:39.085515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:39.085515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:39.085515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:39.085515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:39.085515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:39.085515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:39.085515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:39.085515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:39.085515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:39.085515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:39.085515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:39.085515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:39.085515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:39.085515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:39:39.086692 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:39:39.086692 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:39.086692 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:39:39.091102 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 600/1203] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:39:39.094144 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfabb0-5a8d-4b5a-b7c7-f46ac2c29fdf None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:39.238073 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfabb0-5a8d-4b5a-b7c7-f46ac2c29fdf None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:39.273084 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:39.280485 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8946aa7-410d-4437-bfb9-089f83ff6720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:39.281255 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8946aa7-410d-4437-bfb9-089f83ff6720 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:39.282401 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8946aa7-410d-4437-bfb9-089f83ff6720 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:39.282715 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8946aa7-410d-4437-bfb9-089f83ff6720 None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:39.283373 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8946aa7-410d-4437-bfb9-089f83ff6720 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:39.283754 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8946aa7-410d-4437-bfb9-089f83ff6720 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:39.285619 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8946aa7-410d-4437-bfb9-089f83ff6720 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:39.309401 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 604/1204] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:39:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:39:39.311710 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b262c94-9548-4770-985b-2b3d4d09fb20 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:39.382315 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:39.437358 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b262c94-9548-4770-985b-2b3d4d09fb20 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:39.474355 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d9daa6-59e1-46ae-bdd5-47b61c8f2d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:39.475026 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9daa6-59e1-46ae-bdd5-47b61c8f2d77 None admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:39.475259 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9daa6-59e1-46ae-bdd5-47b61c8f2d77 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:39.475680 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9daa6-59e1-46ae-bdd5-47b61c8f2d77 None admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:39.476362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d9daa6-59e1-46ae-bdd5-47b61c8f2d77 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:39.477886 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d9daa6-59e1-46ae-bdd5-47b61c8f2d77 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:39.502325 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 601/1205] 10.222.0.49 () {60 vars in 1132 bytes} [Wed Aug 24 04:39:39 2022] POST /identity/v3/users => generated 251 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:39:41.611564 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26ce95-9832-4f93-9f20-5f9b8202a62f None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:41.612256 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26ce95-9832-4f93-9f20-5f9b8202a62f None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:41.612256 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26ce95-9832-4f93-9f20-5f9b8202a62f None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:41.614725 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 605/1206] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:41.619555 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5e4ef-b33d-49df-bb14-236a7d27237d None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:41.620082 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5e4ef-b33d-49df-bb14-236a7d27237d None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:41.620082 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5e4ef-b33d-49df-bb14-236a7d27237d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:41.640504 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-57b5e4ef-b33d-49df-bb14-236a7d27237d None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:41.642129 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-57b5e4ef-b33d-49df-bb14-236a7d27237d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:41.727108 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 602/1207] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:39:41.999365 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26ce95-9832-4f93-9f20-5f9b8202a62f None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:42.136204 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26ce95-9832-4f93-9f20-5f9b8202a62f None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:42.182624 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d3d63-0a31-43ae-9d5b-af01d99b1b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:42.183290 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d3d63-0a31-43ae-9d5b-af01d99b1b00 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:42.183565 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d3d63-0a31-43ae-9d5b-af01d99b1b00 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:42.183868 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7d3d63-0a31-43ae-9d5b-af01d99b1b00 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:42.200734 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7d3d63-0a31-43ae-9d5b-af01d99b1b00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:42.206261 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-ef7d3d63-0a31-43ae-9d5b-af01d99b1b00 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:39:42.206261 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:42.206261 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:42.206261 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:42.206261 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:42.206261 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:42.206261 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:42.206261 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:42.206261 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:42.206261 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:42.206261 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:42.206261 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:42.206261 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:42.206261 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:42.206261 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:42.206261 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:42.207267 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:42.207267 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:42.207267 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:42.207267 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:42.207267 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:42.207267 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:42.207267 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:42.207267 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:42.207267 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:42.207267 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:42.207267 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:42.207267 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:42.207267 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:42.207267 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:42.207267 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:42.207267 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:42.210144 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:42.210144 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:42.210144 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:42.210144 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:42.210144 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:42.210144 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:42.210144 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:42.210144 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:42.210144 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:42.210144 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:42.210144 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:39:42.210144 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:39:42.210144 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 606/1208] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 24 04:39:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:39:42.213909 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5e4ef-b33d-49df-bb14-236a7d27237d None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:42.270013 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:42.348589 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5e4ef-b33d-49df-bb14-236a7d27237d None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:42.391421 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29797cbb-0faf-4e9d-92bf-b16109535a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:42.392054 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29797cbb-0faf-4e9d-92bf-b16109535a75 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:42.392367 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29797cbb-0faf-4e9d-92bf-b16109535a75 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:42.392635 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29797cbb-0faf-4e9d-92bf-b16109535a75 None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:42.393309 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29797cbb-0faf-4e9d-92bf-b16109535a75 None admin] RBAC: Adding query filter params (name=service) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:42.393745 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29797cbb-0faf-4e9d-92bf-b16109535a75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:42.395543 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29797cbb-0faf-4e9d-92bf-b16109535a75 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:42.406761 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 603/1209] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 24 04:39:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:42.412532 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d3d63-0a31-43ae-9d5b-af01d99b1b00 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:42.473452 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:42.534884 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7d3d63-0a31-43ae-9d5b-af01d99b1b00 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:42.582142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e2c0f-6113-4be4-82a6-98d632b29b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:42.582805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e2c0f-6113-4be4-82a6-98d632b29b61 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:42.583032 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e2c0f-6113-4be4-82a6-98d632b29b61 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:42.583346 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e2c0f-6113-4be4-82a6-98d632b29b61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:42.594392 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e2c0f-6113-4be4-82a6-98d632b29b61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:42.596065 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e2c0f-6113-4be4-82a6-98d632b29b61 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:42.618780 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-531e2c0f-6113-4be4-82a6-98d632b29b61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:42.618780 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:42.618780 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:42.618780 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:42.618780 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:42.618780 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:42.618780 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:42.618780 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:42.618780 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:42.618780 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:42.618780 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:42.618780 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:42.618780 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:39:42.618780 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:39:42.618780 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:39:42.618780 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:39:42.620481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:42.620481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:42.620481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:42.620481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:42.620481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:42.620481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:42.620481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:42.620481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:42.620481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:42.620481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:42.620481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:42.620481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:42.620481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:42.620481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:42.620481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:42.620481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:42.620481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:39:42.621416 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:39:42.621416 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:42.621416 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:39:42.621416 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 607/1210] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:42.626269 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29797cbb-0faf-4e9d-92bf-b16109535a75 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:42.744640 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:42.748456 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29797cbb-0faf-4e9d-92bf-b16109535a75 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:42.786718 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9183d72-c3e1-4f7f-a158-710be19290f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:42.787339 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9183d72-c3e1-4f7f-a158-710be19290f2 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:42.787642 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9183d72-c3e1-4f7f-a158-710be19290f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:42.787967 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9183d72-c3e1-4f7f-a158-710be19290f2 None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:42.788667 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9183d72-c3e1-4f7f-a158-710be19290f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:42.788997 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9183d72-c3e1-4f7f-a158-710be19290f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:42.790774 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9183d72-c3e1-4f7f-a158-710be19290f2 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:42.804455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 604/1211] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:39:42.810693 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e2c0f-6113-4be4-82a6-98d632b29b61 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:42.923404 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e2c0f-6113-4be4-82a6-98d632b29b61 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:42.926290 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:42.961952 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89858f-4c64-4310-bbe8-d8ad6904421c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:42.962579 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89858f-4c64-4310-bbe8-d8ad6904421c None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:42.962828 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89858f-4c64-4310-bbe8-d8ad6904421c None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:42.963120 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89858f-4c64-4310-bbe8-d8ad6904421c None admin] PATH_INFO: `/v3/users/placement` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:42.971554 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89858f-4c64-4310-bbe8-d8ad6904421c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:42.973469 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b89858f-4c64-4310-bbe8-d8ad6904421c None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:42.987565 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-4b89858f-4c64-4310-bbe8-d8ad6904421c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:39:42.987565 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:42.987565 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:42.987565 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:42.987565 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:42.987565 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:42.987565 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:42.987565 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:42.987565 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:42.987565 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:42.987565 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:42.987565 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:42.987565 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:39:42.987565 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:39:42.987565 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:39:42.987565 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:39:42.989737 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:42.989737 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:42.989737 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:39:42.989737 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:39:42.989737 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:39:42.989737 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:39:42.989737 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:42.989737 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:42.989737 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:42.989737 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:42.989737 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:42.989737 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:42.989737 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:42.989737 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:42.989737 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:42.989737 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:42.989737 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:42.989737 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:42.990685 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:42.990685 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:42.990685 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:39:42.990685 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:39:42.990685 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:39:42.990685 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:39:42.990685 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:39:42.990685 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:39:42.990685 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:39:42.990685 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:39:42.990685 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 608/1212] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:39:42.995367 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9183d72-c3e1-4f7f-a158-710be19290f2 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:43.105494 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9183d72-c3e1-4f7f-a158-710be19290f2 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:43.142950 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192feb8d-cdf4-4f74-97a8-a5c846456833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:43.143570 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192feb8d-cdf4-4f74-97a8-a5c846456833 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:43.143935 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192feb8d-cdf4-4f74-97a8-a5c846456833 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:43.144335 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192feb8d-cdf4-4f74-97a8-a5c846456833 None admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:43.144889 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192feb8d-cdf4-4f74-97a8-a5c846456833 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:43.145196 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192feb8d-cdf4-4f74-97a8-a5c846456833 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:43.146667 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192feb8d-cdf4-4f74-97a8-a5c846456833 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:43.170656 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 605/1213] 10.222.0.49 () {56 vars in 1143 bytes} [Wed Aug 24 04:39:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:43.171706 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89858f-4c64-4310-bbe8-d8ad6904421c None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:43.294095 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89858f-4c64-4310-bbe8-d8ad6904421c None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:43.335099 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c58d2b-bde5-4b63-a4b5-0c061eac8e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:43.335715 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c58d2b-bde5-4b63-a4b5-0c061eac8e34 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:43.335991 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c58d2b-bde5-4b63-a4b5-0c061eac8e34 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:43.336259 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c58d2b-bde5-4b63-a4b5-0c061eac8e34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:43.375915 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:43.428050 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c58d2b-bde5-4b63-a4b5-0c061eac8e34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:43.429944 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c58d2b-bde5-4b63-a4b5-0c061eac8e34 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:43.561154 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 609/1214] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:39:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:39:43.568087 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192feb8d-cdf4-4f74-97a8-a5c846456833 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:43.591557 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:43.688914 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192feb8d-cdf4-4f74-97a8-a5c846456833 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:43.731219 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac000f-3cb9-4621-a6e9-0f305e5464b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:43.731981 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac000f-3cb9-4621-a6e9-0f305e5464b8 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:43.732267 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac000f-3cb9-4621-a6e9-0f305e5464b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:43.732549 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac000f-3cb9-4621-a6e9-0f305e5464b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:43.745316 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac000f-3cb9-4621-a6e9-0f305e5464b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:43.747034 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac000f-3cb9-4621-a6e9-0f305e5464b8 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:43.764582 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-36ac000f-3cb9-4621-a6e9-0f305e5464b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:43.764582 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:43.764582 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:43.764582 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:43.764582 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:43.764582 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:43.764582 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:43.764582 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:43.764582 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:43.764582 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:43.764582 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:43.764582 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:43.764582 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:39:43.764582 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:39:43.764582 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:39:43.764582 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:39:43.765884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:43.765884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:43.765884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:43.765884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:43.765884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:43.765884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:43.765884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:43.765884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:43.765884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:43.765884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:43.765884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:43.765884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:43.765884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:43.765884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:43.765884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:43.765884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:43.765884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:39:43.766806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:39:43.766806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:43.766806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:39:43.766806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 606/1215] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:43.771997 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c58d2b-bde5-4b63-a4b5-0c061eac8e34 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:43.840523 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:43.889289 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c58d2b-bde5-4b63-a4b5-0c061eac8e34 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:43.933398 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715eacaf-9f98-477d-902d-6ce9d5a45160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:43.934530 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715eacaf-9f98-477d-902d-6ce9d5a45160 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:43.935003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715eacaf-9f98-477d-902d-6ce9d5a45160 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:43.935433 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715eacaf-9f98-477d-902d-6ce9d5a45160 None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:43.936206 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715eacaf-9f98-477d-902d-6ce9d5a45160 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:43.936831 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715eacaf-9f98-477d-902d-6ce9d5a45160 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:43.938541 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715eacaf-9f98-477d-902d-6ce9d5a45160 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:43.953478 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 610/1216] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:43.958086 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac000f-3cb9-4621-a6e9-0f305e5464b8 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:44.057692 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:44.094972 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac000f-3cb9-4621-a6e9-0f305e5464b8 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:44.134801 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c57e8-845a-413f-99cb-2f5db82d4a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:44.135454 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c57e8-845a-413f-99cb-2f5db82d4a79 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:44.135729 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c57e8-845a-413f-99cb-2f5db82d4a79 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:44.136054 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c57e8-845a-413f-99cb-2f5db82d4a79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:44.143880 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c57e8-845a-413f-99cb-2f5db82d4a79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:44.145530 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c57e8-845a-413f-99cb-2f5db82d4a79 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:44.161509 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-5f2c57e8-845a-413f-99cb-2f5db82d4a79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:39:44.161509 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:44.161509 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:44.161509 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:44.161509 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:44.161509 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:44.161509 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:44.161509 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:44.161509 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:44.161509 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:44.161509 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:44.161509 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:44.161509 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:39:44.161509 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:39:44.161509 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:39:44.162699 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:39:44.162699 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:44.162699 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:44.162699 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:44.162699 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:44.162699 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:44.162699 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:44.162699 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:44.162699 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:44.162699 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:44.162699 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:44.162699 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:44.162699 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:44.162699 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:44.162699 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:44.162699 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:44.162699 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:44.163763 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:39:44.163763 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:39:44.163763 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:39:44.163763 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:39:44.163763 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:39:44.163763 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:39:44.163763 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:39:44.163763 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:39:44.163763 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 607/1217] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:39:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:39:44.169445 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715eacaf-9f98-477d-902d-6ce9d5a45160 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:44.290664 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715eacaf-9f98-477d-902d-6ce9d5a45160 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:44.319621 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:44.339927 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03e0be-cc91-4979-8b6a-b9c13796add6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:44.341714 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03e0be-cc91-4979-8b6a-b9c13796add6 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:44.341714 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03e0be-cc91-4979-8b6a-b9c13796add6 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:44.341924 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03e0be-cc91-4979-8b6a-b9c13796add6 None admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:44.342722 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03e0be-cc91-4979-8b6a-b9c13796add6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:44.343169 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03e0be-cc91-4979-8b6a-b9c13796add6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:44.344748 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03e0be-cc91-4979-8b6a-b9c13796add6 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:44.365168 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 611/1218] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 24 04:39:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:44.367103 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c57e8-845a-413f-99cb-2f5db82d4a79 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:44.482123 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c57e8-845a-413f-99cb-2f5db82d4a79 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:44.518363 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:44.527074 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab7177-5882-4fb9-948f-d26cb3ce49fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:44.527828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab7177-5882-4fb9-948f-d26cb3ce49fb None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:44.528185 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab7177-5882-4fb9-948f-d26cb3ce49fb None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:44.528665 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab7177-5882-4fb9-948f-d26cb3ce49fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:44.529539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab7177-5882-4fb9-948f-d26cb3ce49fb None admin] RBAC: Adding query filter params (role.id=d62916d0c54540b3859985d5d3565718, scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62, user.id=edf1b960a2eb4e5e9ada736b5f3f5810) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:44.529881 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab7177-5882-4fb9-948f-d26cb3ce49fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:44.531591 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab7177-5882-4fb9-948f-d26cb3ce49fb None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:44.549450 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 608/1219] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:39:44 2022] GET /identity/v3/role_assignments?user.id=edf1b960a2eb4e5e9ada736b5f3f5810&scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62&role.id=d62916d0c54540b3859985d5d3565718 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:46.494528 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb73a5-d988-48e6-a528-41b5dd9c9603 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:46.495079 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb73a5-d988-48e6-a528-41b5dd9c9603 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:46.495079 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecb73a5-d988-48e6-a528-41b5dd9c9603 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:46.496573 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 612/1220] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:46.502220 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bf2c1-8fcf-441f-a197-69f0782aa373 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:46.502725 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bf2c1-8fcf-441f-a197-69f0782aa373 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:46.502838 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bf2c1-8fcf-441f-a197-69f0782aa373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:46.524415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-0e9bf2c1-8fcf-441f-a197-69f0782aa373 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:46.526034 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-0e9bf2c1-8fcf-441f-a197-69f0782aa373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:46.608369 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 609/1221] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:39:46.874950 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb73a5-d988-48e6-a528-41b5dd9c9603 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:47.004182 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecb73a5-d988-48e6-a528-41b5dd9c9603 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:47.044259 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec5102-f904-4351-83b3-f00cf72d96ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:47.045183 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec5102-f904-4351-83b3-f00cf72d96ef None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:47.045682 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec5102-f904-4351-83b3-f00cf72d96ef None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:47.046202 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec5102-f904-4351-83b3-f00cf72d96ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:47.060092 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec5102-f904-4351-83b3-f00cf72d96ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:47.066008 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-b8ec5102-f904-4351-83b3-f00cf72d96ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:39:47.066008 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:47.066008 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:47.066008 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:47.066008 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:47.066008 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:47.066008 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:47.066008 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:47.066008 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:47.066008 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:47.066008 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:47.066008 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:47.066008 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:47.066008 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:47.066008 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:47.066008 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:47.067126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:47.067126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:47.067126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:47.067126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:47.067126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:47.067126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:47.067126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:47.067126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:47.067126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:47.067126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:47.067126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:47.067126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:47.067126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:47.067126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:47.067126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:47.067126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:47.069729 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:47.069729 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:47.069729 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:47.069729 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:47.069729 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:47.069729 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:47.069729 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:47.069729 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:47.069729 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:47.069729 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:47.069729 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:39:47.069729 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:39:47.069729 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 613/1222] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 24 04:39:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:47.074521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9bf2c1-8fcf-441f-a197-69f0782aa373 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:47.201097 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9bf2c1-8fcf-441f-a197-69f0782aa373 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:47.227238 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:47.240502 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1137d-d9e3-492e-a90a-8039e038d0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:47.241202 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1137d-d9e3-492e-a90a-8039e038d0f7 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:47.241827 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1137d-d9e3-492e-a90a-8039e038d0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:47.242168 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1137d-d9e3-492e-a90a-8039e038d0f7 None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:47.243231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1137d-d9e3-492e-a90a-8039e038d0f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:47.243539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1137d-d9e3-492e-a90a-8039e038d0f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:47.245042 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1137d-d9e3-492e-a90a-8039e038d0f7 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:47.255851 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 610/1223] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 24 04:39:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:47.262469 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec5102-f904-4351-83b3-f00cf72d96ef None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:47.309093 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:47.371097 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec5102-f904-4351-83b3-f00cf72d96ef None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:47.412958 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d5b4e-a6b3-41b4-bce2-e4ecefe93c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:47.413585 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d5b4e-a6b3-41b4-bce2-e4ecefe93c79 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:47.413865 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d5b4e-a6b3-41b4-bce2-e4ecefe93c79 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:47.414134 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d5b4e-a6b3-41b4-bce2-e4ecefe93c79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:47.424767 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d5b4e-a6b3-41b4-bce2-e4ecefe93c79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:47.426255 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d5b4e-a6b3-41b4-bce2-e4ecefe93c79 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:47.441746 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-fa7d5b4e-a6b3-41b4-bce2-e4ecefe93c79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:47.441746 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:47.441746 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:47.441746 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:47.441746 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:47.441746 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:47.441746 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:47.441746 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:47.441746 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:47.441746 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:47.441746 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:47.441746 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:47.441746 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:39:47.441746 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:39:47.441746 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:39:47.441746 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:39:47.442975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:47.442975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:47.442975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:47.442975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:47.442975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:47.442975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:47.442975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:47.442975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:47.442975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:47.442975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:47.442975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:47.442975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:47.442975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:47.442975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:47.442975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:47.442975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:47.442975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:39:47.444063 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:39:47.444063 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:47.444063 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:39:47.444063 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 614/1224] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:47.449739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1137d-d9e3-492e-a90a-8039e038d0f7 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:47.564142 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1137d-d9e3-492e-a90a-8039e038d0f7 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:47.603313 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36951407-6d0a-4f74-96dd-5536580ea364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:47.603924 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36951407-6d0a-4f74-96dd-5536580ea364 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:47.604206 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36951407-6d0a-4f74-96dd-5536580ea364 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:47.604466 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36951407-6d0a-4f74-96dd-5536580ea364 None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:47.605118 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36951407-6d0a-4f74-96dd-5536580ea364 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:47.605449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36951407-6d0a-4f74-96dd-5536580ea364 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:47.606850 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36951407-6d0a-4f74-96dd-5536580ea364 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:47.618894 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 611/1225] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:39:47.625560 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d5b4e-a6b3-41b4-bce2-e4ecefe93c79 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:47.730428 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:47.737937 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d5b4e-a6b3-41b4-bce2-e4ecefe93c79 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:47.772817 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74171f-15ff-4218-bbc8-ababf2146102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:47.773454 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74171f-15ff-4218-bbc8-ababf2146102 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:47.773736 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74171f-15ff-4218-bbc8-ababf2146102 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:47.774007 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74171f-15ff-4218-bbc8-ababf2146102 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:47.781805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea74171f-15ff-4218-bbc8-ababf2146102 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:47.783303 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea74171f-15ff-4218-bbc8-ababf2146102 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:47.794319 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-ea74171f-15ff-4218-bbc8-ababf2146102 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:39:47.794319 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:47.794319 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:47.794319 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:47.794319 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:47.794319 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:47.794319 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:47.794319 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:47.794319 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:47.794319 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:47.794319 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:47.794319 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:47.794319 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:39:47.794319 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:39:47.794319 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:39:47.794319 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:39:47.795432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:47.795432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:47.795432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:39:47.795432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:39:47.795432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:39:47.795432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:39:47.795432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:47.795432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:47.795432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:47.795432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:47.795432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:47.795432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:47.795432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:47.795432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:47.795432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:47.795432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:47.795432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:47.795432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:47.796584 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:47.796584 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:47.796584 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:39:47.796584 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:39:47.796584 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:39:47.796584 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:39:47.796584 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:39:47.796584 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:39:47.796584 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:39:47.796584 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:39:47.796584 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 615/1226] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:47.801558 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36951407-6d0a-4f74-96dd-5536580ea364 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:47.853840 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:47.911406 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36951407-6d0a-4f74-96dd-5536580ea364 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:47.948380 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065baeb1-4668-4285-b319-1f3f774d3cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:47.949008 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065baeb1-4668-4285-b319-1f3f774d3cd1 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:47.949283 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065baeb1-4668-4285-b319-1f3f774d3cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:47.949580 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065baeb1-4668-4285-b319-1f3f774d3cd1 None admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:47.950329 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065baeb1-4668-4285-b319-1f3f774d3cd1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:47.950667 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065baeb1-4668-4285-b319-1f3f774d3cd1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:47.952309 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065baeb1-4668-4285-b319-1f3f774d3cd1 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:47.969566 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 612/1227] 10.222.0.49 () {56 vars in 1143 bytes} [Wed Aug 24 04:39:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:47.975796 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74171f-15ff-4218-bbc8-ababf2146102 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:48.107325 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74171f-15ff-4218-bbc8-ababf2146102 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:48.147256 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c1dc3-343b-4f8d-9275-7e40300b9db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:48.147926 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c1dc3-343b-4f8d-9275-7e40300b9db4 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:48.148202 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c1dc3-343b-4f8d-9275-7e40300b9db4 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:48.148467 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c1dc3-343b-4f8d-9275-7e40300b9db4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:48.163343 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c1dc3-343b-4f8d-9275-7e40300b9db4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:48.164842 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c1dc3-343b-4f8d-9275-7e40300b9db4 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:48.179661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-996c1dc3-343b-4f8d-9275-7e40300b9db4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:48.179661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:48.179661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:48.179661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:48.179661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:48.179661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:48.179661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:48.179661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:48.179661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:48.179661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:48.179661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:48.179661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:48.179661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:39:48.179661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:39:48.179661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:39:48.179661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:39:48.180647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:48.180647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:48.180647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:48.180647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:48.180647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:48.180647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:48.180647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:48.180647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:48.180647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:48.180647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:48.180647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:48.180647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:48.180647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:48.180647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:48.180647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:48.180647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:48.180647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:39:48.181849 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:39:48.181849 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:48.181849 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:39:48.181849 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 616/1228] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:48.187261 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065baeb1-4668-4285-b319-1f3f774d3cd1 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:48.304392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065baeb1-4668-4285-b319-1f3f774d3cd1 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:48.307265 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:48.350983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44814081-e914-46be-af73-75d76f938d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:48.351725 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44814081-e914-46be-af73-75d76f938d4d None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:48.352114 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44814081-e914-46be-af73-75d76f938d4d None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:48.352485 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44814081-e914-46be-af73-75d76f938d4d None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:48.353545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44814081-e914-46be-af73-75d76f938d4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:48.354121 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44814081-e914-46be-af73-75d76f938d4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:48.356198 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44814081-e914-46be-af73-75d76f938d4d None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:48.372453 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 613/1229] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:48.378647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c1dc3-343b-4f8d-9275-7e40300b9db4 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:48.390006 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:48.492072 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c1dc3-343b-4f8d-9275-7e40300b9db4 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:48.528829 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76bf1e-df11-47ba-a378-d921290c33ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:48.529639 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76bf1e-df11-47ba-a378-d921290c33ac None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:48.530110 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76bf1e-df11-47ba-a378-d921290c33ac None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:48.530427 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76bf1e-df11-47ba-a378-d921290c33ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:48.538315 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76bf1e-df11-47ba-a378-d921290c33ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:48.540109 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76bf1e-df11-47ba-a378-d921290c33ac None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:48.555654 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-eb76bf1e-df11-47ba-a378-d921290c33ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:39:48.555654 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:48.555654 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:48.555654 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:48.555654 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:48.555654 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:48.555654 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:48.555654 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:48.555654 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:48.555654 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:48.555654 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:48.555654 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:48.555654 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:39:48.555654 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:39:48.555654 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:39:48.556853 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:39:48.556853 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:48.556853 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:48.556853 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:48.556853 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:48.556853 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:48.556853 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:48.556853 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:48.556853 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:48.556853 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:48.556853 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:48.556853 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:48.556853 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:48.556853 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:48.556853 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:48.556853 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:48.556853 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:48.557989 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:39:48.557989 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:39:48.557989 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:39:48.557989 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:39:48.557989 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:39:48.557989 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:39:48.557989 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:39:48.557989 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:39:48.557989 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 617/1230] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:39:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:48.565111 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44814081-e914-46be-af73-75d76f938d4d None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:48.681560 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44814081-e914-46be-af73-75d76f938d4d None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:48.719765 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb7ded-ff83-4b67-a133-3f68eec825a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:48.720711 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb7ded-ff83-4b67-a133-3f68eec825a5 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:48.721054 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb7ded-ff83-4b67-a133-3f68eec825a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:48.721361 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb7ded-ff83-4b67-a133-3f68eec825a5 None admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:48.722183 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb7ded-ff83-4b67-a133-3f68eec825a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:48.722864 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb7ded-ff83-4b67-a133-3f68eec825a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:48.724587 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb7ded-ff83-4b67-a133-3f68eec825a5 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:48.739834 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 614/1231] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 24 04:39:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:48.746212 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76bf1e-df11-47ba-a378-d921290c33ac None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:48.821416 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:48.865566 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76bf1e-df11-47ba-a378-d921290c33ac None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:48.908124 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cab3ae-361f-4d93-a51b-23324ebef977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:48.908802 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cab3ae-361f-4d93-a51b-23324ebef977 None admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:48.909178 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cab3ae-361f-4d93-a51b-23324ebef977 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:48.909567 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cab3ae-361f-4d93-a51b-23324ebef977 None admin] PATH_INFO: `/v3/projects/08755f450e6c47dcaaaa754a6aa2ec62/users/edf1b960a2eb4e5e9ada736b5f3f5810/roles/d62916d0c54540b3859985d5d3565718` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:48.927615 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cab3ae-361f-4d93-a51b-23324ebef977 None admin] RBAC: Authorizing `identity:create_grant(project_id=08755f450e6c47dcaaaa754a6aa2ec62, user_id=edf1b960a2eb4e5e9ada736b5f3f5810, role_id=d62916d0c54540b3859985d5d3565718)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:48.929276 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cab3ae-361f-4d93-a51b-23324ebef977 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:48.943553 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 618/1232] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 24 04:39:48 2022] PUT /identity/v3/projects/08755f450e6c47dcaaaa754a6aa2ec62/users/edf1b960a2eb4e5e9ada736b5f3f5810/roles/d62916d0c54540b3859985d5d3565718 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:50.985862 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14334d0f-a899-45b6-b1f4-e2854f720a67 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:50.986463 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14334d0f-a899-45b6-b1f4-e2854f720a67 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:50.986463 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14334d0f-a899-45b6-b1f4-e2854f720a67 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:50.988046 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 615/1233] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:39:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:50.993918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceedcf9-76cd-4789-ae63-05ed6fdeccad None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:50.994361 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceedcf9-76cd-4789-ae63-05ed6fdeccad None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:50.994452 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceedcf9-76cd-4789-ae63-05ed6fdeccad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:51.012698 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-1ceedcf9-76cd-4789-ae63-05ed6fdeccad None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:51.013938 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-1ceedcf9-76cd-4789-ae63-05ed6fdeccad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:51.085433 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 619/1234] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:39:51.356270 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14334d0f-a899-45b6-b1f4-e2854f720a67 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:51.382600 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:51.465179 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14334d0f-a899-45b6-b1f4-e2854f720a67 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:51.501897 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032a231-4c14-4de2-b834-68d9d530bff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:51.502979 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032a231-4c14-4de2-b834-68d9d530bff7 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:51.503474 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032a231-4c14-4de2-b834-68d9d530bff7 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:51.503964 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032a231-4c14-4de2-b834-68d9d530bff7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:51.520434 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1032a231-4c14-4de2-b834-68d9d530bff7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:51.525860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-1032a231-4c14-4de2-b834-68d9d530bff7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:39:51.525860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:51.525860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:51.525860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:51.525860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:51.525860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:51.525860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:51.525860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:51.525860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:51.525860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:51.525860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:51.525860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:51.525860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:51.525860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:51.525860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:51.525860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:51.527108 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:51.527108 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:51.527108 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:51.527108 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:51.527108 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:51.527108 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:51.527108 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:51.527108 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:51.527108 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:51.527108 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:51.527108 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:51.527108 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:51.527108 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:51.527108 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:51.527108 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:51.527108 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:51.527972 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:51.527972 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:51.527972 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:51.527972 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:51.527972 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:51.527972 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:51.527972 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:51.527972 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:51.527972 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:51.527972 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:51.527972 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:39:51.527972 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:39:51.527972 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 616/1235] 10.222.0.49 () {56 vars in 1102 bytes} [Wed Aug 24 04:39:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:51.534325 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceedcf9-76cd-4789-ae63-05ed6fdeccad None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:51.590705 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:51.650071 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceedcf9-76cd-4789-ae63-05ed6fdeccad None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:51.685110 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5db6c-624e-43b7-a7ce-e55bb7f1261f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:51.685886 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5db6c-624e-43b7-a7ce-e55bb7f1261f None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:51.686157 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5db6c-624e-43b7-a7ce-e55bb7f1261f None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:51.686453 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5db6c-624e-43b7-a7ce-e55bb7f1261f None admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:51.687083 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d5db6c-624e-43b7-a7ce-e55bb7f1261f None admin] RBAC: Adding query filter params (name=service) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:51.687380 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d5db6c-624e-43b7-a7ce-e55bb7f1261f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:51.688938 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d5db6c-624e-43b7-a7ce-e55bb7f1261f None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:51.697856 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 620/1236] 10.222.0.49 () {56 vars in 1103 bytes} [Wed Aug 24 04:39:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:51.704340 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032a231-4c14-4de2-b834-68d9d530bff7 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:51.793887 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:51.811792 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032a231-4c14-4de2-b834-68d9d530bff7 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:51.850498 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf794f2-e497-4e48-b94b-4dda34ab3069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:51.851145 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf794f2-e497-4e48-b94b-4dda34ab3069 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:51.851418 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf794f2-e497-4e48-b94b-4dda34ab3069 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:51.851691 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf794f2-e497-4e48-b94b-4dda34ab3069 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:51.862289 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf794f2-e497-4e48-b94b-4dda34ab3069 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:51.863818 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf794f2-e497-4e48-b94b-4dda34ab3069 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:51.878826 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-8cf794f2-e497-4e48-b94b-4dda34ab3069 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:51.878826 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:51.878826 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:51.878826 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:51.878826 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:51.878826 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:51.878826 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:51.878826 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:51.878826 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:51.878826 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:51.878826 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:51.878826 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:51.878826 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:39:51.878826 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:39:51.878826 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:39:51.878826 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:39:51.880006 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:51.880006 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:51.880006 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:51.880006 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:51.880006 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:51.880006 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:51.880006 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:51.880006 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:51.880006 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:51.880006 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:51.880006 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:51.880006 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:51.880006 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:51.880006 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:51.880006 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:51.880006 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:51.880006 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:39:51.880909 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:39:51.880909 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:51.880909 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:39:51.880909 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 617/1237] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:51.886640 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5db6c-624e-43b7-a7ce-e55bb7f1261f None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:51.992307 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5db6c-624e-43b7-a7ce-e55bb7f1261f None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:52.004753 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:52.037402 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519ba79-f8d1-4221-9471-8d2b0d0b32cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:52.038157 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519ba79-f8d1-4221-9471-8d2b0d0b32cb None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:52.038462 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519ba79-f8d1-4221-9471-8d2b0d0b32cb None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:52.038712 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519ba79-f8d1-4221-9471-8d2b0d0b32cb None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:52.039430 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519ba79-f8d1-4221-9471-8d2b0d0b32cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:52.039728 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519ba79-f8d1-4221-9471-8d2b0d0b32cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:52.041178 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519ba79-f8d1-4221-9471-8d2b0d0b32cb None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:52.054237 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 621/1238] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:52.060379 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf794f2-e497-4e48-b94b-4dda34ab3069 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:52.171068 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf794f2-e497-4e48-b94b-4dda34ab3069 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:52.205058 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebca7c0-5cce-4ce7-90a4-8dddcd6d2030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:52.205725 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebca7c0-5cce-4ce7-90a4-8dddcd6d2030 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:52.206000 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebca7c0-5cce-4ce7-90a4-8dddcd6d2030 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:52.206274 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebca7c0-5cce-4ce7-90a4-8dddcd6d2030 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:52.209193 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:52.214432 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebca7c0-5cce-4ce7-90a4-8dddcd6d2030 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:52.216071 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebca7c0-5cce-4ce7-90a4-8dddcd6d2030 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:52.228273 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-5ebca7c0-5cce-4ce7-90a4-8dddcd6d2030 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:39:52.228273 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:52.228273 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:52.228273 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:52.228273 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:52.228273 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:52.228273 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:52.228273 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:52.228273 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:52.228273 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:52.228273 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:52.228273 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:52.228273 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:39:52.228273 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:39:52.228273 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:39:52.228273 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:39:52.229249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:52.229249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:52.229249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:39:52.229249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:39:52.229249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:39:52.229249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:39:52.229249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:52.229249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:52.229249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:52.229249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:52.229249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:52.229249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:52.229249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:52.229249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:52.229249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:52.229249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:52.229249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:52.229249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:52.230574 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:52.230574 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:52.230574 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:39:52.230574 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:39:52.230574 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:39:52.230574 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:39:52.230574 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:39:52.230574 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:39:52.230574 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:39:52.230574 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:39:52.230574 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 618/1239] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:52.235991 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519ba79-f8d1-4221-9471-8d2b0d0b32cb None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:52.345796 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519ba79-f8d1-4221-9471-8d2b0d0b32cb None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:52.384100 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124336f-0e42-4f50-938b-f229d8baf5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:52.384696 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124336f-0e42-4f50-938b-f229d8baf5f2 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:52.384982 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124336f-0e42-4f50-938b-f229d8baf5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:52.385273 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d124336f-0e42-4f50-938b-f229d8baf5f2 None admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:52.386036 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d124336f-0e42-4f50-938b-f229d8baf5f2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:52.386317 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d124336f-0e42-4f50-938b-f229d8baf5f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:52.387737 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d124336f-0e42-4f50-938b-f229d8baf5f2 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:52.406085 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 622/1240] 10.222.0.49 () {56 vars in 1143 bytes} [Wed Aug 24 04:39:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:52.412813 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebca7c0-5cce-4ce7-90a4-8dddcd6d2030 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:52.530748 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebca7c0-5cce-4ce7-90a4-8dddcd6d2030 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:52.575095 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274c9b0-f45c-451d-8b35-6e6c2f4b5c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:52.575725 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274c9b0-f45c-451d-8b35-6e6c2f4b5c39 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:52.576070 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274c9b0-f45c-451d-8b35-6e6c2f4b5c39 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:52.576342 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274c9b0-f45c-451d-8b35-6e6c2f4b5c39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:52.651541 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:52.662235 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274c9b0-f45c-451d-8b35-6e6c2f4b5c39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:52.664042 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274c9b0-f45c-451d-8b35-6e6c2f4b5c39 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:52.772213 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 619/1241] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:39:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:39:52.778562 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124336f-0e42-4f50-938b-f229d8baf5f2 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:52.808525 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:52.887942 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d124336f-0e42-4f50-938b-f229d8baf5f2 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:52.926078 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c757d51-7c82-4482-9cea-16677b4af6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:52.926661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c757d51-7c82-4482-9cea-16677b4af6ce None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:52.926940 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c757d51-7c82-4482-9cea-16677b4af6ce None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:52.927217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c757d51-7c82-4482-9cea-16677b4af6ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:52.939605 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c757d51-7c82-4482-9cea-16677b4af6ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:52.941082 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c757d51-7c82-4482-9cea-16677b4af6ce None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:52.957509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-4c757d51-7c82-4482-9cea-16677b4af6ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:52.957509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:52.957509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:52.957509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:52.957509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:52.957509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:52.957509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:52.957509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:52.957509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:52.957509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:52.957509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:52.957509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:52.957509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:39:52.957509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:39:52.957509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:39:52.957509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:39:52.958709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:52.958709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:52.958709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:52.958709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:52.958709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:52.958709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:52.958709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:52.958709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:52.958709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:52.958709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:52.958709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:52.958709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:52.958709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:52.958709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:52.958709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:52.958709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:52.958709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:39:52.959841 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:39:52.959841 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:52.959841 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:39:52.959841 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 623/1242] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:52.964956 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274c9b0-f45c-451d-8b35-6e6c2f4b5c39 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:53.092106 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:53.100141 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274c9b0-f45c-451d-8b35-6e6c2f4b5c39 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:53.140148 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1abe3-2904-49ed-ab07-fc1c5b6df864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:53.140786 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1abe3-2904-49ed-ab07-fc1c5b6df864 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:53.141062 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1abe3-2904-49ed-ab07-fc1c5b6df864 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:53.141372 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc1abe3-2904-49ed-ab07-fc1c5b6df864 None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:53.142325 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1abe3-2904-49ed-ab07-fc1c5b6df864 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:53.142636 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1abe3-2904-49ed-ab07-fc1c5b6df864 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:53.144222 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc1abe3-2904-49ed-ab07-fc1c5b6df864 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:53.157890 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 620/1243] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:53.164155 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c757d51-7c82-4482-9cea-16677b4af6ce None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:53.253363 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:53.284507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c757d51-7c82-4482-9cea-16677b4af6ce None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:53.327632 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35525b0c-0853-45f0-a4d3-2a8fd04198ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:53.328290 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35525b0c-0853-45f0-a4d3-2a8fd04198ef None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:53.328560 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35525b0c-0853-45f0-a4d3-2a8fd04198ef None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:53.328885 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35525b0c-0853-45f0-a4d3-2a8fd04198ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:53.336248 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35525b0c-0853-45f0-a4d3-2a8fd04198ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:53.337814 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35525b0c-0853-45f0-a4d3-2a8fd04198ef None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:53.349899 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-35525b0c-0853-45f0-a4d3-2a8fd04198ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:39:53.349899 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:53.349899 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:53.349899 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:53.349899 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:53.349899 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:53.349899 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:53.349899 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:53.349899 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:53.349899 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:53.349899 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:53.349899 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:53.349899 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:39:53.349899 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:39:53.349899 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:39:53.350942 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:39:53.350942 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:53.350942 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:53.350942 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:53.350942 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:53.350942 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:53.350942 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:53.350942 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:53.350942 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:53.350942 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:53.350942 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:53.350942 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:53.350942 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:53.350942 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:53.350942 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:53.350942 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:53.350942 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:53.351854 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:39:53.351854 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:39:53.351854 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:39:53.351854 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:39:53.351854 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:39:53.351854 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:39:53.351854 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:39:53.351854 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:39:53.351854 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 624/1244] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:39:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:53.357856 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1abe3-2904-49ed-ab07-fc1c5b6df864 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:53.474637 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc1abe3-2904-49ed-ab07-fc1c5b6df864 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:53.511870 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3431f-e69a-45c8-910e-774547d6f536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:53.512398 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3431f-e69a-45c8-910e-774547d6f536 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:53.512722 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3431f-e69a-45c8-910e-774547d6f536 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:53.512939 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3431f-e69a-45c8-910e-774547d6f536 None admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:53.513658 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3431f-e69a-45c8-910e-774547d6f536 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:53.513960 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3431f-e69a-45c8-910e-774547d6f536 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:53.515394 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3431f-e69a-45c8-910e-774547d6f536 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:53.528093 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 621/1245] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 24 04:39:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:53.535472 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35525b0c-0853-45f0-a4d3-2a8fd04198ef None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:53.658803 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35525b0c-0853-45f0-a4d3-2a8fd04198ef None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:53.696321 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a2793-c50d-4352-bb7a-5b5c57a67634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:53.697070 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a2793-c50d-4352-bb7a-5b5c57a67634 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:53.697511 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a2793-c50d-4352-bb7a-5b5c57a67634 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:53.697929 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a2793-c50d-4352-bb7a-5b5c57a67634 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:53.698841 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a2793-c50d-4352-bb7a-5b5c57a67634 None admin] RBAC: Adding query filter params (role.id=d62916d0c54540b3859985d5d3565718, scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62, user.id=edf1b960a2eb4e5e9ada736b5f3f5810) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:53.699286 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a2793-c50d-4352-bb7a-5b5c57a67634 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:53.700812 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a2793-c50d-4352-bb7a-5b5c57a67634 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:53.707725 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 625/1246] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:39:53 2022] GET /identity/v3/role_assignments?user.id=edf1b960a2eb4e5e9ada736b5f3f5810&scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62&role.id=d62916d0c54540b3859985d5d3565718 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:55.741864 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c20700-c717-4d9c-8666-5a9bca637b90 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:55.742463 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c20700-c717-4d9c-8666-5a9bca637b90 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:55.742463 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c20700-c717-4d9c-8666-5a9bca637b90 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:55.743793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 622/1247] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:55.753374 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5696599-72ce-4382-b133-4dcaf72308ea None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:55.753374 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5696599-72ce-4382-b133-4dcaf72308ea None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:55.753374 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5696599-72ce-4382-b133-4dcaf72308ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:55.760158 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:55.775316 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-b5696599-72ce-4382-b133-4dcaf72308ea None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:55.776507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-b5696599-72ce-4382-b133-4dcaf72308ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:55.861491 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 626/1248] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:39:56.127448 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c20700-c717-4d9c-8666-5a9bca637b90 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:56.148759 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:56.262960 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c20700-c717-4d9c-8666-5a9bca637b90 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:56.304431 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d127ba-ff28-4a4e-bd32-a4190189eca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:56.305079 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d127ba-ff28-4a4e-bd32-a4190189eca0 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:56.305606 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d127ba-ff28-4a4e-bd32-a4190189eca0 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:56.305930 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d127ba-ff28-4a4e-bd32-a4190189eca0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:56.320158 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d127ba-ff28-4a4e-bd32-a4190189eca0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:56.325252 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-b5d127ba-ff28-4a4e-bd32-a4190189eca0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:39:56.325252 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:56.325252 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:56.325252 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:56.325252 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:56.325252 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:56.325252 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:56.325252 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:56.325252 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:56.325252 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:56.325252 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:56.325252 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:56.325252 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:56.325252 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:56.325252 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:56.325252 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:56.326442 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:56.326442 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:56.326442 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:56.326442 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:56.326442 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:56.326442 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:56.326442 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:56.326442 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:56.326442 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:56.326442 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:56.326442 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:56.326442 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:56.326442 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:56.326442 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:56.326442 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:56.326442 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:56.327472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:56.327472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:56.327472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:56.327472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:56.327472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:56.327472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:56.327472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:56.327472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:56.327472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:56.327472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:56.327472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:39:56.327472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:39:56.327472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 623/1249] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 24 04:39:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:56.333216 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5696599-72ce-4382-b133-4dcaf72308ea None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:56.457854 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5696599-72ce-4382-b133-4dcaf72308ea None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:56.487407 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:56.492504 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d9845-d834-4849-94f8-80f063377504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:56.493461 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d9845-d834-4849-94f8-80f063377504 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:56.493882 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d9845-d834-4849-94f8-80f063377504 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:56.494588 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d9845-d834-4849-94f8-80f063377504 None admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:56.495751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d9845-d834-4849-94f8-80f063377504 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:56.496067 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d9845-d834-4849-94f8-80f063377504 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:56.497774 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d9845-d834-4849-94f8-80f063377504 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:56.509374 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 627/1250] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:39:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:56.514429 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d127ba-ff28-4a4e-bd32-a4190189eca0 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:56.630698 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:56.667185 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d127ba-ff28-4a4e-bd32-a4190189eca0 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:56.712175 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca577d9-3dc4-473b-8997-f949b1341bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:56.712907 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca577d9-3dc4-473b-8997-f949b1341bb8 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:56.713507 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca577d9-3dc4-473b-8997-f949b1341bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:56.713890 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca577d9-3dc4-473b-8997-f949b1341bb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:56.727295 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca577d9-3dc4-473b-8997-f949b1341bb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:56.729089 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca577d9-3dc4-473b-8997-f949b1341bb8 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:56.747929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-9ca577d9-3dc4-473b-8997-f949b1341bb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:56.747929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:56.747929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:56.747929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:56.747929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:56.747929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:56.747929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:56.747929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:56.747929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:56.747929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:56.747929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:56.747929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:56.747929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:39:56.747929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:39:56.747929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:39:56.747929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:39:56.749595 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:56.749595 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:56.749595 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:56.749595 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:56.749595 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:56.749595 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:56.749595 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:56.749595 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:56.749595 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:56.749595 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:56.749595 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:56.749595 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:56.749595 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:56.749595 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:56.749595 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:56.749595 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:56.749595 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:39:56.750583 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:39:56.750583 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:56.750583 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:39:56.750583 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 624/1251] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:39:56.755842 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d9845-d834-4849-94f8-80f063377504 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:56.878226 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d9845-d834-4849-94f8-80f063377504 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:56.919877 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d85c2-db59-4037-ad01-485f855eb4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:56.920505 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d85c2-db59-4037-ad01-485f855eb4b0 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:56.920786 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d85c2-db59-4037-ad01-485f855eb4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:56.921050 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d85c2-db59-4037-ad01-485f855eb4b0 None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:56.921751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d85c2-db59-4037-ad01-485f855eb4b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:56.922057 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d85c2-db59-4037-ad01-485f855eb4b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:56.923516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d85c2-db59-4037-ad01-485f855eb4b0 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:56.937075 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 628/1252] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:39:56.943483 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca577d9-3dc4-473b-8997-f949b1341bb8 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:57.055497 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca577d9-3dc4-473b-8997-f949b1341bb8 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:57.085133 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:57.093139 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b27a7-b2bb-4714-8870-c16af050b380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:57.093869 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b27a7-b2bb-4714-8870-c16af050b380 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:57.094144 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b27a7-b2bb-4714-8870-c16af050b380 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:57.094416 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b27a7-b2bb-4714-8870-c16af050b380 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:57.103905 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b27a7-b2bb-4714-8870-c16af050b380 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:57.105535 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b27a7-b2bb-4714-8870-c16af050b380 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:57.117473 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-9e2b27a7-b2bb-4714-8870-c16af050b380 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:39:57.117473 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:57.117473 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:57.117473 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:57.117473 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:57.117473 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:57.117473 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:57.117473 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:57.117473 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:57.117473 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:57.117473 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:57.117473 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:57.117473 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:39:57.117473 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:39:57.117473 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:39:57.117473 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:39:57.118462 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:57.118462 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:57.118462 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:39:57.118462 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:39:57.118462 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:39:57.118462 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:39:57.118462 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:57.118462 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:57.118462 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:57.118462 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:57.118462 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:57.118462 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:57.118462 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:57.118462 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:57.118462 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:57.118462 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:57.118462 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:57.118462 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:57.119860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:57.119860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:57.119860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:39:57.119860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:39:57.119860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:39:57.119860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:39:57.119860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:39:57.119860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:39:57.119860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:39:57.119860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:39:57.119860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 625/1253] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:39:57.124860 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d85c2-db59-4037-ad01-485f855eb4b0 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:57.194739 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:57.254439 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d85c2-db59-4037-ad01-485f855eb4b0 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:57.296137 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c71847-b95a-4d83-8db2-69d114fc5223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:57.296848 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c71847-b95a-4d83-8db2-69d114fc5223 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:57.297035 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c71847-b95a-4d83-8db2-69d114fc5223 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:57.297305 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c71847-b95a-4d83-8db2-69d114fc5223 None admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:57.298174 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c71847-b95a-4d83-8db2-69d114fc5223 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:57.298513 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c71847-b95a-4d83-8db2-69d114fc5223 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:57.299970 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c71847-b95a-4d83-8db2-69d114fc5223 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:57.324217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 629/1254] 10.222.0.49 () {56 vars in 1143 bytes} [Wed Aug 24 04:39:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:57.325772 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b27a7-b2bb-4714-8870-c16af050b380 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:57.447914 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b27a7-b2bb-4714-8870-c16af050b380 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:57.501612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801d145-216b-488e-9e32-be5aa86e8f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:57.502370 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801d145-216b-488e-9e32-be5aa86e8f55 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:57.502710 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801d145-216b-488e-9e32-be5aa86e8f55 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:57.503023 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801d145-216b-488e-9e32-be5aa86e8f55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:57.572263 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:57.595545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801d145-216b-488e-9e32-be5aa86e8f55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:57.597128 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801d145-216b-488e-9e32-be5aa86e8f55 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:57.735577 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 626/1255] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:39:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:39:57.743912 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c71847-b95a-4d83-8db2-69d114fc5223 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:57.880483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c71847-b95a-4d83-8db2-69d114fc5223 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:57.897209 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:57.920309 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24148396-9ba8-473c-8c54-d8704ffecad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:57.920988 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24148396-9ba8-473c-8c54-d8704ffecad2 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:57.921282 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24148396-9ba8-473c-8c54-d8704ffecad2 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:57.921652 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24148396-9ba8-473c-8c54-d8704ffecad2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:57.932672 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24148396-9ba8-473c-8c54-d8704ffecad2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:57.934210 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24148396-9ba8-473c-8c54-d8704ffecad2 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:57.949975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-24148396-9ba8-473c-8c54-d8704ffecad2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:57.949975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:57.949975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:57.949975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:57.949975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:57.949975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:57.949975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:57.949975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:57.949975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:57.949975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:57.949975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:57.949975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:57.949975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:39:57.949975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:39:57.949975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:39:57.949975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:39:57.951705 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:57.951705 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:57.951705 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:57.951705 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:57.951705 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:57.951705 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:57.951705 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:57.951705 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:57.951705 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:57.951705 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:57.951705 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:57.951705 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:57.951705 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:57.951705 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:57.951705 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:57.951705 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:57.951705 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:39:57.952740 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:39:57.952740 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:57.952740 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:39:57.952740 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 630/1256] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:39:57.957028 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801d145-216b-488e-9e32-be5aa86e8f55 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:58.055223 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:58.070086 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801d145-216b-488e-9e32-be5aa86e8f55 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:58.106641 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d182d28-ee91-4ace-8628-fd612d995754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:58.107251 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d182d28-ee91-4ace-8628-fd612d995754 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:58.107527 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d182d28-ee91-4ace-8628-fd612d995754 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:58.107798 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d182d28-ee91-4ace-8628-fd612d995754 None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:58.108451 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d182d28-ee91-4ace-8628-fd612d995754 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:58.108754 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d182d28-ee91-4ace-8628-fd612d995754 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:58.110228 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d182d28-ee91-4ace-8628-fd612d995754 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:58.122546 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 627/1257] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:58.127997 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24148396-9ba8-473c-8c54-d8704ffecad2 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:58.236550 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24148396-9ba8-473c-8c54-d8704ffecad2 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:58.274168 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf020b21-1e60-4cff-96a3-c8df1aba03ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:58.274835 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf020b21-1e60-4cff-96a3-c8df1aba03ac None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:58.275166 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf020b21-1e60-4cff-96a3-c8df1aba03ac None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:58.275505 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf020b21-1e60-4cff-96a3-c8df1aba03ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:58.282663 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf020b21-1e60-4cff-96a3-c8df1aba03ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:58.284130 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf020b21-1e60-4cff-96a3-c8df1aba03ac None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:58.295772 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-bf020b21-1e60-4cff-96a3-c8df1aba03ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:39:58.295772 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:58.295772 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:58.295772 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:58.295772 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:58.295772 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:58.295772 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:58.295772 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:58.295772 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:58.295772 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:58.295772 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:58.295772 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:58.295772 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:39:58.295772 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:39:58.295772 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:39:58.296920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:39:58.296920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:58.296920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:58.296920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:58.296920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:58.296920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:58.296920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:58.296920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:58.296920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:58.296920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:58.296920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:58.296920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:58.296920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:58.296920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:58.296920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:58.296920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:58.296920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:58.297970 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:39:58.297970 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:39:58.297970 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:39:58.297970 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:39:58.297970 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:39:58.297970 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:39:58.297970 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:39:58.297970 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:39:58.297970 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 631/1258] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:39:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:39:58.303353 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d182d28-ee91-4ace-8628-fd612d995754 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:58.412361 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d182d28-ee91-4ace-8628-fd612d995754 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:58.447839 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134663e-147f-4505-9288-1c24c3108972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:58.448477 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134663e-147f-4505-9288-1c24c3108972 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:58.448935 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134663e-147f-4505-9288-1c24c3108972 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:58.449199 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134663e-147f-4505-9288-1c24c3108972 None admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:58.450215 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134663e-147f-4505-9288-1c24c3108972 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:58.450524 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134663e-147f-4505-9288-1c24c3108972 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:58.451945 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1134663e-147f-4505-9288-1c24c3108972 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:58.464397 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 628/1259] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 24 04:39:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:58.470924 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf020b21-1e60-4cff-96a3-c8df1aba03ac None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:58.506645 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:58.605871 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf020b21-1e60-4cff-96a3-c8df1aba03ac None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:58.648895 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addfbd1-7216-4b6c-861e-c3ec3a613ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:58.649561 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addfbd1-7216-4b6c-861e-c3ec3a613ebd None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:58.649839 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addfbd1-7216-4b6c-861e-c3ec3a613ebd None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:58.650103 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addfbd1-7216-4b6c-861e-c3ec3a613ebd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:58.650828 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addfbd1-7216-4b6c-861e-c3ec3a613ebd None admin] RBAC: Adding query filter params (role.id=74ce7b72bcc94a8a8ad65c3db928e6ac, scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62, user.id=edf1b960a2eb4e5e9ada736b5f3f5810) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:58.651127 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addfbd1-7216-4b6c-861e-c3ec3a613ebd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:58.652595 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addfbd1-7216-4b6c-861e-c3ec3a613ebd None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:58.673457 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 632/1260] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:39:58 2022] GET /identity/v3/role_assignments?user.id=edf1b960a2eb4e5e9ada736b5f3f5810&scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62&role.id=74ce7b72bcc94a8a8ad65c3db928e6ac => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:00.563546 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94303662-e7af-41d7-9ccc-37ebfc239687 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:00.564152 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94303662-e7af-41d7-9ccc-37ebfc239687 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:00.564152 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94303662-e7af-41d7-9ccc-37ebfc239687 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:00.566277 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 629/1261] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:40:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:00.573093 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044a6c5-1ae3-4fd5-9580-ea8c24a75035 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:00.573668 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044a6c5-1ae3-4fd5-9580-ea8c24a75035 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:00.573668 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044a6c5-1ae3-4fd5-9580-ea8c24a75035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:00.596096 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-d044a6c5-1ae3-4fd5-9580-ea8c24a75035 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:00.597830 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-d044a6c5-1ae3-4fd5-9580-ea8c24a75035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:00.672013 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 633/1262] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:40:00.933858 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94303662-e7af-41d7-9ccc-37ebfc239687 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:00.946471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:01.055330 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94303662-e7af-41d7-9ccc-37ebfc239687 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:01.090713 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc392bd-9633-4a24-8b29-b2562f535ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:01.091329 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc392bd-9633-4a24-8b29-b2562f535ee8 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:01.091608 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc392bd-9633-4a24-8b29-b2562f535ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:01.091878 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc392bd-9633-4a24-8b29-b2562f535ee8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:01.103127 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc392bd-9633-4a24-8b29-b2562f535ee8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:01.107856 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-3bc392bd-9633-4a24-8b29-b2562f535ee8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:40:01.107856 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:01.107856 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:01.107856 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:01.107856 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:01.107856 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:01.107856 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:01.107856 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:01.107856 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:01.107856 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:01.107856 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:01.107856 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:01.107856 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:01.107856 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:01.107856 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:01.107856 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:01.109021 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:01.109021 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:01.109021 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:01.109021 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:01.109021 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:01.109021 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:01.109021 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:01.109021 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:01.109021 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:01.109021 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:01.109021 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:01.109021 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:01.109021 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:01.109021 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:01.109021 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:01.109021 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:01.110177 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:01.110177 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:01.110177 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:01.110177 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:01.110177 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:01.110177 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:01.110177 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:01.110177 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:01.110177 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:01.110177 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:01.110177 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:40:01.110177 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:40:01.110177 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 630/1263] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 24 04:40:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:01.117808 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044a6c5-1ae3-4fd5-9580-ea8c24a75035 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:01.141934 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:01.225419 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044a6c5-1ae3-4fd5-9580-ea8c24a75035 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:01.260582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8238b2c-cd1c-4af2-9a13-c1bedd24d357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:01.261182 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8238b2c-cd1c-4af2-9a13-c1bedd24d357 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:01.261491 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8238b2c-cd1c-4af2-9a13-c1bedd24d357 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:01.261763 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8238b2c-cd1c-4af2-9a13-c1bedd24d357 None admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:01.262427 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8238b2c-cd1c-4af2-9a13-c1bedd24d357 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:01.262732 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8238b2c-cd1c-4af2-9a13-c1bedd24d357 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:01.264110 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8238b2c-cd1c-4af2-9a13-c1bedd24d357 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:01.272332 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 634/1264] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:40:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:01.278954 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc392bd-9633-4a24-8b29-b2562f535ee8 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:01.356385 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:01.394624 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc392bd-9633-4a24-8b29-b2562f535ee8 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:01.429256 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14703824-f4e7-4484-9a94-56a3a413ef3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:01.429896 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14703824-f4e7-4484-9a94-56a3a413ef3a None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:01.430178 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14703824-f4e7-4484-9a94-56a3a413ef3a None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:01.430440 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14703824-f4e7-4484-9a94-56a3a413ef3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:01.441027 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14703824-f4e7-4484-9a94-56a3a413ef3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:01.442499 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14703824-f4e7-4484-9a94-56a3a413ef3a None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:01.456683 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-14703824-f4e7-4484-9a94-56a3a413ef3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:01.456683 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:01.456683 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:01.456683 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:01.456683 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:01.456683 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:01.456683 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:01.456683 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:01.456683 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:01.456683 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:01.456683 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:01.456683 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:01.456683 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:01.456683 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:01.456683 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:01.456683 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:01.457820 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:01.457820 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:01.457820 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:01.457820 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:01.457820 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:01.457820 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:01.457820 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:01.457820 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:01.457820 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:01.457820 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:01.457820 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:01.457820 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:01.457820 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:01.457820 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:01.457820 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:01.457820 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:01.457820 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:01.458707 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:01.458707 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:01.458707 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:40:01.458707 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 631/1265] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:01.464594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8238b2c-cd1c-4af2-9a13-c1bedd24d357 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:01.574435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:01.595446 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8238b2c-cd1c-4af2-9a13-c1bedd24d357 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:01.629888 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c4bb6-4b5c-4005-94aa-8af64b310492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:01.630488 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c4bb6-4b5c-4005-94aa-8af64b310492 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:01.630768 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c4bb6-4b5c-4005-94aa-8af64b310492 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:01.631045 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c4bb6-4b5c-4005-94aa-8af64b310492 None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:01.631729 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c4bb6-4b5c-4005-94aa-8af64b310492 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:01.632029 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c4bb6-4b5c-4005-94aa-8af64b310492 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:01.633446 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c4bb6-4b5c-4005-94aa-8af64b310492 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:01.645315 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 635/1266] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:01.651600 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14703824-f4e7-4484-9a94-56a3a413ef3a None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:01.760149 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14703824-f4e7-4484-9a94-56a3a413ef3a None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:01.780471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:01.796006 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d700326-1bc8-4eb8-8051-aeac35f7917a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:01.796628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d700326-1bc8-4eb8-8051-aeac35f7917a None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:01.796907 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d700326-1bc8-4eb8-8051-aeac35f7917a None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:01.797171 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d700326-1bc8-4eb8-8051-aeac35f7917a None admin] PATH_INFO: `/v3/users/placement` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:01.804997 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d700326-1bc8-4eb8-8051-aeac35f7917a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:01.806520 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d700326-1bc8-4eb8-8051-aeac35f7917a None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:01.821814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-0d700326-1bc8-4eb8-8051-aeac35f7917a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:40:01.821814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:01.821814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:01.821814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:01.821814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:01.821814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:01.821814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:01.821814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:01.821814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:01.821814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:01.821814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:01.821814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:01.821814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:40:01.821814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:40:01.821814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:40:01.821814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:40:01.822857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:01.822857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:01.822857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:40:01.822857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:01.822857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:40:01.822857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:01.822857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:01.822857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:01.822857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:01.822857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:01.822857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:01.822857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:01.822857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:01.822857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:01.822857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:01.822857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:01.822857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:01.822857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:01.823939 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:01.823939 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:01.823939 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:40:01.823939 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:40:01.823939 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:40:01.823939 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:40:01.823939 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:40:01.823939 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:40:01.823939 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:40:01.823939 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:40:01.823939 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 632/1267] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:01.829079 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c4bb6-4b5c-4005-94aa-8af64b310492 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:01.937391 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c4bb6-4b5c-4005-94aa-8af64b310492 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:01.977837 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf4439-314d-4643-a700-237e08262396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:01.978435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf4439-314d-4643-a700-237e08262396 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:01.978710 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf4439-314d-4643-a700-237e08262396 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:01.978984 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf4439-314d-4643-a700-237e08262396 None admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:01.979720 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf4439-314d-4643-a700-237e08262396 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:01.980030 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf4439-314d-4643-a700-237e08262396 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:01.981490 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf4439-314d-4643-a700-237e08262396 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:01.990457 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:01.999701 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 636/1268] 10.222.0.49 () {56 vars in 1143 bytes} [Wed Aug 24 04:40:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:02.008329 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d700326-1bc8-4eb8-8051-aeac35f7917a None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:02.116734 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d700326-1bc8-4eb8-8051-aeac35f7917a None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:02.153557 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b4f71-2c6f-4735-997c-184fd2fee184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:02.154240 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b4f71-2c6f-4735-997c-184fd2fee184 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:02.154518 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b4f71-2c6f-4735-997c-184fd2fee184 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:02.154786 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b4f71-2c6f-4735-997c-184fd2fee184 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:02.165681 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b4f71-2c6f-4735-997c-184fd2fee184 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:02.167168 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b4f71-2c6f-4735-997c-184fd2fee184 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:02.181628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-434b4f71-2c6f-4735-997c-184fd2fee184 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:02.181628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:02.181628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:02.181628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:02.181628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:02.181628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:02.181628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:02.181628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:02.181628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:02.181628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:02.181628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:02.181628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:02.181628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:02.181628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:02.181628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:02.181628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:02.182673 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:02.182673 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:02.182673 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:02.182673 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:02.182673 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:02.182673 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:02.182673 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:02.182673 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:02.182673 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:02.182673 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:02.182673 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:02.182673 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:02.182673 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:02.182673 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:02.182673 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:02.182673 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:02.182673 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:02.183551 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:02.183551 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:02.183551 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:40:02.183551 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 633/1269] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:02.191250 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf4439-314d-4643-a700-237e08262396 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:02.305494 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf4439-314d-4643-a700-237e08262396 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:02.341113 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daacce4-0fcc-4021-9c23-b58066c852c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:02.341741 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daacce4-0fcc-4021-9c23-b58066c852c7 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:02.342022 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daacce4-0fcc-4021-9c23-b58066c852c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:02.342260 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daacce4-0fcc-4021-9c23-b58066c852c7 None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:02.342922 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daacce4-0fcc-4021-9c23-b58066c852c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:02.343227 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daacce4-0fcc-4021-9c23-b58066c852c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:02.344622 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daacce4-0fcc-4021-9c23-b58066c852c7 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:02.356283 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 637/1270] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:02.362298 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b4f71-2c6f-4735-997c-184fd2fee184 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:02.395602 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:02.476225 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b4f71-2c6f-4735-997c-184fd2fee184 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:02.515869 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e1c06-3297-4817-a7fb-b502614d672e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:02.516486 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e1c06-3297-4817-a7fb-b502614d672e None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:02.516757 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e1c06-3297-4817-a7fb-b502614d672e None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:02.517022 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e1c06-3297-4817-a7fb-b502614d672e None admin] PATH_INFO: `/v3/projects/service` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:02.524460 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e1c06-3297-4817-a7fb-b502614d672e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:02.525925 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8e1c06-3297-4817-a7fb-b502614d672e None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:02.537828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-6e8e1c06-3297-4817-a7fb-b502614d672e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:02.537828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:02.537828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:02.537828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:02.537828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:02.537828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:02.537828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:02.537828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:02.537828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:02.537828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:02.537828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:02.537828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:02.537828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:40:02.537828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:40:02.537828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:40:02.538857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:40:02.538857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:02.538857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:02.538857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:02.538857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:02.538857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:02.538857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:02.538857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:02.538857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:02.538857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:02.538857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:02.538857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:02.538857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:02.538857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:02.538857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:02.538857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:02.538857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:02.539897 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:40:02.539897 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:40:02.539897 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:40:02.539897 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:40:02.539897 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:40:02.539897 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:40:02.539897 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:02.539897 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:40:02.539897 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 634/1271] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:40:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:02.545693 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daacce4-0fcc-4021-9c23-b58066c852c7 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:02.613688 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:02.655902 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daacce4-0fcc-4021-9c23-b58066c852c7 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:02.690558 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4eca87-0de3-4f86-97b5-7740f2472510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:02.691155 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4eca87-0de3-4f86-97b5-7740f2472510 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:02.691437 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4eca87-0de3-4f86-97b5-7740f2472510 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:02.691707 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4eca87-0de3-4f86-97b5-7740f2472510 None admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:02.692408 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4eca87-0de3-4f86-97b5-7740f2472510 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:02.692715 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4eca87-0de3-4f86-97b5-7740f2472510 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:02.694246 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4eca87-0de3-4f86-97b5-7740f2472510 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:02.706282 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 638/1272] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 24 04:40:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:02.713988 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e1c06-3297-4817-a7fb-b502614d672e None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:02.810767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:02.827384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8e1c06-3297-4817-a7fb-b502614d672e None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:02.866899 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb48398c-024b-4d30-93e8-3facacab029c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:02.867587 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48398c-024b-4d30-93e8-3facacab029c None admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:02.867865 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48398c-024b-4d30-93e8-3facacab029c None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:02.868128 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48398c-024b-4d30-93e8-3facacab029c None admin] PATH_INFO: `/v3/projects/08755f450e6c47dcaaaa754a6aa2ec62/users/edf1b960a2eb4e5e9ada736b5f3f5810/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:02.870276 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb48398c-024b-4d30-93e8-3facacab029c None admin] RBAC: Authorizing `identity:create_grant(project_id=08755f450e6c47dcaaaa754a6aa2ec62, user_id=edf1b960a2eb4e5e9ada736b5f3f5810, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:02.871733 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb48398c-024b-4d30-93e8-3facacab029c None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:02.891451 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 635/1273] 10.222.0.49 () {58 vars in 1439 bytes} [Wed Aug 24 04:40:02 2022] PUT /identity/v3/projects/08755f450e6c47dcaaaa754a6aa2ec62/users/edf1b960a2eb4e5e9ada736b5f3f5810/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:40:04.763526 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59185b21-5da2-44e7-88c2-4c43a2db5b3c None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:04.764103 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59185b21-5da2-44e7-88c2-4c43a2db5b3c None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:04.764103 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59185b21-5da2-44e7-88c2-4c43a2db5b3c None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:04.766179 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 639/1274] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:40:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:04.774177 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57af3da-8c29-488d-aa63-98ba24ebdd15 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:04.774641 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57af3da-8c29-488d-aa63-98ba24ebdd15 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:04.774747 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57af3da-8c29-488d-aa63-98ba24ebdd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:04.794420 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-b57af3da-8c29-488d-aa63-98ba24ebdd15 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:04.795657 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-b57af3da-8c29-488d-aa63-98ba24ebdd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:04.870128 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 636/1275] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:40:05.140594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59185b21-5da2-44e7-88c2-4c43a2db5b3c None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:05.250846 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59185b21-5da2-44e7-88c2-4c43a2db5b3c None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:05.269267 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:05.287283 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e7fa23-4f2f-4c5a-a71e-88e7ff24c8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:05.287906 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7fa23-4f2f-4c5a-a71e-88e7ff24c8c4 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:05.288286 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7fa23-4f2f-4c5a-a71e-88e7ff24c8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:05.288575 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7fa23-4f2f-4c5a-a71e-88e7ff24c8c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:05.304417 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e7fa23-4f2f-4c5a-a71e-88e7ff24c8c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:05.309095 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-a5e7fa23-4f2f-4c5a-a71e-88e7ff24c8c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:40:05.309095 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:05.309095 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:05.309095 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:05.309095 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:05.309095 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:05.309095 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:05.309095 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:05.309095 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:05.309095 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:05.309095 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:05.309095 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:05.309095 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:05.309095 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:05.309095 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:05.309095 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:05.310174 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:05.310174 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:05.310174 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:05.310174 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:05.310174 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:05.310174 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:05.310174 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:05.310174 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:05.310174 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:05.310174 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:05.310174 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:05.310174 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:05.310174 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:05.310174 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:05.310174 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:05.310174 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:05.311161 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:05.311161 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:05.311161 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:05.311161 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:05.311161 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:05.311161 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:05.311161 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:05.311161 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:05.311161 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:05.311161 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:05.311161 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:40:05.311161 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:40:05.313517 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 640/1276] 10.222.0.49 () {56 vars in 1096 bytes} [Wed Aug 24 04:40:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:05.316971 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57af3da-8c29-488d-aa63-98ba24ebdd15 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:05.403712 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:05.423476 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57af3da-8c29-488d-aa63-98ba24ebdd15 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:05.458392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b57c82-9df8-4700-bee2-f00f66fc259b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:05.458982 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b57c82-9df8-4700-bee2-f00f66fc259b None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:05.459255 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b57c82-9df8-4700-bee2-f00f66fc259b None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:05.459533 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b57c82-9df8-4700-bee2-f00f66fc259b None admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:05.460217 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b57c82-9df8-4700-bee2-f00f66fc259b None admin] RBAC: Adding query filter params (name=admin) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:05.460508 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b57c82-9df8-4700-bee2-f00f66fc259b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:05.462078 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b57c82-9df8-4700-bee2-f00f66fc259b None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:05.470113 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 637/1277] 10.222.0.49 () {56 vars in 1099 bytes} [Wed Aug 24 04:40:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:05.476539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e7fa23-4f2f-4c5a-a71e-88e7ff24c8c4 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:05.605301 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e7fa23-4f2f-4c5a-a71e-88e7ff24c8c4 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:05.645624 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54fab8-cfb9-480a-97d4-a3e7abc7ded1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:05.646175 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54fab8-cfb9-480a-97d4-a3e7abc7ded1 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:05.646512 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54fab8-cfb9-480a-97d4-a3e7abc7ded1 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:05.646912 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54fab8-cfb9-480a-97d4-a3e7abc7ded1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:05.663961 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54fab8-cfb9-480a-97d4-a3e7abc7ded1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:05.665393 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54fab8-cfb9-480a-97d4-a3e7abc7ded1 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:05.680144 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-fc54fab8-cfb9-480a-97d4-a3e7abc7ded1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:05.680144 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:05.680144 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:05.680144 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:05.680144 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:05.680144 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:05.680144 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:05.680144 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:05.680144 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:05.680144 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:05.680144 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:05.680144 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:05.680144 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:05.680144 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:05.680144 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:05.680144 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:05.681219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:05.681219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:05.681219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:05.681219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:05.681219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:05.681219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:05.681219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:05.681219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:05.681219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:05.681219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:05.681219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:05.681219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:05.681219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:05.681219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:05.681219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:05.681219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:05.681219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:05.682392 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:05.682392 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:05.682392 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:40:05.682392 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 641/1278] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:05.689177 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b57c82-9df8-4700-bee2-f00f66fc259b None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:05.805559 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b57c82-9df8-4700-bee2-f00f66fc259b None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:05.843718 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a8022-8c24-494c-a84c-0ff373ee4484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:05.844313 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a8022-8c24-494c-a84c-0ff373ee4484 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:05.844591 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a8022-8c24-494c-a84c-0ff373ee4484 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:05.844862 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a8022-8c24-494c-a84c-0ff373ee4484 None admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:05.845539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a8022-8c24-494c-a84c-0ff373ee4484 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:05.845841 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a8022-8c24-494c-a84c-0ff373ee4484 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:05.847213 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a8022-8c24-494c-a84c-0ff373ee4484 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:05.859407 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 638/1279] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:05.868129 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54fab8-cfb9-480a-97d4-a3e7abc7ded1 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:05.900079 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:05.974260 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54fab8-cfb9-480a-97d4-a3e7abc7ded1 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:06.009383 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b73a5-1a10-476d-a886-8c0dbdecb923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:06.010004 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b73a5-1a10-476d-a886-8c0dbdecb923 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:06.010274 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b73a5-1a10-476d-a886-8c0dbdecb923 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:06.010540 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2b73a5-1a10-476d-a886-8c0dbdecb923 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:06.018077 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b73a5-1a10-476d-a886-8c0dbdecb923 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:06.019508 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2b73a5-1a10-476d-a886-8c0dbdecb923 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:06.030726 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-1a2b73a5-1a10-476d-a886-8c0dbdecb923 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:40:06.030726 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:06.030726 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:06.030726 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:06.030726 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:06.030726 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:06.030726 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:06.030726 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:06.030726 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:06.030726 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:06.030726 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:06.030726 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:06.030726 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:40:06.030726 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:40:06.030726 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:40:06.030726 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:40:06.031891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:06.031891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:06.031891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:40:06.031891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:06.031891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:40:06.031891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:06.031891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:06.031891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:06.031891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:06.031891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:06.031891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:06.031891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:06.031891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:06.031891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:06.031891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:06.031891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:06.031891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:06.031891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:06.033012 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:06.033012 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:06.033012 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:40:06.033012 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:40:06.033012 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:40:06.033012 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:40:06.033012 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:40:06.033012 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:40:06.033012 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:40:06.033012 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:40:06.033012 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 642/1280] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:06.037765 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a8022-8c24-494c-a84c-0ff373ee4484 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:06.041651 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:06.145374 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a8022-8c24-494c-a84c-0ff373ee4484 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:06.181497 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c733f0-dd4e-4800-8220-7afe16c2acc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:06.182108 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c733f0-dd4e-4800-8220-7afe16c2acc1 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:06.182386 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c733f0-dd4e-4800-8220-7afe16c2acc1 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:06.182657 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c733f0-dd4e-4800-8220-7afe16c2acc1 None admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:06.183394 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c733f0-dd4e-4800-8220-7afe16c2acc1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:06.183701 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c733f0-dd4e-4800-8220-7afe16c2acc1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:06.185124 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c733f0-dd4e-4800-8220-7afe16c2acc1 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:06.203089 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 639/1281] 10.222.0.49 () {56 vars in 1143 bytes} [Wed Aug 24 04:40:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:06.211669 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b73a5-1a10-476d-a886-8c0dbdecb923 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:06.305246 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:06.315836 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2b73a5-1a10-476d-a886-8c0dbdecb923 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:06.354120 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530b2e0-034f-4a45-bbfb-043345f70401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:06.354773 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530b2e0-034f-4a45-bbfb-043345f70401 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:06.355052 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530b2e0-034f-4a45-bbfb-043345f70401 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:06.355321 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530b2e0-034f-4a45-bbfb-043345f70401 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:06.429905 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530b2e0-034f-4a45-bbfb-043345f70401 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:06.431359 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1530b2e0-034f-4a45-bbfb-043345f70401 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:06.521601 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:06.533661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 643/1282] 10.222.0.49 () {58 vars in 1282 bytes} [Wed Aug 24 04:40:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 04:40:06.540486 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c733f0-dd4e-4800-8220-7afe16c2acc1 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:06.616046 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:06.658249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c733f0-dd4e-4800-8220-7afe16c2acc1 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:06.702112 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad00fc-f5b2-4881-9478-ede673f25c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:06.702739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad00fc-f5b2-4881-9478-ede673f25c06 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:06.703017 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad00fc-f5b2-4881-9478-ede673f25c06 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:06.703288 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad00fc-f5b2-4881-9478-ede673f25c06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:06.715044 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad00fc-f5b2-4881-9478-ede673f25c06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:06.716490 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad00fc-f5b2-4881-9478-ede673f25c06 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:06.732286 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-7bad00fc-f5b2-4881-9478-ede673f25c06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:06.732286 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:06.732286 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:06.732286 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:06.732286 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:06.732286 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:06.732286 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:06.732286 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:06.732286 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:06.732286 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:06.732286 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:06.732286 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:06.732286 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:06.732286 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:06.732286 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:06.732286 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:06.733518 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:06.733518 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:06.733518 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:06.733518 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:06.733518 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:06.733518 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:06.733518 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:06.733518 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:06.733518 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:06.733518 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:06.733518 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:06.733518 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:06.733518 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:06.733518 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:06.733518 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:06.733518 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:06.733518 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:06.734555 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:06.734555 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:06.734555 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:40:06.734555 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 640/1283] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:06.739581 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530b2e0-034f-4a45-bbfb-043345f70401 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:06.849323 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530b2e0-034f-4a45-bbfb-043345f70401 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:06.884789 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf45dd-b628-49e4-9dbe-1824204368b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:06.885422 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf45dd-b628-49e4-9dbe-1824204368b6 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:06.885566 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf45dd-b628-49e4-9dbe-1824204368b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:06.885863 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf45dd-b628-49e4-9dbe-1824204368b6 None admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:06.886504 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf45dd-b628-49e4-9dbe-1824204368b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:06.886797 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf45dd-b628-49e4-9dbe-1824204368b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:06.888169 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf45dd-b628-49e4-9dbe-1824204368b6 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:06.899374 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 644/1284] 10.222.0.49 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:06.905431 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad00fc-f5b2-4881-9478-ede673f25c06 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:07.010501 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad00fc-f5b2-4881-9478-ede673f25c06 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:07.026327 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:07.052350 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c818c-b79b-42b3-9c42-30dd7e767161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:07.053018 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c818c-b79b-42b3-9c42-30dd7e767161 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:07.053293 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c818c-b79b-42b3-9c42-30dd7e767161 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:07.053593 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c818c-b79b-42b3-9c42-30dd7e767161 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:07.061776 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c818c-b79b-42b3-9c42-30dd7e767161 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:07.063225 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c818c-b79b-42b3-9c42-30dd7e767161 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:07.074562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application [None req-4c8c818c-b79b-42b3-9c42-30dd7e767161 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:07.074562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:07.074562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:07.074562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:07.074562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:07.074562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:07.074562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:07.074562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:07.074562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:07.074562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:07.074562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:07.074562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:07.074562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:40:07.074562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:40:07.074562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:40:07.075621 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:40:07.075621 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:07.075621 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:07.075621 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:07.075621 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:07.075621 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:07.075621 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:07.075621 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:07.075621 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:07.075621 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:07.075621 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:07.075621 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:07.075621 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:07.075621 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:07.075621 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:07.075621 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:07.075621 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:07.076520 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:40:07.076520 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:40:07.076520 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:40:07.076520 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:40:07.076520 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:40:07.076520 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:40:07.076520 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:07.076520 dv-cinder-854265-1-smb devstack@keystone.service[93147]: ERROR keystone.server.flask.application Aug 24 04:40:07.076520 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 641/1285] 10.222.0.49 () {56 vars in 1111 bytes} [Wed Aug 24 04:40:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:07.081937 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf45dd-b628-49e4-9dbe-1824204368b6 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:07.132250 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:07.185888 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf45dd-b628-49e4-9dbe-1824204368b6 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:07.220454 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13381d4-6075-4e42-b562-39454af04314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:07.221058 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13381d4-6075-4e42-b562-39454af04314 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:07.221369 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13381d4-6075-4e42-b562-39454af04314 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:07.221643 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13381d4-6075-4e42-b562-39454af04314 None admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:07.222338 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13381d4-6075-4e42-b562-39454af04314 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:07.222642 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13381d4-6075-4e42-b562-39454af04314 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:07.224431 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13381d4-6075-4e42-b562-39454af04314 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:07.236901 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 645/1286] 10.222.0.49 () {56 vars in 1148 bytes} [Wed Aug 24 04:40:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:40:07.243435 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c818c-b79b-42b3-9c42-30dd7e767161 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:07.352602 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c818c-b79b-42b3-9c42-30dd7e767161 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:07.388942 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6073c0-b0f5-44a4-95e0-284ac89c3893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:07.389555 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6073c0-b0f5-44a4-95e0-284ac89c3893 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:07.389830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6073c0-b0f5-44a4-95e0-284ac89c3893 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:07.390093 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6073c0-b0f5-44a4-95e0-284ac89c3893 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:07.390813 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6073c0-b0f5-44a4-95e0-284ac89c3893 None admin] RBAC: Adding query filter params (role.id=74ce7b72bcc94a8a8ad65c3db928e6ac, scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62, user.id=edf1b960a2eb4e5e9ada736b5f3f5810) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:07.391117 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6073c0-b0f5-44a4-95e0-284ac89c3893 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:07.392545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6073c0-b0f5-44a4-95e0-284ac89c3893 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:07.398454 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 642/1287] 10.222.0.49 () {56 vars in 1374 bytes} [Wed Aug 24 04:40:07 2022] GET /identity/v3/role_assignments?user.id=edf1b960a2eb4e5e9ada736b5f3f5810&scope.project.id=08755f450e6c47dcaaaa754a6aa2ec62&role.id=74ce7b72bcc94a8a8ad65c3db928e6ac => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:09.288002 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ceaeba-7059-4f2f-82bc-cc8a0f286d99 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:09.289056 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ceaeba-7059-4f2f-82bc-cc8a0f286d99 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:09.289056 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ceaeba-7059-4f2f-82bc-cc8a0f286d99 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:09.291166 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 646/1288] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:40:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:09.299152 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d2843-9b0c-4564-8bbb-6d42f9b12f77 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:09.299599 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d2843-9b0c-4564-8bbb-6d42f9b12f77 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:09.299708 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d2843-9b0c-4564-8bbb-6d42f9b12f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:09.319738 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-364d2843-9b0c-4564-8bbb-6d42f9b12f77 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:09.320919 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-364d2843-9b0c-4564-8bbb-6d42f9b12f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:09.352031 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:09.402636 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 643/1289] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:40:09.695892 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ceaeba-7059-4f2f-82bc-cc8a0f286d99 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:09.811203 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ceaeba-7059-4f2f-82bc-cc8a0f286d99 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:09.822240 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:09.851159 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39bb1f-6095-4c13-bf9b-1f8b8e5798c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:09.851777 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39bb1f-6095-4c13-bf9b-1f8b8e5798c8 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:09.852052 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39bb1f-6095-4c13-bf9b-1f8b8e5798c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:09.852313 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39bb1f-6095-4c13-bf9b-1f8b8e5798c8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:09.852897 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39bb1f-6095-4c13-bf9b-1f8b8e5798c8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:09.854299 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39bb1f-6095-4c13-bf9b-1f8b8e5798c8 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:09.863523 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-7c39bb1f-6095-4c13-bf9b-1f8b8e5798c8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:40:09.863523 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:09.863523 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:40:09.863523 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:40:09.863523 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:40:09.863523 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:40:09.863523 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:40:09.863523 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:40:09.863523 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:40:09.863523 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:40:09.863523 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:40:09.863523 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:40:09.863523 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:09.863523 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:09.863523 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:09.863523 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:09.863523 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:09.864757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:09.864757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:09.864757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:09.864757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:09.864757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:09.864757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:09.864757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:40:09.864757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:40:09.864757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:40:09.864757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:40:09.864757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:09.864757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:09.864757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:09.864757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:09.864757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:09.864757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:09.865993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:09.865993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:09.865993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:09.865993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:09.865993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:09.865993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:09.865993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:09.865993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:09.865993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:09.865993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:09.865993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:40:09.865993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:40:09.865993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:40:09.865993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:40:09.869539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 647/1290] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Aug 24 04:40:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:09.870747 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d2843-9b0c-4564-8bbb-6d42f9b12f77 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:09.977255 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d2843-9b0c-4564-8bbb-6d42f9b12f77 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:10.016044 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78046d16-fb6c-4fb3-868e-39106fdc681e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:10.016641 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78046d16-fb6c-4fb3-868e-39106fdc681e None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:10.016918 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78046d16-fb6c-4fb3-868e-39106fdc681e None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:10.017185 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78046d16-fb6c-4fb3-868e-39106fdc681e None admin] PATH_INFO: `/v3/services` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:10.017844 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78046d16-fb6c-4fb3-868e-39106fdc681e None admin] RBAC: Adding query filter params (name=placement) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:10.018153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78046d16-fb6c-4fb3-868e-39106fdc681e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:10.019528 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78046d16-fb6c-4fb3-868e-39106fdc681e None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:10.024658 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 644/1291] 10.222.0.49 () {56 vars in 1116 bytes} [Wed Aug 24 04:40:09 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:10.030888 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39bb1f-6095-4c13-bf9b-1f8b8e5798c8 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:10.139258 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39bb1f-6095-4c13-bf9b-1f8b8e5798c8 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:10.175238 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75732636-d2d3-4b93-9ec5-7bf6460128b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:10.175849 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75732636-d2d3-4b93-9ec5-7bf6460128b8 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:10.176126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75732636-d2d3-4b93-9ec5-7bf6460128b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:10.176401 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75732636-d2d3-4b93-9ec5-7bf6460128b8 None admin] PATH_INFO: `/v3/services` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:10.177034 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75732636-d2d3-4b93-9ec5-7bf6460128b8 None admin] RBAC: Adding query filter params (type=placement) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:10.177368 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75732636-d2d3-4b93-9ec5-7bf6460128b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:10.178748 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75732636-d2d3-4b93-9ec5-7bf6460128b8 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:10.183443 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 648/1292] 10.222.0.49 () {56 vars in 1116 bytes} [Wed Aug 24 04:40:10 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:12.057885 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92422f-9e38-4bfc-b949-3f9a3a33e905 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:12.058773 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92422f-9e38-4bfc-b949-3f9a3a33e905 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:12.058773 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92422f-9e38-4bfc-b949-3f9a3a33e905 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:12.060865 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 645/1293] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:40:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:12.069818 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f62e88-b34b-43cd-8b36-6192e2028960 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:12.070208 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f62e88-b34b-43cd-8b36-6192e2028960 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:12.070387 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f62e88-b34b-43cd-8b36-6192e2028960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:12.089032 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-c8f62e88-b34b-43cd-8b36-6192e2028960 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:12.090253 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-c8f62e88-b34b-43cd-8b36-6192e2028960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:12.122320 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:12.165011 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 649/1294] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:40:12.430117 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92422f-9e38-4bfc-b949-3f9a3a33e905 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:12.476189 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:12.563230 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92422f-9e38-4bfc-b949-3f9a3a33e905 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:12.613655 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a1bc9-e90a-4432-bb19-d03b30769ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:12.614458 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a1bc9-e90a-4432-bb19-d03b30769ed4 None admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:12.614910 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a1bc9-e90a-4432-bb19-d03b30769ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:12.615198 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a1bc9-e90a-4432-bb19-d03b30769ed4 None admin] PATH_INFO: `/v3/services` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:12.616218 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a1bc9-e90a-4432-bb19-d03b30769ed4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:12.618011 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a1bc9-e90a-4432-bb19-d03b30769ed4 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:12.636935 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 646/1295] 10.222.0.49 () {60 vars in 1141 bytes} [Wed Aug 24 04:40:12 2022] POST /identity/v3/services => generated 246 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:40:14.496078 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6913f2-5c65-49ec-86df-6e3fb773aa28 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:14.496600 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6913f2-5c65-49ec-86df-6e3fb773aa28 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:14.496600 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6913f2-5c65-49ec-86df-6e3fb773aa28 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:14.497956 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 650/1296] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:14.504257 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aef4ea-506a-486e-af00-e55674cd0fd0 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:14.504967 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aef4ea-506a-486e-af00-e55674cd0fd0 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:14.505107 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aef4ea-506a-486e-af00-e55674cd0fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:14.527301 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-c2aef4ea-506a-486e-af00-e55674cd0fd0 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:14.528513 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-c2aef4ea-506a-486e-af00-e55674cd0fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:14.618269 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 647/1297] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:14 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:40:14.894080 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6913f2-5c65-49ec-86df-6e3fb773aa28 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:15.008487 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6913f2-5c65-49ec-86df-6e3fb773aa28 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:15.044717 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044d23d-a60f-4fe0-b0ab-91290979ec96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:15.045368 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044d23d-a60f-4fe0-b0ab-91290979ec96 None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:15.045647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044d23d-a60f-4fe0-b0ab-91290979ec96 None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:15.045927 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044d23d-a60f-4fe0-b0ab-91290979ec96 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:15.046507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044d23d-a60f-4fe0-b0ab-91290979ec96 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:15.047882 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044d23d-a60f-4fe0-b0ab-91290979ec96 None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:15.056628 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-a044d23d-a60f-4fe0-b0ab-91290979ec96 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:40:15.056628 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:15.056628 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:40:15.056628 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:40:15.056628 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:40:15.056628 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:40:15.056628 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:40:15.056628 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:40:15.056628 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:40:15.056628 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:40:15.056628 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:40:15.056628 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:40:15.056628 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:15.056628 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:15.056628 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:15.056628 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:15.056628 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:15.057826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:15.057826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:15.057826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:15.057826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:15.057826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:15.057826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:15.057826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:40:15.057826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:40:15.057826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:40:15.057826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:40:15.057826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:15.057826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:15.057826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:15.057826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:15.057826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:15.057826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:15.058676 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:15.058676 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:15.058676 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:15.058676 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:15.058676 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:15.058676 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:15.058676 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:15.058676 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:15.058676 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:15.058676 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:15.058676 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:40:15.058676 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:40:15.058676 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:40:15.058676 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:40:15.058676 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 651/1298] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Aug 24 04:40:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:15.065712 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aef4ea-506a-486e-af00-e55674cd0fd0 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:15.086131 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:15.173532 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aef4ea-506a-486e-af00-e55674cd0fd0 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:15.208542 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c4314-5a53-4570-a9a0-c0bb52d27bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:15.209164 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c4314-5a53-4570-a9a0-c0bb52d27bf9 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:15.209462 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c4314-5a53-4570-a9a0-c0bb52d27bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:15.209730 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c4314-5a53-4570-a9a0-c0bb52d27bf9 None admin] PATH_INFO: `/v3/services` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:15.210386 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c4314-5a53-4570-a9a0-c0bb52d27bf9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:15.210687 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c4314-5a53-4570-a9a0-c0bb52d27bf9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:15.212062 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c4314-5a53-4570-a9a0-c0bb52d27bf9 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:15.217521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 648/1299] 10.222.0.49 () {56 vars in 1116 bytes} [Wed Aug 24 04:40:15 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:15.224152 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044d23d-a60f-4fe0-b0ab-91290979ec96 None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:15.259011 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:15.330351 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044d23d-a60f-4fe0-b0ab-91290979ec96 None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:15.365971 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bc6861-3e42-4061-b8c1-2d2ee206795f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:15.366588 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc6861-3e42-4061-b8c1-2d2ee206795f None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:15.366859 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc6861-3e42-4061-b8c1-2d2ee206795f None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:15.367125 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc6861-3e42-4061-b8c1-2d2ee206795f None admin] PATH_INFO: `/v3/endpoints` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:15.367821 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc6861-3e42-4061-b8c1-2d2ee206795f None admin] RBAC: Adding query filter params (interface=public, service_id=12f5b763600e4fdd903f9a1997545b45, region_id=RegionOne) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:15.368096 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc6861-3e42-4061-b8c1-2d2ee206795f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:15.369504 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bc6861-3e42-4061-b8c1-2d2ee206795f None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:15.374398 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 652/1300] 10.222.0.49 () {56 vars in 1251 bytes} [Wed Aug 24 04:40:15 2022] GET /identity/v3/endpoints?service_id=12f5b763600e4fdd903f9a1997545b45&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:15.380864 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c4314-5a53-4570-a9a0-c0bb52d27bf9 None admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:15.467113 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:15.490498 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c4314-5a53-4570-a9a0-c0bb52d27bf9 None admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:15.528982 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6dc9c-400c-4cdc-8c89-e32a6e008017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:15.529641 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6dc9c-400c-4cdc-8c89-e32a6e008017 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:15.529867 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6dc9c-400c-4cdc-8c89-e32a6e008017 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:15.530134 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6dc9c-400c-4cdc-8c89-e32a6e008017 None admin] PATH_INFO: `/v3/services` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:15.530736 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6dc9c-400c-4cdc-8c89-e32a6e008017 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:15.532116 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6dc9c-400c-4cdc-8c89-e32a6e008017 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:15.539126 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 649/1301] 10.222.0.49 () {56 vars in 1087 bytes} [Wed Aug 24 04:40:15 2022] GET /identity/v3/services => generated 2191 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:40:17.400686 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf2c9b-586e-461b-ba19-8bb75cb1ac14 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:17.401587 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf2c9b-586e-461b-ba19-8bb75cb1ac14 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:17.401587 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf2c9b-586e-461b-ba19-8bb75cb1ac14 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:17.403805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 653/1302] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:40:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:17.409272 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff160d-1ea2-42ca-b3b6-0ca005d9a113 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:17.409734 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff160d-1ea2-42ca-b3b6-0ca005d9a113 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:17.409734 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff160d-1ea2-42ca-b3b6-0ca005d9a113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:17.429383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-c1ff160d-1ea2-42ca-b3b6-0ca005d9a113 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:17.430578 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-c1ff160d-1ea2-42ca-b3b6-0ca005d9a113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:17.500986 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 650/1303] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:17 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:40:17.796630 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf2c9b-586e-461b-ba19-8bb75cb1ac14 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:17.901995 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:17.909478 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf2c9b-586e-461b-ba19-8bb75cb1ac14 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:17.945632 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc7ede-bcd8-4321-8ce1-6b409255bfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:17.946249 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc7ede-bcd8-4321-8ce1-6b409255bfac None admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:17.946523 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc7ede-bcd8-4321-8ce1-6b409255bfac None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:17.946796 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc7ede-bcd8-4321-8ce1-6b409255bfac None admin] PATH_INFO: `/v3/services/placement` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:17.947379 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc7ede-bcd8-4321-8ce1-6b409255bfac None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:17.948739 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc7ede-bcd8-4321-8ce1-6b409255bfac None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:17.958077 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application [None req-71bc7ede-bcd8-4321-8ce1-6b409255bfac None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:40:17.958077 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:17.958077 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:40:17.958077 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:40:17.958077 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:40:17.958077 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:40:17.958077 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:40:17.958077 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:40:17.958077 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:40:17.958077 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:40:17.958077 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:40:17.958077 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:40:17.958077 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:17.958077 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:17.958077 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:17.958077 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:17.958077 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:17.959190 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:17.959190 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:17.959190 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:17.959190 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:17.959190 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:17.959190 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:17.959190 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:40:17.959190 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:40:17.959190 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:40:17.959190 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:40:17.959190 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:17.959190 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:17.959190 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:17.959190 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:17.959190 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:17.959190 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:17.960162 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:17.960162 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:17.960162 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:17.960162 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:17.960162 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:17.960162 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:17.960162 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:17.960162 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:17.960162 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:17.960162 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:17.960162 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:40:17.960162 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:40:17.960162 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:40:17.960162 dv-cinder-854265-1-smb devstack@keystone.service[93148]: ERROR keystone.server.flask.application Aug 24 04:40:17.960162 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 654/1304] 10.222.0.49 () {56 vars in 1117 bytes} [Wed Aug 24 04:40:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:17.966929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff160d-1ea2-42ca-b3b6-0ca005d9a113 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:18.046983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:18.080149 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff160d-1ea2-42ca-b3b6-0ca005d9a113 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:18.117914 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20e71e-1ee8-4eaa-b561-9e6665487b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:18.118514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20e71e-1ee8-4eaa-b561-9e6665487b77 None admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:18.118794 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20e71e-1ee8-4eaa-b561-9e6665487b77 None admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:18.119070 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20e71e-1ee8-4eaa-b561-9e6665487b77 None admin] PATH_INFO: `/v3/services` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:18.119703 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d20e71e-1ee8-4eaa-b561-9e6665487b77 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:18.120006 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d20e71e-1ee8-4eaa-b561-9e6665487b77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:18.121380 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d20e71e-1ee8-4eaa-b561-9e6665487b77 None admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:18.127217 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 651/1305] 10.222.0.49 () {56 vars in 1116 bytes} [Wed Aug 24 04:40:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:18.135165 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc7ede-bcd8-4321-8ce1-6b409255bfac None admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:18.253899 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc7ede-bcd8-4321-8ce1-6b409255bfac None admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:18.288778 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083b882-cc0e-4b48-beeb-c82b429a771e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:18.289374 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083b882-cc0e-4b48-beeb-c82b429a771e None admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:18.289675 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083b882-cc0e-4b48-beeb-c82b429a771e None admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:18.289954 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083b882-cc0e-4b48-beeb-c82b429a771e None admin] PATH_INFO: `/v3/endpoints` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:18.290634 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083b882-cc0e-4b48-beeb-c82b429a771e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:18.292013 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083b882-cc0e-4b48-beeb-c82b429a771e None admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:18.315239 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 655/1306] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:40:18 2022] POST /identity/v3/endpoints => generated 331 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:40:28.123961 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=30 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:28.310482 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:22.501890 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887dbae7-4ccb-4c9b-a381-97416996d9ed None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:22.502921 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887dbae7-4ccb-4c9b-a381-97416996d9ed None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:22.503409 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887dbae7-4ccb-4c9b-a381-97416996d9ed None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:22.504996 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 652/1307] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:41:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:22.510439 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b38bc3-7723-485d-839c-9e07568616b1 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:22.510857 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b38bc3-7723-485d-839c-9e07568616b1 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:22.511064 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b38bc3-7723-485d-839c-9e07568616b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:22.599011 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-56b38bc3-7723-485d-839c-9e07568616b1 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:22.600342 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-56b38bc3-7723-485d-839c-9e07568616b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:22.714783 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 656/1308] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:41:23.011571 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4871c-e02b-47fb-b0f7-fc67c540b40b None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:23.011783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4871c-e02b-47fb-b0f7-fc67c540b40b None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:23.012051 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4871c-e02b-47fb-b0f7-fc67c540b40b None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:23.013800 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 653/1309] 10.222.0.49 () {54 vars in 965 bytes} [Wed Aug 24 04:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:23.019857 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e7fca-cb05-4c2d-9e9c-139be12ee929 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:23.020177 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e7fca-cb05-4c2d-9e9c-139be12ee929 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:23.020458 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e7fca-cb05-4c2d-9e9c-139be12ee929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:23.100594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-2f4e7fca-cb05-4c2d-9e9c-139be12ee929 None None] MFA Rules not processed for user `087c0311906a4987b294729706a08810`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:23.101917 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-2f4e7fca-cb05-4c2d-9e9c-139be12ee929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:23.124719 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:23.185410 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 657/1310] 10.222.0.49 () {58 vars in 1062 bytes} [Wed Aug 24 04:41:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:41:23.194431 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4871c-e02b-47fb-b0f7-fc67c540b40b None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:23.196180 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-13c4871c-e02b-47fb-b0f7-fc67c540b40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:23.311192 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4871c-e02b-47fb-b0f7-fc67c540b40b None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:23.387469 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b72786-7ce8-49bb-82e7-14d40e3ad8c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:23.388077 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b72786-7ce8-49bb-82e7-14d40e3ad8c7 service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:23.388356 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b72786-7ce8-49bb-82e7-14d40e3ad8c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:23.388627 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b72786-7ce8-49bb-82e7-14d40e3ad8c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:23.390338 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-c2b72786-7ce8-49bb-82e7-14d40e3ad8c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:23.454386 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:23.518566 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b72786-7ce8-49bb-82e7-14d40e3ad8c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:23.520038 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b72786-7ce8-49bb-82e7-14d40e3ad8c7 service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:23.542435 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 654/1311] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:41:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:41:25.747918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8a379-f2bd-46a5-bb9c-c92ad7669570 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:25.748515 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8a379-f2bd-46a5-bb9c-c92ad7669570 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:25.748515 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8a379-f2bd-46a5-bb9c-c92ad7669570 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:25.749913 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 658/1312] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:25.756009 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a87e0-c49f-4005-8f35-6cdfc817a034 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:25.756581 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a87e0-c49f-4005-8f35-6cdfc817a034 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:25.756581 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a87e0-c49f-4005-8f35-6cdfc817a034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:25.840307 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-591a87e0-c49f-4005-8f35-6cdfc817a034 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:25.841623 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-591a87e0-c49f-4005-8f35-6cdfc817a034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:25.944506 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 655/1313] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:41:26.239774 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ac0e9-c24b-404b-8719-2493b0d725fe None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:26.240146 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ac0e9-c24b-404b-8719-2493b0d725fe None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:26.240482 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ac0e9-c24b-404b-8719-2493b0d725fe None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:26.241985 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 659/1314] 10.222.0.49 () {54 vars in 965 bytes} [Wed Aug 24 04:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:26.248284 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798b4c5-440a-46ba-b5a7-e747efb48dcc None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:26.248571 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798b4c5-440a-46ba-b5a7-e747efb48dcc None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:26.248844 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798b4c5-440a-46ba-b5a7-e747efb48dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:26.260792 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:26.330010 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-6798b4c5-440a-46ba-b5a7-e747efb48dcc None None] MFA Rules not processed for user `087c0311906a4987b294729706a08810`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:26.331246 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-6798b4c5-440a-46ba-b5a7-e747efb48dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:26.409506 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 656/1315] 10.222.0.49 () {58 vars in 1062 bytes} [Wed Aug 24 04:41:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:41:26.418392 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ac0e9-c24b-404b-8719-2493b0d725fe None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:26.419915 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-de2ac0e9-c24b-404b-8719-2493b0d725fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:26.530599 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ac0e9-c24b-404b-8719-2493b0d725fe None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:26.602977 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:26.606309 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ec6b7-c198-4d8a-a119-89d8ca1b970f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:26.606940 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ec6b7-c198-4d8a-a119-89d8ca1b970f service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:26.607902 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ec6b7-c198-4d8a-a119-89d8ca1b970f service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:26.607902 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ec6b7-c198-4d8a-a119-89d8ca1b970f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:26.610162 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-fe4ec6b7-c198-4d8a-a119-89d8ca1b970f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:26.723668 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ec6b7-c198-4d8a-a119-89d8ca1b970f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:26.725186 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ec6b7-c198-4d8a-a119-89d8ca1b970f service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:26.745136 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 660/1316] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:41:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:41:29.156443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190e285-572b-43a1-a473-f24d47bddbfb None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:29.156443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190e285-572b-43a1-a473-f24d47bddbfb None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:29.156443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190e285-572b-43a1-a473-f24d47bddbfb None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:29.157792 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 657/1317] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:29.163440 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84765799-c096-4904-9914-fda2e5241760 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:29.163923 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84765799-c096-4904-9914-fda2e5241760 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:29.164015 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84765799-c096-4904-9914-fda2e5241760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:29.233327 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-84765799-c096-4904-9914-fda2e5241760 None None] MFA Rules not processed for user `8cd784bb521f420da48da77b1d52602f`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:29.234627 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-84765799-c096-4904-9914-fda2e5241760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:29.290187 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:29.340495 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 661/1318] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:29 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:41:29.619512 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190e285-572b-43a1-a473-f24d47bddbfb None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:29.621070 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-b190e285-572b-43a1-a473-f24d47bddbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:29.732227 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190e285-572b-43a1-a473-f24d47bddbfb None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:29.735190 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:29.808698 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601425b7-c316-4965-9433-5724a1a77f8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:29.809309 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601425b7-c316-4965-9433-5724a1a77f8b service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:29.809593 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601425b7-c316-4965-9433-5724a1a77f8b service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:29.809894 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601425b7-c316-4965-9433-5724a1a77f8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:29.811481 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-601425b7-c316-4965-9433-5724a1a77f8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:29.932250 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601425b7-c316-4965-9433-5724a1a77f8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:29.933662 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601425b7-c316-4965-9433-5724a1a77f8b service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:29.952634 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 658/1319] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:41:29 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:41:32.404324 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298708b-49e3-4e16-a7a9-47a1f57dc2b3 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:32.405220 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298708b-49e3-4e16-a7a9-47a1f57dc2b3 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:32.405220 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298708b-49e3-4e16-a7a9-47a1f57dc2b3 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:32.407453 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 662/1320] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:41:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:32.414866 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f235f5-9338-4e01-b29b-1149a425a950 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:32.415294 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f235f5-9338-4e01-b29b-1149a425a950 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:32.415449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f235f5-9338-4e01-b29b-1149a425a950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:32.467331 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:32.495223 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-35f235f5-9338-4e01-b29b-1149a425a950 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:32.496441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-35f235f5-9338-4e01-b29b-1149a425a950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:32.597044 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 659/1321] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:41:32.882415 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298708b-49e3-4e16-a7a9-47a1f57dc2b3 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:32.884878 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-d298708b-49e3-4e16-a7a9-47a1f57dc2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:33.010529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298708b-49e3-4e16-a7a9-47a1f57dc2b3 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:33.090616 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d98994-8edf-44cb-9b32-8f6fbf636bbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:33.091220 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d98994-8edf-44cb-9b32-8f6fbf636bbc service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:33.091489 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d98994-8edf-44cb-9b32-8f6fbf636bbc service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:33.091754 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d98994-8edf-44cb-9b32-8f6fbf636bbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:33.093375 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-13d98994-8edf-44cb-9b32-8f6fbf636bbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:33.100870 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:33.210266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d98994-8edf-44cb-9b32-8f6fbf636bbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:33.211795 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d98994-8edf-44cb-9b32-8f6fbf636bbc service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:33.232686 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 663/1322] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:41:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:41:35.771004 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c6ddc-b840-4f31-88b4-854daba68c15 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:35.771671 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c6ddc-b840-4f31-88b4-854daba68c15 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:35.771671 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c6ddc-b840-4f31-88b4-854daba68c15 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:35.773082 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 660/1323] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:35.778272 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3599ec-d083-4557-a7c1-040908ab3cee None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:35.778720 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3599ec-d083-4557-a7c1-040908ab3cee None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:35.778825 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3599ec-d083-4557-a7c1-040908ab3cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:35.846242 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-3b3599ec-d083-4557-a7c1-040908ab3cee None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:35.847480 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-3b3599ec-d083-4557-a7c1-040908ab3cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:35.906575 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:35.947024 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 664/1324] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:41:36.224852 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c6ddc-b840-4f31-88b4-854daba68c15 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:36.226457 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-e47c6ddc-b840-4f31-88b4-854daba68c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:36.335591 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c6ddc-b840-4f31-88b4-854daba68c15 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:36.349143 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:36.414245 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2c905-b29b-42e3-a5a4-59ca2dd5ec16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:36.414747 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2c905-b29b-42e3-a5a4-59ca2dd5ec16 service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:36.415029 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2c905-b29b-42e3-a5a4-59ca2dd5ec16 service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:36.415296 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2c905-b29b-42e3-a5a4-59ca2dd5ec16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:36.416886 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-c3a2c905-b29b-42e3-a5a4-59ca2dd5ec16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:36.533014 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a2c905-b29b-42e3-a5a4-59ca2dd5ec16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:36.534533 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a2c905-b29b-42e3-a5a4-59ca2dd5ec16 service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:36.553791 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 661/1325] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:41:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:41:38.498649 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9b1ea-c126-4be3-96b1-f3dc8e900882 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:38.499206 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9b1ea-c126-4be3-96b1-f3dc8e900882 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:38.499206 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9b1ea-c126-4be3-96b1-f3dc8e900882 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:38.500876 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 665/1326] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:41:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:38.506778 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd351721-4d44-4e66-84c3-c217c5a15806 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:38.507206 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd351721-4d44-4e66-84c3-c217c5a15806 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:38.507408 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd351721-4d44-4e66-84c3-c217c5a15806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:38.560884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:38.579627 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-cd351721-4d44-4e66-84c3-c217c5a15806 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:38.580857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-cd351721-4d44-4e66-84c3-c217c5a15806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:38.686244 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 662/1327] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:41:38.965632 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9b1ea-c126-4be3-96b1-f3dc8e900882 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:38.967170 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-fdc9b1ea-c126-4be3-96b1-f3dc8e900882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:39.081185 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9b1ea-c126-4be3-96b1-f3dc8e900882 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:39.157028 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1776bbd-4304-4d83-abeb-31b8683fbe4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:39.157686 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1776bbd-4304-4d83-abeb-31b8683fbe4a service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:39.157973 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1776bbd-4304-4d83-abeb-31b8683fbe4a service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:39.158252 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1776bbd-4304-4d83-abeb-31b8683fbe4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:39.160024 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-a1776bbd-4304-4d83-abeb-31b8683fbe4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:39.179497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:39.273820 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1776bbd-4304-4d83-abeb-31b8683fbe4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:39.275562 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1776bbd-4304-4d83-abeb-31b8683fbe4a service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:39.295736 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 666/1328] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:41:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:41:41.238745 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17b6f7-8ebf-4e6f-8150-452d4e92d084 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:41.239342 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17b6f7-8ebf-4e6f-8150-452d4e92d084 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:41.239342 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17b6f7-8ebf-4e6f-8150-452d4e92d084 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:41.240648 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 663/1329] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:41.246794 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39e125-c0b2-45a7-a0ca-8dc5e7448edb None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:41.247365 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39e125-c0b2-45a7-a0ca-8dc5e7448edb None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:41.247365 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39e125-c0b2-45a7-a0ca-8dc5e7448edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:41.319789 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-fe39e125-c0b2-45a7-a0ca-8dc5e7448edb None None] MFA Rules not processed for user `8cd784bb521f420da48da77b1d52602f`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:41.321093 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-fe39e125-c0b2-45a7-a0ca-8dc5e7448edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:41.387858 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:41.421191 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 667/1330] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:41 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:41:41.700291 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17b6f7-8ebf-4e6f-8150-452d4e92d084 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:41.701869 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-6b17b6f7-8ebf-4e6f-8150-452d4e92d084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:41.806881 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17b6f7-8ebf-4e6f-8150-452d4e92d084 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:41.826775 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:41.887382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c1f5a-6aa6-4e09-a67b-e8df884f7420 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:41.887929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c1f5a-6aa6-4e09-a67b-e8df884f7420 service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:41.888208 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c1f5a-6aa6-4e09-a67b-e8df884f7420 service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:41.888481 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c1f5a-6aa6-4e09-a67b-e8df884f7420 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:41.890140 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-180c1f5a-6aa6-4e09-a67b-e8df884f7420 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:41.999714 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c1f5a-6aa6-4e09-a67b-e8df884f7420 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:42.001116 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c1f5a-6aa6-4e09-a67b-e8df884f7420 service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:42.022025 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 664/1331] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:41:41 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:41:44.403543 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031f91f-ff17-470f-aeb2-e8bc9c64bbf4 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:44.404106 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031f91f-ff17-470f-aeb2-e8bc9c64bbf4 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:44.404106 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031f91f-ff17-470f-aeb2-e8bc9c64bbf4 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:44.405368 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 668/1332] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:44.412219 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4bb66e-2856-40b4-9735-b7051285deb0 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:44.412955 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4bb66e-2856-40b4-9735-b7051285deb0 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:44.413089 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4bb66e-2856-40b4-9735-b7051285deb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:44.492420 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:44.495596 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-ce4bb66e-2856-40b4-9735-b7051285deb0 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:44.497637 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-ce4bb66e-2856-40b4-9735-b7051285deb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:44.625723 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 665/1333] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:41:44.915708 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031f91f-ff17-470f-aeb2-e8bc9c64bbf4 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:44.917252 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-5031f91f-ff17-470f-aeb2-e8bc9c64bbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:45.029326 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031f91f-ff17-470f-aeb2-e8bc9c64bbf4 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:45.110534 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f9cd3-a7aa-4faf-83c0-8dec857a0815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:45.111132 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f9cd3-a7aa-4faf-83c0-8dec857a0815 service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:45.111410 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f9cd3-a7aa-4faf-83c0-8dec857a0815 service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:45.111679 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f9cd3-a7aa-4faf-83c0-8dec857a0815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:45.113278 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-639f9cd3-a7aa-4faf-83c0-8dec857a0815 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:45.140954 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:45.229749 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f9cd3-a7aa-4faf-83c0-8dec857a0815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:45.231152 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f9cd3-a7aa-4faf-83c0-8dec857a0815 service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:45.251682 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 669/1334] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:41:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:41:47.189477 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582bbd65-f07c-4d0c-b129-3ccc90af3d4d None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:47.189990 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582bbd65-f07c-4d0c-b129-3ccc90af3d4d None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:47.189990 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582bbd65-f07c-4d0c-b129-3ccc90af3d4d None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:47.191447 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 666/1335] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:41:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:47.197940 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8603e4-06b9-495e-a772-bcf59e5f70c1 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:47.199115 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8603e4-06b9-495e-a772-bcf59e5f70c1 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:47.199507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8603e4-06b9-495e-a772-bcf59e5f70c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:47.278053 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-3e8603e4-06b9-495e-a772-bcf59e5f70c1 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:47.279262 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-3e8603e4-06b9-495e-a772-bcf59e5f70c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:47.358869 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:47.385871 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 670/1336] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:41:47.670441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582bbd65-f07c-4d0c-b129-3ccc90af3d4d None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:47.672950 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-582bbd65-f07c-4d0c-b129-3ccc90af3d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:47.800281 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582bbd65-f07c-4d0c-b129-3ccc90af3d4d None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:47.829142 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:47.879521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b2644-2e25-4d37-99b0-b532354918fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:47.880130 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b2644-2e25-4d37-99b0-b532354918fd service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:47.880404 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b2644-2e25-4d37-99b0-b532354918fd service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:47.880671 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b2644-2e25-4d37-99b0-b532354918fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:47.882303 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-8d9b2644-2e25-4d37-99b0-b532354918fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:47.996134 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b2644-2e25-4d37-99b0-b532354918fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:47.997549 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b2644-2e25-4d37-99b0-b532354918fd service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:48.017387 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 667/1337] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:41:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:41:50.353394 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fde6b-3753-4a05-9c38-f62087820369 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:50.354289 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fde6b-3753-4a05-9c38-f62087820369 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:50.354560 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2fde6b-3753-4a05-9c38-f62087820369 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:50.356586 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 671/1338] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:41:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:50.362626 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdef0a-b9b8-4d4d-a72a-a20a43619390 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:50.363066 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdef0a-b9b8-4d4d-a72a-a20a43619390 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:50.363171 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdef0a-b9b8-4d4d-a72a-a20a43619390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:50.433431 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-e4bdef0a-b9b8-4d4d-a72a-a20a43619390 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:50.434561 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-e4bdef0a-b9b8-4d4d-a72a-a20a43619390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:50.443924 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:50.540925 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 668/1339] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:41:50.835448 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2fde6b-3753-4a05-9c38-f62087820369 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:50.837917 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-be2fde6b-3753-4a05-9c38-f62087820369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:50.970209 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2fde6b-3753-4a05-9c38-f62087820369 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:51.051540 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb1902-a692-4c62-a7f1-90d2c6fa7a6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:51.052157 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb1902-a692-4c62-a7f1-90d2c6fa7a6a service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:51.052470 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb1902-a692-4c62-a7f1-90d2c6fa7a6a service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:51.052738 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb1902-a692-4c62-a7f1-90d2c6fa7a6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:51.054649 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-5bbb1902-a692-4c62-a7f1-90d2c6fa7a6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:51.099076 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:51.177296 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb1902-a692-4c62-a7f1-90d2c6fa7a6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:51.178832 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb1902-a692-4c62-a7f1-90d2c6fa7a6a service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:51.198968 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 672/1340] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:41:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:41:55.106883 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcae9a-471f-4244-8810-798436996690 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:55.107399 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcae9a-471f-4244-8810-798436996690 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:55.107497 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affcae9a-471f-4244-8810-798436996690 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:55.109200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 669/1341] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:55.114837 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a289769-0bd3-4586-8a99-c0a7462cd67a None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:55.115231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a289769-0bd3-4586-8a99-c0a7462cd67a None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:55.115397 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a289769-0bd3-4586-8a99-c0a7462cd67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:55.186749 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-6a289769-0bd3-4586-8a99-c0a7462cd67a None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:55.187984 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-6a289769-0bd3-4586-8a99-c0a7462cd67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:55.278851 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:55.290759 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 673/1342] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:41:55.569677 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcae9a-471f-4244-8810-798436996690 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:55.571182 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-affcae9a-471f-4244-8810-798436996690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:55.681564 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affcae9a-471f-4244-8810-798436996690 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:55.720847 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:55.759192 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0e6a6-e721-4e88-a513-33e7cfd3efdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:55.759815 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0e6a6-e721-4e88-a513-33e7cfd3efdc service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:55.760085 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0e6a6-e721-4e88-a513-33e7cfd3efdc service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:55.760353 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0e6a6-e721-4e88-a513-33e7cfd3efdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:55.761969 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-e4e0e6a6-e721-4e88-a513-33e7cfd3efdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:55.873187 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0e6a6-e721-4e88-a513-33e7cfd3efdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:55.874669 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0e6a6-e721-4e88-a513-33e7cfd3efdc service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:55.893930 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 670/1343] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:41:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:41:58.400791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a552f-6a4a-4acd-b266-ef2c68f7cb01 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:58.401469 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a552f-6a4a-4acd-b266-ef2c68f7cb01 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:58.401469 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a552f-6a4a-4acd-b266-ef2c68f7cb01 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:58.402788 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 674/1344] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:58.408530 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6af305-ffeb-4f1a-b2ca-6701830cdb2f None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:58.409041 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6af305-ffeb-4f1a-b2ca-6701830cdb2f None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:58.409041 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6af305-ffeb-4f1a-b2ca-6701830cdb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:58.485649 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-4e6af305-ffeb-4f1a-b2ca-6701830cdb2f None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:58.486994 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-4e6af305-ffeb-4f1a-b2ca-6701830cdb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:58.506000 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:58.588675 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 671/1345] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:41:58.866703 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a552f-6a4a-4acd-b266-ef2c68f7cb01 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:58.868287 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-db5a552f-6a4a-4acd-b266-ef2c68f7cb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:58.974566 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a552f-6a4a-4acd-b266-ef2c68f7cb01 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:59.050850 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768d9a4-8d25-42f7-a78b-af0a6a182aeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:59.051486 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768d9a4-8d25-42f7-a78b-af0a6a182aeb service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:59.051763 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768d9a4-8d25-42f7-a78b-af0a6a182aeb service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:59.052032 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768d9a4-8d25-42f7-a78b-af0a6a182aeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:59.053669 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-e768d9a4-8d25-42f7-a78b-af0a6a182aeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:59.101609 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:59.175843 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768d9a4-8d25-42f7-a78b-af0a6a182aeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:59.177298 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768d9a4-8d25-42f7-a78b-af0a6a182aeb service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:59.196898 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 675/1346] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:41:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:03.380487 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d5b53-ddf5-41a0-82c3-195c4e43f0d8 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:03.381070 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d5b53-ddf5-41a0-82c3-195c4e43f0d8 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:03.381070 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d5b53-ddf5-41a0-82c3-195c4e43f0d8 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:03.382489 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 672/1347] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:42:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:03.388395 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5b467-55ef-4088-a048-03d11e444d96 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:03.388910 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5b467-55ef-4088-a048-03d11e444d96 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:03.388910 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5b467-55ef-4088-a048-03d11e444d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:03.460169 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-49f5b467-55ef-4088-a048-03d11e444d96 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:03.461454 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-49f5b467-55ef-4088-a048-03d11e444d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:03.564458 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:03.567315 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 676/1348] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:03.850146 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d5b53-ddf5-41a0-82c3-195c4e43f0d8 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:03.852570 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-ed5d5b53-ddf5-41a0-82c3-195c4e43f0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:03.970782 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d5b53-ddf5-41a0-82c3-195c4e43f0d8 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:04.023296 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:04.053976 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee7f6a-be9e-47b4-8ea8-6e1dcc71251e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:04.054621 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee7f6a-be9e-47b4-8ea8-6e1dcc71251e service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:04.054902 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee7f6a-be9e-47b4-8ea8-6e1dcc71251e service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:04.055168 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee7f6a-be9e-47b4-8ea8-6e1dcc71251e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:04.056839 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-baee7f6a-be9e-47b4-8ea8-6e1dcc71251e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:04.181974 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee7f6a-be9e-47b4-8ea8-6e1dcc71251e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:04.185840 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee7f6a-be9e-47b4-8ea8-6e1dcc71251e service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:04.205906 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 673/1349] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:09.055606 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42270c-2e53-48f7-abd0-bbe4d3e5e763 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:09.056092 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42270c-2e53-48f7-abd0-bbe4d3e5e763 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:09.056206 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42270c-2e53-48f7-abd0-bbe4d3e5e763 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:09.057922 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 677/1350] 10.222.0.49 () {54 vars in 921 bytes} [Wed Aug 24 04:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:09.064251 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ff295-d932-4b4d-b044-d24e3eef18e9 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:09.064658 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ff295-d932-4b4d-b044-d24e3eef18e9 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:09.064759 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ff295-d932-4b4d-b044-d24e3eef18e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:09.207409 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-5c6ff295-d932-4b4d-b044-d24e3eef18e9 None None] MFA Rules not processed for user `edf1b960a2eb4e5e9ada736b5f3f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:09.208862 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-5c6ff295-d932-4b4d-b044-d24e3eef18e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:09.230413 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:09.345561 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 674/1351] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Aug 24 04:42:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:13.345003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95937f0e-6325-4443-84fb-6ed6206ada7d None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:13.345563 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95937f0e-6325-4443-84fb-6ed6206ada7d None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:13.345563 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95937f0e-6325-4443-84fb-6ed6206ada7d None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:13.347116 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 678/1352] 10.222.0.49 () {54 vars in 921 bytes} [Wed Aug 24 04:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:13.351975 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adf783-3600-4530-9520-6abb760be10f None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:13.352445 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adf783-3600-4530-9520-6abb760be10f None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:13.352721 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adf783-3600-4530-9520-6abb760be10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:13.439438 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-32adf783-3600-4530-9520-6abb760be10f None None] MFA Rules not processed for user `edf1b960a2eb4e5e9ada736b5f3f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:13.440739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-32adf783-3600-4530-9520-6abb760be10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:13.518449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:13.556256 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 675/1353] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Aug 24 04:42:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:14.947250 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf9c96-e0ae-4056-bc04-2d6bb8fec0c6 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:14.947811 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf9c96-e0ae-4056-bc04-2d6bb8fec0c6 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:14.947811 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf9c96-e0ae-4056-bc04-2d6bb8fec0c6 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:14.949225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 679/1354] 10.222.0.49 () {54 vars in 921 bytes} [Wed Aug 24 04:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:14.954554 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f71fc-a9e7-479d-ad92-259a02abb308 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:14.954988 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f71fc-a9e7-479d-ad92-259a02abb308 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:14.955132 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f71fc-a9e7-479d-ad92-259a02abb308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:15.035246 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-040f71fc-a9e7-479d-ad92-259a02abb308 None None] MFA Rules not processed for user `edf1b960a2eb4e5e9ada736b5f3f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:15.036464 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-040f71fc-a9e7-479d-ad92-259a02abb308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:15.151247 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 676/1355] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Aug 24 04:42:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:42:18.513760 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4435ac9-064f-479d-bca1-eeb0197a2a74 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:18.514333 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4435ac9-064f-479d-bca1-eeb0197a2a74 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:18.514333 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4435ac9-064f-479d-bca1-eeb0197a2a74 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:18.515662 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 680/1356] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:18.521240 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132aa12-f6e3-4648-9ba3-580740a1e8ae None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:18.522052 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132aa12-f6e3-4648-9ba3-580740a1e8ae None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:18.522499 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132aa12-f6e3-4648-9ba3-580740a1e8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:18.575494 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:18.619114 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-f132aa12-f6e3-4648-9ba3-580740a1e8ae None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:18.622968 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-f132aa12-f6e3-4648-9ba3-580740a1e8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:18.751422 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 677/1357] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:19.052767 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94dc1c0-1039-478f-a613-efc8014a98fa None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:19.054084 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94dc1c0-1039-478f-a613-efc8014a98fa None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:19.054566 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94dc1c0-1039-478f-a613-efc8014a98fa None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:19.056590 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 681/1358] 10.222.0.49 () {54 vars in 962 bytes} [Wed Aug 24 04:42:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:19.065890 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9fd00-635f-49d3-b520-fd57640348e2 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:19.066894 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9fd00-635f-49d3-b520-fd57640348e2 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:19.067685 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9fd00-635f-49d3-b520-fd57640348e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:19.164538 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-a9d9fd00-635f-49d3-b520-fd57640348e2 None None] MFA Rules not processed for user `9dc9a3cf381e4a2da36ed82b407a2d94`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:19.165809 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-a9d9fd00-635f-49d3-b520-fd57640348e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:19.218791 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:19.299867 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 678/1359] 10.222.0.49 () {58 vars in 1059 bytes} [Wed Aug 24 04:42:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:19.308073 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94dc1c0-1039-478f-a613-efc8014a98fa None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:19.309871 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-b94dc1c0-1039-478f-a613-efc8014a98fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:19.460806 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94dc1c0-1039-478f-a613-efc8014a98fa None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:19.543822 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:19.584608 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b815000-c9d8-4a41-8d39-2538d550786d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:19.585292 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b815000-c9d8-4a41-8d39-2538d550786d service nova] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:19.585753 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b815000-c9d8-4a41-8d39-2538d550786d service nova] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:19.586082 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b815000-c9d8-4a41-8d39-2538d550786d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:19.587813 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-5b815000-c9d8-4a41-8d39-2538d550786d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:19.676596 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b815000-c9d8-4a41-8d39-2538d550786d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:19.678346 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b815000-c9d8-4a41-8d39-2538d550786d service nova] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:19.697369 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 682/1360] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:21.822480 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5fbec-54bc-4f43-a414-a17c73639ef8 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:21.823006 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5fbec-54bc-4f43-a414-a17c73639ef8 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:21.823006 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5fbec-54bc-4f43-a414-a17c73639ef8 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:21.824485 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 679/1361] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:42:21.829930 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95409d5-8a4c-4fda-9770-adeb1ac2c99a None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:21.830493 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95409d5-8a4c-4fda-9770-adeb1ac2c99a None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:21.830493 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95409d5-8a4c-4fda-9770-adeb1ac2c99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:21.900406 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-d95409d5-8a4c-4fda-9770-adeb1ac2c99a None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:21.901655 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-d95409d5-8a4c-4fda-9770-adeb1ac2c99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:21.944079 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:22.017509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 683/1362] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:22.308264 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5fbec-54bc-4f43-a414-a17c73639ef8 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:22.309935 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-35d5fbec-54bc-4f43-a414-a17c73639ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:22.463461 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5fbec-54bc-4f43-a414-a17c73639ef8 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:22.472672 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:22.589520 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116c7f3-a160-4581-8fb0-3a613c1a0508 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:22.590354 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116c7f3-a160-4581-8fb0-3a613c1a0508 service nova] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:22.590824 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116c7f3-a160-4581-8fb0-3a613c1a0508 service nova] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:22.591065 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116c7f3-a160-4581-8fb0-3a613c1a0508 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:22.592913 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-3116c7f3-a160-4581-8fb0-3a613c1a0508 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:22.700854 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116c7f3-a160-4581-8fb0-3a613c1a0508 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:22.702559 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116c7f3-a160-4581-8fb0-3a613c1a0508 service nova] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:22.725515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 680/1363] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:24.932821 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa45b28-812d-442e-84d6-36a579b6643d None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:24.933761 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa45b28-812d-442e-84d6-36a579b6643d None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:24.933761 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa45b28-812d-442e-84d6-36a579b6643d None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:24.935033 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 684/1364] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:24.940502 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8145ad-a9ca-4c4b-9510-827872d93fd2 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:24.940960 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8145ad-a9ca-4c4b-9510-827872d93fd2 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:24.941073 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8145ad-a9ca-4c4b-9510-827872d93fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:24.959212 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:25.015890 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-8c8145ad-a9ca-4c4b-9510-827872d93fd2 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:25.017122 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-8c8145ad-a9ca-4c4b-9510-827872d93fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:25.120201 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 681/1365] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:25.407993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63404d9-3e7f-45f1-8135-533bf903fcdc None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:25.408281 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63404d9-3e7f-45f1-8135-533bf903fcdc None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:25.408555 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63404d9-3e7f-45f1-8135-533bf903fcdc None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:25.410074 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 685/1366] 10.222.0.49 () {54 vars in 962 bytes} [Wed Aug 24 04:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:25.415503 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dfa6d9-9cac-4d9a-81a1-db345003eb0e None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:25.415916 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dfa6d9-9cac-4d9a-81a1-db345003eb0e None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:25.416255 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dfa6d9-9cac-4d9a-81a1-db345003eb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:25.506039 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-38dfa6d9-9cac-4d9a-81a1-db345003eb0e None None] MFA Rules not processed for user `9dc9a3cf381e4a2da36ed82b407a2d94`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:25.507305 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-38dfa6d9-9cac-4d9a-81a1-db345003eb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:25.543590 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:25.632453 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 682/1367] 10.222.0.49 () {58 vars in 1059 bytes} [Wed Aug 24 04:42:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:25.640111 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63404d9-3e7f-45f1-8135-533bf903fcdc None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:25.641660 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-f63404d9-3e7f-45f1-8135-533bf903fcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:25.794558 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63404d9-3e7f-45f1-8135-533bf903fcdc None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:25.815721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:25.910227 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc4401-7795-4a23-8823-730fb5e55a37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:25.910756 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc4401-7795-4a23-8823-730fb5e55a37 service nova] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:25.911031 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc4401-7795-4a23-8823-730fb5e55a37 service nova] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:25.911345 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc4401-7795-4a23-8823-730fb5e55a37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:25.912961 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-6ecc4401-7795-4a23-8823-730fb5e55a37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:26.005661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc4401-7795-4a23-8823-730fb5e55a37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:26.007323 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc4401-7795-4a23-8823-730fb5e55a37 service nova] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:26.029202 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 686/1368] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:26.585828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc0c07-3179-4a63-a82c-5deb311eca90 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:26.586347 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc0c07-3179-4a63-a82c-5deb311eca90 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:26.586347 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc0c07-3179-4a63-a82c-5deb311eca90 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:26.588865 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 683/1369] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:42:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:26.593572 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21300416-8d0c-49ea-8904-912974fdea41 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:26.593863 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21300416-8d0c-49ea-8904-912974fdea41 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:26.594134 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21300416-8d0c-49ea-8904-912974fdea41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:26.627547 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:26.662253 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-21300416-8d0c-49ea-8904-912974fdea41 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:26.663573 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-21300416-8d0c-49ea-8904-912974fdea41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:26.766334 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 687/1370] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:27.354782 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c06ca-7520-4fcb-b518-d9653839b385 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:27.354782 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c06ca-7520-4fcb-b518-d9653839b385 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:27.354782 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c06ca-7520-4fcb-b518-d9653839b385 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:27.357064 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 684/1371] 10.222.0.49 () {54 vars in 964 bytes} [Wed Aug 24 04:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:27.361058 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52fe81-2283-4371-9cfe-42fe0ff5d0a6 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:27.361593 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52fe81-2283-4371-9cfe-42fe0ff5d0a6 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:27.361849 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be52fe81-2283-4371-9cfe-42fe0ff5d0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:27.451213 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-be52fe81-2283-4371-9cfe-42fe0ff5d0a6 None None] MFA Rules not processed for user `2a957fc61ff14c35aac0b577c3c1baf5`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:27.452495 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-be52fe81-2283-4371-9cfe-42fe0ff5d0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:27.505528 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:27.544980 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 688/1372] 10.222.0.49 () {58 vars in 1061 bytes} [Wed Aug 24 04:42:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:42:27.553711 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c06ca-7520-4fcb-b518-d9653839b385 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:27.555240 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-be4c06ca-7520-4fcb-b518-d9653839b385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:27.671141 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c06ca-7520-4fcb-b518-d9653839b385 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:27.714356 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:27.755134 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e51fa5-9a35-4e7e-9dc9-d307e74f9c0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:27.755876 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e51fa5-9a35-4e7e-9dc9-d307e74f9c0d service cinder] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:27.756454 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e51fa5-9a35-4e7e-9dc9-d307e74f9c0d service cinder] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:27.757002 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e51fa5-9a35-4e7e-9dc9-d307e74f9c0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:27.759410 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-a8e51fa5-9a35-4e7e-9dc9-d307e74f9c0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:27.924905 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e51fa5-9a35-4e7e-9dc9-d307e74f9c0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:27.926946 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e51fa5-9a35-4e7e-9dc9-d307e74f9c0d service cinder] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:27.953725 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 685/1373] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:28.026416 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa554fd-af9f-43c2-8d9e-a204524b9fc2 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:28.026997 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa554fd-af9f-43c2-8d9e-a204524b9fc2 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:28.026997 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa554fd-af9f-43c2-8d9e-a204524b9fc2 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:28.030050 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 689/1374] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:42:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:28.033558 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766136d8-2034-4b7f-a3d4-12d967ef8ce9 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:28.033878 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766136d8-2034-4b7f-a3d4-12d967ef8ce9 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:28.034344 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766136d8-2034-4b7f-a3d4-12d967ef8ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:28.127500 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-766136d8-2034-4b7f-a3d4-12d967ef8ce9 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:28.129072 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-766136d8-2034-4b7f-a3d4-12d967ef8ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:28.165563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:28.247266 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 686/1375] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:28.534673 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa554fd-af9f-43c2-8d9e-a204524b9fc2 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:28.536356 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-ffa554fd-af9f-43c2-8d9e-a204524b9fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:28.684925 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa554fd-af9f-43c2-8d9e-a204524b9fc2 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:28.736159 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:28.797644 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c522fc-22c4-4e29-b088-20f0c69cd561 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:28.798177 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c522fc-22c4-4e29-b088-20f0c69cd561 service nova] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:28.798459 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c522fc-22c4-4e29-b088-20f0c69cd561 service nova] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:28.798732 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c522fc-22c4-4e29-b088-20f0c69cd561 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:28.800373 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-97c522fc-22c4-4e29-b088-20f0c69cd561 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:28.891894 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c522fc-22c4-4e29-b088-20f0c69cd561 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:28.893600 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c522fc-22c4-4e29-b088-20f0c69cd561 service nova] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:28.913172 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 690/1376] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:30.861557 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657e5e7-d3b7-4e55-86fc-0c512bfedfdc None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:30.862131 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657e5e7-d3b7-4e55-86fc-0c512bfedfdc None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:30.862131 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657e5e7-d3b7-4e55-86fc-0c512bfedfdc None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:30.863854 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 687/1377] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:30.869425 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89b746-ee10-4ced-8169-8a4c9a50f944 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:30.869880 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89b746-ee10-4ced-8169-8a4c9a50f944 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:30.869975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89b746-ee10-4ced-8169-8a4c9a50f944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:30.946705 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-ad89b746-ee10-4ced-8169-8a4c9a50f944 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:30.947981 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-ad89b746-ee10-4ced-8169-8a4c9a50f944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:30.954640 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:31.065350 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 691/1378] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:31.353090 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657e5e7-d3b7-4e55-86fc-0c512bfedfdc None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:31.354816 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-e657e5e7-d3b7-4e55-86fc-0c512bfedfdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:31.552640 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657e5e7-d3b7-4e55-86fc-0c512bfedfdc None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:31.556627 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:31.676190 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374848fe-d565-4be9-a715-f1dab529ea9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:31.676803 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374848fe-d565-4be9-a715-f1dab529ea9a service nova] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:31.677088 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374848fe-d565-4be9-a715-f1dab529ea9a service nova] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:31.677395 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374848fe-d565-4be9-a715-f1dab529ea9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:31.679024 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-374848fe-d565-4be9-a715-f1dab529ea9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:31.773515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374848fe-d565-4be9-a715-f1dab529ea9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:31.775280 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374848fe-d565-4be9-a715-f1dab529ea9a service nova] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:31.794245 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 688/1379] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:42:33.740616 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5f3cf-bea9-42d3-819d-e0969f71e0a3 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:33.741255 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5f3cf-bea9-42d3-819d-e0969f71e0a3 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:33.741255 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5f3cf-bea9-42d3-819d-e0969f71e0a3 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:33.742768 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 692/1380] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:33.748459 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bb23c-39f6-41d4-b7da-bea1390e8c89 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:33.748927 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bb23c-39f6-41d4-b7da-bea1390e8c89 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:33.749033 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bb23c-39f6-41d4-b7da-bea1390e8c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:33.761710 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:33.823567 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-751bb23c-39f6-41d4-b7da-bea1390e8c89 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:33.824793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-751bb23c-39f6-41d4-b7da-bea1390e8c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:33.929430 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 689/1381] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:34.215121 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5f3cf-bea9-42d3-819d-e0969f71e0a3 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:34.216637 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-36f5f3cf-bea9-42d3-819d-e0969f71e0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:34.371281 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:34.382031 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5f3cf-bea9-42d3-819d-e0969f71e0a3 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:34.501128 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16674c-d433-43a5-b441-ad7e7fce707b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:34.502759 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16674c-d433-43a5-b441-ad7e7fce707b service nova] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:34.502759 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16674c-d433-43a5-b441-ad7e7fce707b service nova] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:34.502759 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16674c-d433-43a5-b441-ad7e7fce707b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:34.504089 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-ae16674c-d433-43a5-b441-ad7e7fce707b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:34.601665 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16674c-d433-43a5-b441-ad7e7fce707b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:34.603386 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16674c-d433-43a5-b441-ad7e7fce707b service nova] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:34.614936 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:34.624907 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 693/1382] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:36.770096 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c5047-022d-4afc-9db5-764c6fbbdfea None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:36.770679 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c5047-022d-4afc-9db5-764c6fbbdfea None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:36.770679 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c5047-022d-4afc-9db5-764c6fbbdfea None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:36.772095 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 690/1383] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:36.778091 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d307f-d4fb-422f-9d39-db4d03976f07 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:36.778650 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d307f-d4fb-422f-9d39-db4d03976f07 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:36.778650 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d307f-d4fb-422f-9d39-db4d03976f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:36.858652 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-e98d307f-d4fb-422f-9d39-db4d03976f07 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:36.859956 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-e98d307f-d4fb-422f-9d39-db4d03976f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:36.968677 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 694/1384] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:42:37.255316 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c5047-022d-4afc-9db5-764c6fbbdfea None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:37.257487 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-530c5047-022d-4afc-9db5-764c6fbbdfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:37.377165 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:37.447827 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c5047-022d-4afc-9db5-764c6fbbdfea None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:37.584113 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645c195-7976-4fcb-9a73-84fbcf028b37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:37.584766 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645c195-7976-4fcb-9a73-84fbcf028b37 service nova] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:37.585049 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645c195-7976-4fcb-9a73-84fbcf028b37 service nova] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:37.585444 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645c195-7976-4fcb-9a73-84fbcf028b37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:37.587068 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-2645c195-7976-4fcb-9a73-84fbcf028b37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:37.642175 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:37.686888 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645c195-7976-4fcb-9a73-84fbcf028b37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:37.688573 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645c195-7976-4fcb-9a73-84fbcf028b37 service nova] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:37.711589 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 691/1385] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:40.123387 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f9c92-cb64-4d8d-83d0-cb48c4791fb9 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:40.123994 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f9c92-cb64-4d8d-83d0-cb48c4791fb9 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:40.123994 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f9c92-cb64-4d8d-83d0-cb48c4791fb9 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:40.125518 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 695/1386] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:42:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:40.132928 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8218417-8ffe-4e45-b520-7bdd828c507a None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:40.133480 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8218417-8ffe-4e45-b520-7bdd828c507a None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:40.133650 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8218417-8ffe-4e45-b520-7bdd828c507a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:40.226002 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-c8218417-8ffe-4e45-b520-7bdd828c507a None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:40.227652 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-c8218417-8ffe-4e45-b520-7bdd828c507a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:40.336146 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 692/1387] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:40.631142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f9c92-cb64-4d8d-83d0-cb48c4791fb9 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:40.632939 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-e75f9c92-cb64-4d8d-83d0-cb48c4791fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:40.717878 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:40.793056 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f9c92-cb64-4d8d-83d0-cb48c4791fb9 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:40.913053 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c984c1e-1eea-4250-87bd-b7c347e0760d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:40.913629 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c984c1e-1eea-4250-87bd-b7c347e0760d service nova] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:40.913911 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c984c1e-1eea-4250-87bd-b7c347e0760d service nova] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:40.914179 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c984c1e-1eea-4250-87bd-b7c347e0760d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:40.915866 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-4c984c1e-1eea-4250-87bd-b7c347e0760d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:40.957826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:41.013133 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c984c1e-1eea-4250-87bd-b7c347e0760d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:41.014821 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c984c1e-1eea-4250-87bd-b7c347e0760d service nova] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:41.033498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 696/1388] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:42.889930 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb28a1-551a-42a4-88af-f57d7892aa22 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:42.890611 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb28a1-551a-42a4-88af-f57d7892aa22 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:42.890611 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb28a1-551a-42a4-88af-f57d7892aa22 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:42.891949 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 693/1389] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:42.897423 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f765f4-e3de-47e2-8bd2-9911981cc4c0 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:42.897903 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f765f4-e3de-47e2-8bd2-9911981cc4c0 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:42.898020 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f765f4-e3de-47e2-8bd2-9911981cc4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:42.964799 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e19a0-38cc-4f9e-abb9-fc9025b86d44 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:42.965101 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e19a0-38cc-4f9e-abb9-fc9025b86d44 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:42.965592 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e19a0-38cc-4f9e-abb9-fc9025b86d44 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:42.967589 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 694/1390] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:42:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:42.971704 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-e4f765f4-e3de-47e2-8bd2-9911981cc4c0 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:42.972976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-e4f765f4-e3de-47e2-8bd2-9911981cc4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:42.973407 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28cfc3-989e-46bd-b4ea-f67b7d05e02b None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:42.973697 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28cfc3-989e-46bd-b4ea-f67b7d05e02b None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:42.973970 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac28cfc3-989e-46bd-b4ea-f67b7d05e02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:43.013565 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:43.045708 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-ac28cfc3-989e-46bd-b4ea-f67b7d05e02b None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:43.046957 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-ac28cfc3-989e-46bd-b4ea-f67b7d05e02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:43.078428 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 697/1391] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:43.145396 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 695/1392] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:43.373365 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6846fa9-7fb5-4b19-a4a1-7cdb7d1d9c5f None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:43.373677 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6846fa9-7fb5-4b19-a4a1-7cdb7d1d9c5f None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:43.373929 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6846fa9-7fb5-4b19-a4a1-7cdb7d1d9c5f None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:43.375386 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 698/1393] 10.222.0.49 () {54 vars in 967 bytes} [Wed Aug 24 04:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:43.380623 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358056f-dc42-4d68-8fab-ee41279e9ea0 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:43.380907 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358056f-dc42-4d68-8fab-ee41279e9ea0 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:43.381181 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358056f-dc42-4d68-8fab-ee41279e9ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:43.444758 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6846fa9-7fb5-4b19-a4a1-7cdb7d1d9c5f None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:43.446399 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-d6846fa9-7fb5-4b19-a4a1-7cdb7d1d9c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:43.461314 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:43.462477 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-1358056f-dc42-4d68-8fab-ee41279e9ea0 None None] MFA Rules not processed for user `2be44ea93247420d994e24912a9ac32e`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:43.463801 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-1358056f-dc42-4d68-8fab-ee41279e9ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:43.513456 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:43.542493 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 696/1394] 10.222.0.49 () {58 vars in 1064 bytes} [Wed Aug 24 04:42:43 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:43.550218 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358056f-dc42-4d68-8fab-ee41279e9ea0 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:43.557970 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358056f-dc42-4d68-8fab-ee41279e9ea0 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:43.601297 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6846fa9-7fb5-4b19-a4a1-7cdb7d1d9c5f None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:43.634707 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de298c-0a96-4b69-8c47-c0048fa63e48 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be44ea93247420d994e24912a9ac32e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:43.635618 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de298c-0a96-4b69-8c47-c0048fa63e48 service glance] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:43.635896 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de298c-0a96-4b69-8c47-c0048fa63e48 service glance] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:43.636167 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de298c-0a96-4b69-8c47-c0048fa63e48 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:43.637868 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-02de298c-0a96-4b69-8c47-c0048fa63e48 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:43.690484 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:43.719572 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb48cc-b23e-4336-9011-c4261be14c0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:43.720203 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb48cc-b23e-4336-9011-c4261be14c0f service nova] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:43.720489 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb48cc-b23e-4336-9011-c4261be14c0f service nova] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:43.720762 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb48cc-b23e-4336-9011-c4261be14c0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:43.722433 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-2bcb48cc-b23e-4336-9011-c4261be14c0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:43.754353 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de298c-0a96-4b69-8c47-c0048fa63e48 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:43.755846 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de298c-0a96-4b69-8c47-c0048fa63e48 service glance] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:43.771052 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:43.776527 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 697/1395] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:42:43.814974 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb48cc-b23e-4336-9011-c4261be14c0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:43.816588 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb48cc-b23e-4336-9011-c4261be14c0f service nova] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:43.834965 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 699/1396] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:44.536590 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a94ed-3382-4637-a2eb-12d1ad221655 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:44.537053 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a94ed-3382-4637-a2eb-12d1ad221655 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:44.537159 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a94ed-3382-4637-a2eb-12d1ad221655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:44.607686 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-709a94ed-3382-4637-a2eb-12d1ad221655 None None] MFA Rules not processed for user `c737c4586910476eafead0dfd4d9bc4c`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:44.608916 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-709a94ed-3382-4637-a2eb-12d1ad221655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:44.694703 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 698/1397] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 24 04:42:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:44.737176 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc4f5b-85ca-428f-bc00-c50d7717bc18 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:44.737704 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc4f5b-85ca-428f-bc00-c50d7717bc18 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:44.737812 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc4f5b-85ca-428f-bc00-c50d7717bc18 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:44.739181 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 700/1398] 10.222.0.49 () {54 vars in 943 bytes} [Wed Aug 24 04:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:44.745932 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64beac-428c-4947-a277-91db3064a6aa None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:44.746273 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64beac-428c-4947-a277-91db3064a6aa None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:44.746551 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64beac-428c-4947-a277-91db3064a6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:44.823314 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-8f64beac-428c-4947-a277-91db3064a6aa None None] MFA Rules not processed for user `a7ebb5105220438693118d734c9fda70`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:44.824472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-8f64beac-428c-4947-a277-91db3064a6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:44.854241 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:44.937542 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 699/1399] 10.222.0.49 () {58 vars in 1040 bytes} [Wed Aug 24 04:42:44 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:44.947522 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc4f5b-85ca-428f-bc00-c50d7717bc18 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:44.949143 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-89fc4f5b-85ca-428f-bc00-c50d7717bc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:45.051777 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:45.094092 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc4f5b-85ca-428f-bc00-c50d7717bc18 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:45.203918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07bbda1-e3c6-4d10-8e7c-7bfbe7b2c5cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ebb5105220438693118d734c9fda70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:45.204626 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bbda1-e3c6-4d10-8e7c-7bfbe7b2c5cf service swift] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:45.204896 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bbda1-e3c6-4d10-8e7c-7bfbe7b2c5cf service swift] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:45.205161 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bbda1-e3c6-4d10-8e7c-7bfbe7b2c5cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:45.206797 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-a07bbda1-e3c6-4d10-8e7c-7bfbe7b2c5cf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:45.290303 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07bbda1-e3c6-4d10-8e7c-7bfbe7b2c5cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:45.291920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07bbda1-e3c6-4d10-8e7c-7bfbe7b2c5cf service swift] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:45.295694 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:45.301072 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 701/1400] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 24 04:42:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:42:45.783932 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219feca-3154-408c-b40b-1f89f7e3cab8 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:45.785222 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219feca-3154-408c-b40b-1f89f7e3cab8 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:45.785931 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219feca-3154-408c-b40b-1f89f7e3cab8 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:45.787774 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 700/1401] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:42:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:45.793476 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723793b3-88ea-4e45-8b43-1ee9ee0d30ac None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:45.793958 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723793b3-88ea-4e45-8b43-1ee9ee0d30ac None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:45.794098 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723793b3-88ea-4e45-8b43-1ee9ee0d30ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:45.862063 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-723793b3-88ea-4e45-8b43-1ee9ee0d30ac None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:45.863327 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-723793b3-88ea-4e45-8b43-1ee9ee0d30ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:45.969115 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 702/1402] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:46.257285 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219feca-3154-408c-b40b-1f89f7e3cab8 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:46.259332 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-a219feca-3154-408c-b40b-1f89f7e3cab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:46.428187 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219feca-3154-408c-b40b-1f89f7e3cab8 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:46.431078 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:46.592991 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965fec6-ab5d-446f-9482-46c3e033623e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:46.593773 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965fec6-ab5d-446f-9482-46c3e033623e service nova] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:46.594195 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965fec6-ab5d-446f-9482-46c3e033623e service nova] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:46.594473 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965fec6-ab5d-446f-9482-46c3e033623e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:46.596519 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-2965fec6-ab5d-446f-9482-46c3e033623e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:46.721700 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965fec6-ab5d-446f-9482-46c3e033623e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:46.723707 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965fec6-ab5d-446f-9482-46c3e033623e service nova] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:46.748857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 701/1403] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:48.693373 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e80f7a-db22-4cdc-a41a-cf191ca25a80 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:48.693973 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e80f7a-db22-4cdc-a41a-cf191ca25a80 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:48.693973 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e80f7a-db22-4cdc-a41a-cf191ca25a80 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:48.695190 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 703/1404] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:48.700737 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c880ff-b4c4-4bb6-bbff-423c27727807 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:48.701266 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c880ff-b4c4-4bb6-bbff-423c27727807 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:48.701525 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c880ff-b4c4-4bb6-bbff-423c27727807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:48.714226 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:48.779815 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-00c880ff-b4c4-4bb6-bbff-423c27727807 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:48.781397 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-00c880ff-b4c4-4bb6-bbff-423c27727807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:48.894368 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 702/1405] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:49.178237 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e80f7a-db22-4cdc-a41a-cf191ca25a80 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:49.179844 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-67e80f7a-db22-4cdc-a41a-cf191ca25a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:49.273034 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:49.350981 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e80f7a-db22-4cdc-a41a-cf191ca25a80 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:49.474392 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45deb532-e49c-4b62-abdc-8579c9b75ec2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:49.474967 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45deb532-e49c-4b62-abdc-8579c9b75ec2 service nova] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:49.475248 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45deb532-e49c-4b62-abdc-8579c9b75ec2 service nova] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:49.475525 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45deb532-e49c-4b62-abdc-8579c9b75ec2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:49.477569 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-45deb532-e49c-4b62-abdc-8579c9b75ec2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:49.650907 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:49.704307 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45deb532-e49c-4b62-abdc-8579c9b75ec2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:49.706861 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45deb532-e49c-4b62-abdc-8579c9b75ec2 service nova] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:49.726212 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 704/1406] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:42:51.690951 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdacc31-5454-4d57-9c54-73b11bc1fecc None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:51.691527 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdacc31-5454-4d57-9c54-73b11bc1fecc None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:51.691527 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdacc31-5454-4d57-9c54-73b11bc1fecc None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:51.696888 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 703/1407] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:42:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:51.698371 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69e70f-a2d6-4fc4-abdd-b7cd6161a538 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:51.698769 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69e70f-a2d6-4fc4-abdd-b7cd6161a538 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:51.698924 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69e70f-a2d6-4fc4-abdd-b7cd6161a538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:51.770972 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-6e69e70f-a2d6-4fc4-abdd-b7cd6161a538 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:51.772208 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-6e69e70f-a2d6-4fc4-abdd-b7cd6161a538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:51.885462 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 705/1408] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:42:52.166876 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdacc31-5454-4d57-9c54-73b11bc1fecc None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:52.168484 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-ecdacc31-5454-4d57-9c54-73b11bc1fecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:52.263661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:52.333662 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdacc31-5454-4d57-9c54-73b11bc1fecc None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:52.458701 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b377ef-4194-45ce-b6e9-18426cdcaf2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:52.459223 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b377ef-4194-45ce-b6e9-18426cdcaf2e service nova] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:52.459496 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b377ef-4194-45ce-b6e9-18426cdcaf2e service nova] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:52.459760 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b377ef-4194-45ce-b6e9-18426cdcaf2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:52.461484 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-a5b377ef-4194-45ce-b6e9-18426cdcaf2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:52.512834 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:52.560082 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b377ef-4194-45ce-b6e9-18426cdcaf2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:52.563409 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b377ef-4194-45ce-b6e9-18426cdcaf2e service nova] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:52.588171 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 704/1409] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:42:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:43:01.870566 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=93 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:02.622647 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=24 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:07.347791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19cc1a-5a7b-4562-8bf8-105281e9edae None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:07.348396 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19cc1a-5a7b-4562-8bf8-105281e9edae None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:07.348396 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19cc1a-5a7b-4562-8bf8-105281e9edae None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:07.350550 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 706/1410] 10.222.0.49 () {54 vars in 918 bytes} [Wed Aug 24 04:43:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:07.356050 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f454a-4cd3-409d-a05a-bcd630f9c44a None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:07.356534 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f454a-4cd3-409d-a05a-bcd630f9c44a None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:07.356637 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f454a-4cd3-409d-a05a-bcd630f9c44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:07.436245 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-633f454a-4cd3-409d-a05a-bcd630f9c44a None None] MFA Rules not processed for user `edf1b960a2eb4e5e9ada736b5f3f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:07.437453 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-633f454a-4cd3-409d-a05a-bcd630f9c44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:07.555625 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 705/1411] 10.222.0.49 () {58 vars in 1015 bytes} [Wed Aug 24 04:43:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:07.576395 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f0959-be49-4189-9190-e686cddb25dc None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:07.576677 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f0959-be49-4189-9190-e686cddb25dc None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:07.576946 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f0959-be49-4189-9190-e686cddb25dc None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:07.578330 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 707/1412] 10.222.0.49 () {54 vars in 918 bytes} [Wed Aug 24 04:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:07.583511 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab72f11-7ea5-48a0-acff-007246ec45fc None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:07.583802 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab72f11-7ea5-48a0-acff-007246ec45fc None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:07.584076 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab72f11-7ea5-48a0-acff-007246ec45fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:07.660429 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:07.666005 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-3ab72f11-7ea5-48a0-acff-007246ec45fc None None] MFA Rules not processed for user `9dc9a3cf381e4a2da36ed82b407a2d94`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:07.668493 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-3ab72f11-7ea5-48a0-acff-007246ec45fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:07.806119 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 706/1413] 10.222.0.49 () {58 vars in 1015 bytes} [Wed Aug 24 04:43:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:10.199932 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb29c3-38d2-46b7-9833-b87d068e3e58 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:10.200506 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb29c3-38d2-46b7-9833-b87d068e3e58 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:10.200506 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb29c3-38d2-46b7-9833-b87d068e3e58 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:10.202544 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:43:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:10.208425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b74a94-7f91-47d6-9077-0d18c033a6e5 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:10.208840 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b74a94-7f91-47d6-9077-0d18c033a6e5 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:10.209018 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b74a94-7f91-47d6-9077-0d18c033a6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:10.277732 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-39b74a94-7f91-47d6-9077-0d18c033a6e5 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:10.278949 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-39b74a94-7f91-47d6-9077-0d18c033a6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:10.335411 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:10.384150 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:43:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:10.674038 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb29c3-38d2-46b7-9833-b87d068e3e58 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:10.675642 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-09fb29c3-38d2-46b7-9833-b87d068e3e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:10.832052 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb29c3-38d2-46b7-9833-b87d068e3e58 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:10.916186 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:10.955438 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4795d-e7c1-4e48-84eb-c249820ad14a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:10.956046 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4795d-e7c1-4e48-84eb-c249820ad14a service nova] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:10.956320 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4795d-e7c1-4e48-84eb-c249820ad14a service nova] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:10.956607 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4795d-e7c1-4e48-84eb-c249820ad14a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:10.958287 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-c9c4795d-e7c1-4e48-84eb-c249820ad14a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:11.063470 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c4795d-e7c1-4e48-84eb-c249820ad14a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:11.065098 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c4795d-e7c1-4e48-84eb-c249820ad14a service nova] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:11.083153 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 709/1416] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:43:11.985907 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776e93d-d12c-4b73-be20-59d754102d5f None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:11.986873 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776e93d-d12c-4b73-be20-59d754102d5f None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:11.986873 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776e93d-d12c-4b73-be20-59d754102d5f None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:11.989421 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:43:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:11.995496 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7b4a5-96fd-4499-8e12-817ba3a0ee57 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:11.995955 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7b4a5-96fd-4499-8e12-817ba3a0ee57 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:11.996067 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7b4a5-96fd-4499-8e12-817ba3a0ee57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:12.081378 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-73d7b4a5-96fd-4499-8e12-817ba3a0ee57 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:12.082636 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-73d7b4a5-96fd-4499-8e12-817ba3a0ee57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:12.110577 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:12.187456 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:12.340494 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776e93d-d12c-4b73-be20-59d754102d5f None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:12.342079 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-c776e93d-d12c-4b73-be20-59d754102d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:12.504922 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776e93d-d12c-4b73-be20-59d754102d5f None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:12.548088 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:12.625388 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae336fe2-d216-4538-9088-2e407360272e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:12.625934 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae336fe2-d216-4538-9088-2e407360272e service nova] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:12.626207 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae336fe2-d216-4538-9088-2e407360272e service nova] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:12.626479 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae336fe2-d216-4538-9088-2e407360272e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:12.628171 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-ae336fe2-d216-4538-9088-2e407360272e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:12.722513 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae336fe2-d216-4538-9088-2e407360272e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:12.724170 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae336fe2-d216-4538-9088-2e407360272e service nova] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:12.743428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 709/1419] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:43:13.628915 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd7ed7-a1ea-4aef-95b8-3a7e9df4bccc None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:13.629957 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd7ed7-a1ea-4aef-95b8-3a7e9df4bccc None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:13.629957 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dd7ed7-a1ea-4aef-95b8-3a7e9df4bccc None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:13.632144 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:43:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:13.638553 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cca81d-6662-4bd9-81a6-aa374fd38f4e None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:13.639023 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cca81d-6662-4bd9-81a6-aa374fd38f4e None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:13.639125 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cca81d-6662-4bd9-81a6-aa374fd38f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:13.693710 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:13.717041 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-a7cca81d-6662-4bd9-81a6-aa374fd38f4e None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:13.718313 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-a7cca81d-6662-4bd9-81a6-aa374fd38f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:13.841785 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:43:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:43:13.999189 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd7ed7-a1ea-4aef-95b8-3a7e9df4bccc None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:14.000649 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-05dd7ed7-a1ea-4aef-95b8-3a7e9df4bccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:14.160413 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dd7ed7-a1ea-4aef-95b8-3a7e9df4bccc None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:14.178591 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:14.290451 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a3539-6fa4-43f8-a467-c4f4c4b0c824 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:14.291012 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a3539-6fa4-43f8-a467-c4f4c4b0c824 service nova] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:14.291257 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a3539-6fa4-43f8-a467-c4f4c4b0c824 service nova] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:14.291552 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a3539-6fa4-43f8-a467-c4f4c4b0c824 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:14.293130 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-527a3539-6fa4-43f8-a467-c4f4c4b0c824 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:14.384217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a3539-6fa4-43f8-a467-c4f4c4b0c824 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:14.385911 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a3539-6fa4-43f8-a467-c4f4c4b0c824 service nova] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:14.403710 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 712/1422] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:43:15.273740 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d2835-c78f-44b4-b2e8-62e85e159cd7 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:15.274302 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d2835-c78f-44b4-b2e8-62e85e159cd7 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:15.274302 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d2835-c78f-44b4-b2e8-62e85e159cd7 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:15.275708 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:15.281843 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2f736-5800-49ea-8915-b52f7a9368e4 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:15.282565 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2f736-5800-49ea-8915-b52f7a9368e4 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:15.282766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af2f736-5800-49ea-8915-b52f7a9368e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:15.307036 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:15.376463 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-4af2f736-5800-49ea-8915-b52f7a9368e4 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:15.377716 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-4af2f736-5800-49ea-8915-b52f7a9368e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:15.479384 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:15.630272 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d2835-c78f-44b4-b2e8-62e85e159cd7 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:15.632735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-1e8d2835-c78f-44b4-b2e8-62e85e159cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:15.764006 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:15.803807 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d2835-c78f-44b4-b2e8-62e85e159cd7 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:15.924262 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1d60c-3d0d-47e0-9e09-d37131bf28ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:15.924871 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1d60c-3d0d-47e0-9e09-d37131bf28ba service nova] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:15.925183 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1d60c-3d0d-47e0-9e09-d37131bf28ba service nova] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:15.925487 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1d60c-3d0d-47e0-9e09-d37131bf28ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:15.927558 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-91b1d60c-3d0d-47e0-9e09-d37131bf28ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:16.015257 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:16.030324 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b1d60c-3d0d-47e0-9e09-d37131bf28ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:16.031963 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b1d60c-3d0d-47e0-9e09-d37131bf28ba service nova] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:16.050571 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 712/1425] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:43:16.910947 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4df08f-198c-4908-adc3-21a45b14c4c8 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:16.911541 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4df08f-198c-4908-adc3-21a45b14c4c8 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:16.911541 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4df08f-198c-4908-adc3-21a45b14c4c8 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:16.913491 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:43:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:16.919521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ec88a-884c-49cf-9284-0d99c65cfd4f None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:16.920007 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ec88a-884c-49cf-9284-0d99c65cfd4f None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:16.920145 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ec88a-884c-49cf-9284-0d99c65cfd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:17.006773 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-3f8ec88a-884c-49cf-9284-0d99c65cfd4f None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:17.008057 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-3f8ec88a-884c-49cf-9284-0d99c65cfd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:17.121352 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:43:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:17.276306 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4df08f-198c-4908-adc3-21a45b14c4c8 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:17.277843 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-dc4df08f-198c-4908-adc3-21a45b14c4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:17.366485 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:17.428101 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4df08f-198c-4908-adc3-21a45b14c4c8 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:17.550357 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7e5f0-e06b-4d22-84a6-0d9689f3170c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:17.550879 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7e5f0-e06b-4d22-84a6-0d9689f3170c service nova] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:17.551155 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7e5f0-e06b-4d22-84a6-0d9689f3170c service nova] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:17.551419 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7e5f0-e06b-4d22-84a6-0d9689f3170c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:17.553033 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-3ef7e5f0-e06b-4d22-84a6-0d9689f3170c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:17.606114 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:17.651210 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7e5f0-e06b-4d22-84a6-0d9689f3170c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:17.652975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7e5f0-e06b-4d22-84a6-0d9689f3170c service nova] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:17.673973 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 715/1428] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:43:18.488227 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39edefd6-3c98-4582-91f0-5ce8f397ecff None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:18.489012 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39edefd6-3c98-4582-91f0-5ce8f397ecff None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:18.489012 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39edefd6-3c98-4582-91f0-5ce8f397ecff None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:18.490892 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:43:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:18.496119 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9345858-c8c7-4419-9d1f-27fdf46e22e5 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:18.496563 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9345858-c8c7-4419-9d1f-27fdf46e22e5 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:18.496674 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9345858-c8c7-4419-9d1f-27fdf46e22e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:18.578855 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-c9345858-c8c7-4419-9d1f-27fdf46e22e5 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:18.580082 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-c9345858-c8c7-4419-9d1f-27fdf46e22e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:18.689140 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:43:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:18.841565 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39edefd6-3c98-4582-91f0-5ce8f397ecff None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:18.844031 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-39edefd6-3c98-4582-91f0-5ce8f397ecff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:18.900051 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:19.006445 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39edefd6-3c98-4582-91f0-5ce8f397ecff None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:19.134103 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1eb36-61c9-47cd-8e54-3970365d031b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:19.134655 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1eb36-61c9-47cd-8e54-3970365d031b service nova] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:19.134935 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1eb36-61c9-47cd-8e54-3970365d031b service nova] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:19.135209 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1eb36-61c9-47cd-8e54-3970365d031b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:19.136918 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-28f1eb36-61c9-47cd-8e54-3970365d031b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:19.144456 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:19.229614 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f1eb36-61c9-47cd-8e54-3970365d031b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:19.231318 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f1eb36-61c9-47cd-8e54-3970365d031b service nova] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:19.250069 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 715/1431] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:43:20.081075 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651e496-7044-48e0-964b-f547f42b3b6e None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:20.081726 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651e496-7044-48e0-964b-f547f42b3b6e None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:20.081726 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651e496-7044-48e0-964b-f547f42b3b6e None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:20.083020 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:20.088210 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297b3d3-f676-4497-97d4-edf363cab98c None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:20.088662 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297b3d3-f676-4497-97d4-edf363cab98c None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:20.088771 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297b3d3-f676-4497-97d4-edf363cab98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:20.166193 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-0297b3d3-f676-4497-97d4-edf363cab98c None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:20.167421 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-0297b3d3-f676-4497-97d4-edf363cab98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:20.242431 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:20.282816 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:43:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:20.429508 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7651e496-7044-48e0-964b-f547f42b3b6e None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:20.431010 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-7651e496-7044-48e0-964b-f547f42b3b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:20.456946 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:20.601009 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7651e496-7044-48e0-964b-f547f42b3b6e None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:20.691855 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:20.720404 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff437511-8ec7-4e26-bfd3-40d8cfd7b2b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:20.721054 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff437511-8ec7-4e26-bfd3-40d8cfd7b2b5 service nova] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:20.721344 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff437511-8ec7-4e26-bfd3-40d8cfd7b2b5 service nova] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:20.721624 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff437511-8ec7-4e26-bfd3-40d8cfd7b2b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:20.723254 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-ff437511-8ec7-4e26-bfd3-40d8cfd7b2b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:20.818716 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff437511-8ec7-4e26-bfd3-40d8cfd7b2b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:20.820307 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff437511-8ec7-4e26-bfd3-40d8cfd7b2b5 service nova] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:20.838473 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 718/1434] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:43:21.657258 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057073e-2387-4cc0-816b-e7f228d5b367 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:21.658232 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057073e-2387-4cc0-816b-e7f228d5b367 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:21.658232 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057073e-2387-4cc0-816b-e7f228d5b367 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:21.660504 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:43:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:21.665828 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea1e2a-c69b-4120-87ba-eb19cf2a7bda None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:21.666304 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea1e2a-c69b-4120-87ba-eb19cf2a7bda None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:21.666409 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea1e2a-c69b-4120-87ba-eb19cf2a7bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:21.746965 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-56ea1e2a-c69b-4120-87ba-eb19cf2a7bda None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:21.748215 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-56ea1e2a-c69b-4120-87ba-eb19cf2a7bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:21.795218 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:21.854348 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:22.016115 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057073e-2387-4cc0-816b-e7f228d5b367 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:22.018636 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-9057073e-2387-4cc0-816b-e7f228d5b367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:22.180525 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057073e-2387-4cc0-816b-e7f228d5b367 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:22.246551 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:22.307619 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a07712-e61d-472f-b493-d272b8402012 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:22.308221 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a07712-e61d-472f-b493-d272b8402012 service nova] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:22.308497 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a07712-e61d-472f-b493-d272b8402012 service nova] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:22.308764 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a07712-e61d-472f-b493-d272b8402012 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:22.310409 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-08a07712-e61d-472f-b493-d272b8402012 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:22.407092 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a07712-e61d-472f-b493-d272b8402012 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:22.408646 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a07712-e61d-472f-b493-d272b8402012 service nova] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:22.426951 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 718/1437] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:43:23.231692 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30485e6-4844-451c-beaf-bdad34a43aef None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:23.232224 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30485e6-4844-451c-beaf-bdad34a43aef None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:23.232224 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30485e6-4844-451c-beaf-bdad34a43aef None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:23.233567 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:23.240091 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ac531-9361-4c88-9c3a-8293e7e933cc None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:23.240806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ac531-9361-4c88-9c3a-8293e7e933cc None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:23.241164 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ac531-9361-4c88-9c3a-8293e7e933cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:23.331064 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-f79ac531-9361-4c88-9c3a-8293e7e933cc None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:23.332287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-f79ac531-9361-4c88-9c3a-8293e7e933cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:23.334435 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:23.434783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:23.587874 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30485e6-4844-451c-beaf-bdad34a43aef None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:23.590321 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-d30485e6-4844-451c-beaf-bdad34a43aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:23.751408 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30485e6-4844-451c-beaf-bdad34a43aef None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:23.783779 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:23.896529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875ab83-1f9f-4248-bcf8-4b7d677adee0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:23.897162 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875ab83-1f9f-4248-bcf8-4b7d677adee0 service nova] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:23.897480 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875ab83-1f9f-4248-bcf8-4b7d677adee0 service nova] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:23.897752 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875ab83-1f9f-4248-bcf8-4b7d677adee0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:23.899388 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-0875ab83-1f9f-4248-bcf8-4b7d677adee0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:23.994710 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0875ab83-1f9f-4248-bcf8-4b7d677adee0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:23.996308 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0875ab83-1f9f-4248-bcf8-4b7d677adee0 service nova] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:24.016288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 721/1440] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:43:25.799770 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9c7c8-42ac-4084-8f77-65d5adb0f0f7 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:25.800338 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9c7c8-42ac-4084-8f77-65d5adb0f0f7 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:25.800338 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9c7c8-42ac-4084-8f77-65d5adb0f0f7 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:25.801702 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:25.807805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6241c-c27a-4111-b195-6c9dcbfb9563 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:25.808226 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6241c-c27a-4111-b195-6c9dcbfb9563 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:25.808349 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6241c-c27a-4111-b195-6c9dcbfb9563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:25.858970 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:25.886707 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-13e6241c-c27a-4111-b195-6c9dcbfb9563 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:25.887905 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-13e6241c-c27a-4111-b195-6c9dcbfb9563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:25.997799 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:43:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:26.294501 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9c7c8-42ac-4084-8f77-65d5adb0f0f7 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:26.296835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-d5d9c7c8-42ac-4084-8f77-65d5adb0f0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:26.415102 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9c7c8-42ac-4084-8f77-65d5adb0f0f7 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:26.449463 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:26.494761 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e99574-dd8f-4ee7-8f37-587b014d82da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:26.495358 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e99574-dd8f-4ee7-8f37-587b014d82da service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:26.495634 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e99574-dd8f-4ee7-8f37-587b014d82da service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:26.495904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e99574-dd8f-4ee7-8f37-587b014d82da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:26.497595 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-95e99574-dd8f-4ee7-8f37-587b014d82da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:26.619167 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e99574-dd8f-4ee7-8f37-587b014d82da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:26.620677 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e99574-dd8f-4ee7-8f37-587b014d82da service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:26.640397 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 721/1443] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:43:28.691971 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d53981-49d3-44ff-ad79-b8f2260967e7 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:28.692662 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d53981-49d3-44ff-ad79-b8f2260967e7 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:28.692662 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d53981-49d3-44ff-ad79-b8f2260967e7 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:28.694561 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:43:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:28.701158 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46a432-2df4-43fa-93d7-384693b1279a None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:28.701894 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46a432-2df4-43fa-93d7-384693b1279a None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:28.702010 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46a432-2df4-43fa-93d7-384693b1279a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:28.786614 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-ae46a432-2df4-43fa-93d7-384693b1279a None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:28.787870 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-ae46a432-2df4-43fa-93d7-384693b1279a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:28.801935 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:28.892963 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:29.181200 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d53981-49d3-44ff-ad79-b8f2260967e7 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:29.183860 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-60d53981-49d3-44ff-ad79-b8f2260967e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:29.293053 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d53981-49d3-44ff-ad79-b8f2260967e7 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:29.305260 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:29.370544 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d5176-760b-42d2-843a-e1df06e7c536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:29.371154 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d5176-760b-42d2-843a-e1df06e7c536 service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:29.371433 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d5176-760b-42d2-843a-e1df06e7c536 service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:29.371709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d5176-760b-42d2-843a-e1df06e7c536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:29.373305 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-0a2d5176-760b-42d2-843a-e1df06e7c536 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:29.500721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d5176-760b-42d2-843a-e1df06e7c536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:29.502267 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d5176-760b-42d2-843a-e1df06e7c536 service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:29.522171 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 724/1446] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:43:31.725823 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1132f-3980-4cf7-99e9-c4e3963913a9 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:31.726446 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1132f-3980-4cf7-99e9-c4e3963913a9 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:31.726446 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1132f-3980-4cf7-99e9-c4e3963913a9 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:31.727731 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:31.734306 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e2225-bdf0-4afa-88d5-b49762147513 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:31.735087 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e2225-bdf0-4afa-88d5-b49762147513 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:31.735181 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e2225-bdf0-4afa-88d5-b49762147513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:31.794225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:31.817227 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-9f8e2225-bdf0-4afa-88d5-b49762147513 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:31.818488 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-9f8e2225-bdf0-4afa-88d5-b49762147513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:31.920057 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:43:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:32.218686 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1132f-3980-4cf7-99e9-c4e3963913a9 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:32.220245 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-57a1132f-3980-4cf7-99e9-c4e3963913a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:32.353284 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1132f-3980-4cf7-99e9-c4e3963913a9 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:32.398549 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:32.436325 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14bce7-cd14-4c40-9594-ca861271a5fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:32.436890 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14bce7-cd14-4c40-9594-ca861271a5fc service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:32.437168 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14bce7-cd14-4c40-9594-ca861271a5fc service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:32.437472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14bce7-cd14-4c40-9594-ca861271a5fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:32.439091 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-ed14bce7-cd14-4c40-9594-ca861271a5fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:32.550737 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed14bce7-cd14-4c40-9594-ca861271a5fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:32.552203 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed14bce7-cd14-4c40-9594-ca861271a5fc service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:32.570584 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 724/1449] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:43:34.688105 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688c137-860f-423b-a719-701a357ffe89 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:34.688777 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688c137-860f-423b-a719-701a357ffe89 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:34.688777 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688c137-860f-423b-a719-701a357ffe89 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:34.690113 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:34.697129 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2443f-a2c8-4717-8b8c-992e8ec0f34d None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:34.697801 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2443f-a2c8-4717-8b8c-992e8ec0f34d None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:34.697801 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2443f-a2c8-4717-8b8c-992e8ec0f34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:34.771586 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-82f2443f-a2c8-4717-8b8c-992e8ec0f34d None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:34.772824 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-82f2443f-a2c8-4717-8b8c-992e8ec0f34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:34.806189 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:34.895511 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:35.183109 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688c137-860f-423b-a719-701a357ffe89 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:35.185724 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-7688c137-860f-423b-a719-701a357ffe89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:35.298916 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688c137-860f-423b-a719-701a357ffe89 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:35.318903 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:35.388912 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63cc67e-9878-4453-ac29-2c94d623b11a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:35.389586 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cc67e-9878-4453-ac29-2c94d623b11a service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:35.389940 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cc67e-9878-4453-ac29-2c94d623b11a service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:35.390208 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63cc67e-9878-4453-ac29-2c94d623b11a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:35.391717 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-c63cc67e-9878-4453-ac29-2c94d623b11a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:35.509245 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63cc67e-9878-4453-ac29-2c94d623b11a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:35.510732 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63cc67e-9878-4453-ac29-2c94d623b11a service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:35.532325 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 727/1452] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:43:37.527609 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a21bcb-f2d2-42f6-b05e-3c082d6b4970 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:37.528337 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a21bcb-f2d2-42f6-b05e-3c082d6b4970 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:37.528337 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a21bcb-f2d2-42f6-b05e-3c082d6b4970 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:37.530428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:43:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:37.536181 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a0917-5a38-4cdf-b407-b1fa749bfc10 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:37.536636 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a0917-5a38-4cdf-b407-b1fa749bfc10 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:37.536755 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a0917-5a38-4cdf-b407-b1fa749bfc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:37.611855 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:37.615188 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-954a0917-5a38-4cdf-b407-b1fa749bfc10 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:37.617157 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-954a0917-5a38-4cdf-b407-b1fa749bfc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:37.721456 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:43:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:38.003365 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a21bcb-f2d2-42f6-b05e-3c082d6b4970 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:38.005916 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-f8a21bcb-f2d2-42f6-b05e-3c082d6b4970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:38.139002 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a21bcb-f2d2-42f6-b05e-3c082d6b4970 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:38.193857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:38.222112 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a6d80-e057-4fa6-baef-d6986c421206 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:38.222737 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a6d80-e057-4fa6-baef-d6986c421206 service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:38.222984 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a6d80-e057-4fa6-baef-d6986c421206 service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:38.223254 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a6d80-e057-4fa6-baef-d6986c421206 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:38.224907 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-3b1a6d80-e057-4fa6-baef-d6986c421206 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:38.339594 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a6d80-e057-4fa6-baef-d6986c421206 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:38.340979 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a6d80-e057-4fa6-baef-d6986c421206 service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:38.359279 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 727/1455] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:43:40.288508 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1cd68-2402-4bf9-9614-372c1e78b272 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:40.289071 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1cd68-2402-4bf9-9614-372c1e78b272 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:40.289071 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1cd68-2402-4bf9-9614-372c1e78b272 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:40.290474 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:40.297145 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d5c2f-a355-46ee-903a-a1f6b811e34a None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:40.297945 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d5c2f-a355-46ee-903a-a1f6b811e34a None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:40.298136 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d5c2f-a355-46ee-903a-a1f6b811e34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:40.369949 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-b01d5c2f-a355-46ee-903a-a1f6b811e34a None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:40.371221 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-b01d5c2f-a355-46ee-903a-a1f6b811e34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:40.401908 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:40.473003 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:43:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:40.751678 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1cd68-2402-4bf9-9614-372c1e78b272 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:40.754192 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-7fb1cd68-2402-4bf9-9614-372c1e78b272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:40.878203 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1cd68-2402-4bf9-9614-372c1e78b272 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:40.906965 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:40.954197 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a580fda-cf16-4957-98b5-ddf26aaba29d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:40.954803 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a580fda-cf16-4957-98b5-ddf26aaba29d service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:40.955081 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a580fda-cf16-4957-98b5-ddf26aaba29d service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:40.955350 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a580fda-cf16-4957-98b5-ddf26aaba29d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:40.956950 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-5a580fda-cf16-4957-98b5-ddf26aaba29d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:41.069400 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a580fda-cf16-4957-98b5-ddf26aaba29d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:41.070818 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a580fda-cf16-4957-98b5-ddf26aaba29d service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:41.092320 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 730/1458] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:43:43.048665 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de305198-9435-4b40-901e-6a1ddfdc4823 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:43.049632 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de305198-9435-4b40-901e-6a1ddfdc4823 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:43.049632 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de305198-9435-4b40-901e-6a1ddfdc4823 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:43.051792 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:43:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:43.057694 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad96079-d0f7-4192-9a04-fadcf072d1b8 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:43.058123 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad96079-d0f7-4192-9a04-fadcf072d1b8 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:43.058263 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad96079-d0f7-4192-9a04-fadcf072d1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:43.127501 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-4ad96079-d0f7-4192-9a04-fadcf072d1b8 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:43.128753 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-4ad96079-d0f7-4192-9a04-fadcf072d1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:43.137952 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:43.231141 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:43:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:43.514045 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de305198-9435-4b40-901e-6a1ddfdc4823 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:43.515600 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-de305198-9435-4b40-901e-6a1ddfdc4823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:43.633770 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de305198-9435-4b40-901e-6a1ddfdc4823 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:43.692379 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:43.712526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571ef3b-930e-48fa-9d4b-44724cd85c76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:43.713141 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571ef3b-930e-48fa-9d4b-44724cd85c76 service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:43.713446 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571ef3b-930e-48fa-9d4b-44724cd85c76 service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:43.713719 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571ef3b-930e-48fa-9d4b-44724cd85c76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:43.715338 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-a571ef3b-930e-48fa-9d4b-44724cd85c76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:43.835913 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571ef3b-930e-48fa-9d4b-44724cd85c76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:43.837373 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a571ef3b-930e-48fa-9d4b-44724cd85c76 service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:43.856678 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 730/1461] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:43:45.973043 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae20ed-f817-440c-bcf6-c738fd333ba8 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:45.973690 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae20ed-f817-440c-bcf6-c738fd333ba8 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:45.973690 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae20ed-f817-440c-bcf6-c738fd333ba8 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:45.974977 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:45.981864 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f81a4-157c-46fa-a655-237a349dc411 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:45.982345 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f81a4-157c-46fa-a655-237a349dc411 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:45.982452 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f81a4-157c-46fa-a655-237a349dc411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:46.053086 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-2b1f81a4-157c-46fa-a655-237a349dc411 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:46.054346 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-2b1f81a4-157c-46fa-a655-237a349dc411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:46.094615 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:46.160702 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:43:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:46.445140 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae20ed-f817-440c-bcf6-c738fd333ba8 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:46.446845 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-d5ae20ed-f817-440c-bcf6-c738fd333ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:46.554791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae20ed-f817-440c-bcf6-c738fd333ba8 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:46.601946 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:46.639462 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32ec0a-f2d2-4d9f-bb62-a73218e7c157 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:46.640062 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32ec0a-f2d2-4d9f-bb62-a73218e7c157 service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:46.640329 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32ec0a-f2d2-4d9f-bb62-a73218e7c157 service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:46.640596 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32ec0a-f2d2-4d9f-bb62-a73218e7c157 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:46.642195 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-4f32ec0a-f2d2-4d9f-bb62-a73218e7c157 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:46.762154 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32ec0a-f2d2-4d9f-bb62-a73218e7c157 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:46.763609 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32ec0a-f2d2-4d9f-bb62-a73218e7c157 service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:46.782666 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 733/1464] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:43:48.769923 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860cd55-0624-459c-a78e-4e21b4736814 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:48.770585 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860cd55-0624-459c-a78e-4e21b4736814 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:48.770585 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860cd55-0624-459c-a78e-4e21b4736814 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:48.771933 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:48.779507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a170e-0e1a-4a27-9036-70d095aa575e None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:48.779968 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a170e-0e1a-4a27-9036-70d095aa575e None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:48.780069 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a170e-0e1a-4a27-9036-70d095aa575e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:48.854751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-749a170e-0e1a-4a27-9036-70d095aa575e None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:48.855975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-749a170e-0e1a-4a27-9036-70d095aa575e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:48.880074 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:48.978144 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:49.260618 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9860cd55-0624-459c-a78e-4e21b4736814 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:49.263398 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-9860cd55-0624-459c-a78e-4e21b4736814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:49.377415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9860cd55-0624-459c-a78e-4e21b4736814 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:49.445112 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:49.452699 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8050998-8a92-4070-a7cb-c05f24b02b5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:49.453313 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8050998-8a92-4070-a7cb-c05f24b02b5c service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:49.453615 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8050998-8a92-4070-a7cb-c05f24b02b5c service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:49.453882 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8050998-8a92-4070-a7cb-c05f24b02b5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:49.455489 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-c8050998-8a92-4070-a7cb-c05f24b02b5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:49.568182 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8050998-8a92-4070-a7cb-c05f24b02b5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:49.569683 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8050998-8a92-4070-a7cb-c05f24b02b5c service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:49.590355 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 733/1467] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:43:51.520545 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868422c5-4c0c-428d-b0b3-6edd2885f00a None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:51.521423 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868422c5-4c0c-428d-b0b3-6edd2885f00a None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:51.521423 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868422c5-4c0c-428d-b0b3-6edd2885f00a None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:51.523410 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:43:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:51.530004 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71189d-769b-4e10-90ed-d2b0d0979188 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:51.530437 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71189d-769b-4e10-90ed-d2b0d0979188 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:51.530556 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71189d-769b-4e10-90ed-d2b0d0979188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:51.607584 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-4d71189d-769b-4e10-90ed-d2b0d0979188 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:51.608871 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-4d71189d-769b-4e10-90ed-d2b0d0979188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:51.659409 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:51.711469 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:43:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:43:51.996409 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868422c5-4c0c-428d-b0b3-6edd2885f00a None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:51.998010 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-868422c5-4c0c-428d-b0b3-6edd2885f00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:52.113024 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868422c5-4c0c-428d-b0b3-6edd2885f00a None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:52.163662 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:52.192114 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42be2d-3a92-46c7-8a8c-7293a2624f6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:52.192664 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42be2d-3a92-46c7-8a8c-7293a2624f6b service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:52.192919 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42be2d-3a92-46c7-8a8c-7293a2624f6b service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:52.193185 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42be2d-3a92-46c7-8a8c-7293a2624f6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:52.194867 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-bb42be2d-3a92-46c7-8a8c-7293a2624f6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:52.306236 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42be2d-3a92-46c7-8a8c-7293a2624f6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:52.307706 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42be2d-3a92-46c7-8a8c-7293a2624f6b service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:52.326999 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 736/1470] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:43:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:44:01.709548 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=22 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:02.325080 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=66 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:11.653047 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa79600-ec99-42ff-aacc-d4c2b9d548d9 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:11.653646 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa79600-ec99-42ff-aacc-d4c2b9d548d9 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:11.653646 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa79600-ec99-42ff-aacc-d4c2b9d548d9 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:11.655022 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 735/1471] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:44:11.661517 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad4cec-ede3-40d7-94d3-9ecc5e671a9e None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:11.662277 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad4cec-ede3-40d7-94d3-9ecc5e671a9e None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:11.662431 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ad4cec-ede3-40d7-94d3-9ecc5e671a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:11.737783 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-e3ad4cec-ede3-40d7-94d3-9ecc5e671a9e None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:44:11.738990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-e3ad4cec-ede3-40d7-94d3-9ecc5e671a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:11.846965 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 737/1472] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:44:12.144029 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133c095-6d85-4237-8180-616523698fbb None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:12.144312 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133c095-6d85-4237-8180-616523698fbb None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:12.144585 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133c095-6d85-4237-8180-616523698fbb None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:12.146012 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 736/1473] 10.222.0.49 () {54 vars in 967 bytes} [Wed Aug 24 04:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:44:12.151611 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b20d0b-0b01-4dcb-a9a8-9f84ef42f848 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:12.151929 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b20d0b-0b01-4dcb-a9a8-9f84ef42f848 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:12.152210 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b20d0b-0b01-4dcb-a9a8-9f84ef42f848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:12.233265 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-c1b20d0b-0b01-4dcb-a9a8-9f84ef42f848 None None] MFA Rules not processed for user `2be44ea93247420d994e24912a9ac32e`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:44:12.234535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-c1b20d0b-0b01-4dcb-a9a8-9f84ef42f848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:12.257310 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:12.315526 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 738/1474] 10.222.0.49 () {58 vars in 1064 bytes} [Wed Aug 24 04:44:12 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:44:12.323424 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133c095-6d85-4237-8180-616523698fbb None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:12.324987 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-c133c095-6d85-4237-8180-616523698fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:12.431352 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133c095-6d85-4237-8180-616523698fbb None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:12.510743 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b8c7b-495a-42fe-a67c-e7a221b093d8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be44ea93247420d994e24912a9ac32e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:12.511345 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b8c7b-495a-42fe-a67c-e7a221b093d8 service glance] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:12.511620 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b8c7b-495a-42fe-a67c-e7a221b093d8 service glance] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:12.511892 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b8c7b-495a-42fe-a67c-e7a221b093d8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:12.513554 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-179b8c7b-495a-42fe-a67c-e7a221b093d8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:12.569695 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:12.628987 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179b8c7b-495a-42fe-a67c-e7a221b093d8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:12.630529 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179b8c7b-495a-42fe-a67c-e7a221b093d8 service glance] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:12.650167 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 737/1475] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:44:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:44:14.612992 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad21cd3-c181-47a7-b72b-64915a14d765 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:14.613647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad21cd3-c181-47a7-b72b-64915a14d765 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:14.613647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad21cd3-c181-47a7-b72b-64915a14d765 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:14.614960 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 739/1476] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:44:14.621726 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e86f9-9ed6-4e8c-b3f6-2ae0c7793246 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:14.622396 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e86f9-9ed6-4e8c-b3f6-2ae0c7793246 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:14.622535 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e86f9-9ed6-4e8c-b3f6-2ae0c7793246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:14.707902 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-ed1e86f9-9ed6-4e8c-b3f6-2ae0c7793246 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:44:14.709269 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-ed1e86f9-9ed6-4e8c-b3f6-2ae0c7793246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:14.816497 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 738/1477] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:44:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:44:15.105895 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad21cd3-c181-47a7-b72b-64915a14d765 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:15.107433 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-3ad21cd3-c181-47a7-b72b-64915a14d765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:15.266969 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad21cd3-c181-47a7-b72b-64915a14d765 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:15.325416 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:15.372531 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1eb1e4-f841-4ffd-b21f-c0ce60da4951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:15.373099 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1eb1e4-f841-4ffd-b21f-c0ce60da4951 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:15.373380 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1eb1e4-f841-4ffd-b21f-c0ce60da4951 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:15.373655 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1eb1e4-f841-4ffd-b21f-c0ce60da4951 admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:15.374308 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1eb1e4-f841-4ffd-b21f-c0ce60da4951 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:15.376103 dv-cinder-854265-1-smb devstack@keystone.service[93148]: WARNING py.warnings [None req-9a1eb1e4-f841-4ffd-b21f-c0ce60da4951 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:44:15.376103 dv-cinder-854265-1-smb devstack@keystone.service[93148]: warnings.warn(msg) Aug 24 04:44:15.376103 dv-cinder-854265-1-smb devstack@keystone.service[93148]: Aug 24 04:44:15.377274 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1eb1e4-f841-4ffd-b21f-c0ce60da4951 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:15.397985 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 740/1478] 10.222.0.49 () {56 vars in 1108 bytes} [Wed Aug 24 04:44:15 2022] GET /identity/v3/projects => generated 2553 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:44:17.309928 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd47a95-dec9-4572-ad89-393a3e7306e9 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:17.310576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd47a95-dec9-4572-ad89-393a3e7306e9 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:17.310576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd47a95-dec9-4572-ad89-393a3e7306e9 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:17.311917 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 739/1479] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:44:17.318610 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe1237-713c-4578-a14c-24ed1ed9e462 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:17.319100 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe1237-713c-4578-a14c-24ed1ed9e462 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:17.319205 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe1237-713c-4578-a14c-24ed1ed9e462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:17.388472 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-86fe1237-713c-4578-a14c-24ed1ed9e462 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:44:17.389750 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-86fe1237-713c-4578-a14c-24ed1ed9e462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:17.500492 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 741/1480] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:44:17.798148 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd47a95-dec9-4572-ad89-393a3e7306e9 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:17.800685 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-abd47a95-dec9-4572-ad89-393a3e7306e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:17.811735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:17.959482 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd47a95-dec9-4572-ad89-393a3e7306e9 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:18.048252 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:18.087005 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7bf87-555a-4810-8361-e46fd836eb42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:18.087615 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7bf87-555a-4810-8361-e46fd836eb42 service nova] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:18.087885 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7bf87-555a-4810-8361-e46fd836eb42 service nova] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:18.088154 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7bf87-555a-4810-8361-e46fd836eb42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:18.089819 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-07d7bf87-555a-4810-8361-e46fd836eb42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:18.200737 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d7bf87-555a-4810-8361-e46fd836eb42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:18.202404 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d7bf87-555a-4810-8361-e46fd836eb42 service nova] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:18.223420 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 740/1481] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:44:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:44:20.299774 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ce6af-02cc-4da2-9c40-7d928685a2da None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:20.300557 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ce6af-02cc-4da2-9c40-7d928685a2da None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:20.300557 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27ce6af-02cc-4da2-9c40-7d928685a2da None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:20.302798 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 742/1482] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:44:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:44:20.308380 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff6b60-9175-4fa3-81c3-9b909190e763 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:20.308844 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff6b60-9175-4fa3-81c3-9b909190e763 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:20.308941 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff6b60-9175-4fa3-81c3-9b909190e763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:20.375602 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-a8ff6b60-9175-4fa3-81c3-9b909190e763 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:44:20.376849 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-a8ff6b60-9175-4fa3-81c3-9b909190e763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:20.424134 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:20.481374 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 741/1483] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:44:20.765537 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ce6af-02cc-4da2-9c40-7d928685a2da None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:20.767849 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-d27ce6af-02cc-4da2-9c40-7d928685a2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:20.793582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:20.888804 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27ce6af-02cc-4da2-9c40-7d928685a2da None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:20.971065 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a73b6-4cd2-4c8e-9401-3004e79782f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:20.971966 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a73b6-4cd2-4c8e-9401-3004e79782f0 service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:20.972249 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a73b6-4cd2-4c8e-9401-3004e79782f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:20.972785 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a73b6-4cd2-4c8e-9401-3004e79782f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:20.975059 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-c73a73b6-4cd2-4c8e-9401-3004e79782f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:21.056466 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:21.095195 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a73b6-4cd2-4c8e-9401-3004e79782f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:21.096676 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a73b6-4cd2-4c8e-9401-3004e79782f0 service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:21.115757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 743/1484] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:44:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:44:23.089643 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0c3c3-1a41-4e73-a1af-ad22311bc805 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:23.090248 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0c3c3-1a41-4e73-a1af-ad22311bc805 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:23.090248 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a0c3c3-1a41-4e73-a1af-ad22311bc805 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:23.091569 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 742/1485] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:44:23.097118 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc605f5-7d33-403a-8bc0-968f84f1f39e None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:23.097619 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc605f5-7d33-403a-8bc0-968f84f1f39e None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:23.097718 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc605f5-7d33-403a-8bc0-968f84f1f39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:23.179482 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-edc605f5-7d33-403a-8bc0-968f84f1f39e None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:44:23.180730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-edc605f5-7d33-403a-8bc0-968f84f1f39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:23.284644 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 744/1486] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:44:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:44:23.571756 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0c3c3-1a41-4e73-a1af-ad22311bc805 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:23.573439 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-31a0c3c3-1a41-4e73-a1af-ad22311bc805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:23.693070 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a0c3c3-1a41-4e73-a1af-ad22311bc805 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:23.778314 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:23.780498 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2683cd-0322-47ca-88e9-0698e2ad0708 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:23.781304 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2683cd-0322-47ca-88e9-0698e2ad0708 service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:23.781898 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2683cd-0322-47ca-88e9-0698e2ad0708 service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:23.782191 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2683cd-0322-47ca-88e9-0698e2ad0708 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:23.785145 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-9f2683cd-0322-47ca-88e9-0698e2ad0708 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:23.910865 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2683cd-0322-47ca-88e9-0698e2ad0708 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:23.912384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2683cd-0322-47ca-88e9-0698e2ad0708 service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:23.931230 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 743/1487] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:44:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:44:25.972543 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a422ccc-d20a-4189-b9be-325e2d09aaaa None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:25.973161 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a422ccc-d20a-4189-b9be-325e2d09aaaa None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:25.973161 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a422ccc-d20a-4189-b9be-325e2d09aaaa None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:25.974588 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 745/1488] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:44:25.981541 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9dca3-f426-4072-8073-74975397716b None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:25.982229 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9dca3-f426-4072-8073-74975397716b None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:25.982458 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9dca3-f426-4072-8073-74975397716b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:26.059287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-a6a9dca3-f426-4072-8073-74975397716b None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:44:26.060515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-a6a9dca3-f426-4072-8073-74975397716b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:26.115836 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:26.162624 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 744/1489] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:44:26.452697 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a422ccc-d20a-4189-b9be-325e2d09aaaa None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:26.455189 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-8a422ccc-d20a-4189-b9be-325e2d09aaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:26.506165 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:26.587442 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a422ccc-d20a-4189-b9be-325e2d09aaaa None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:26.667469 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc4d71a-639d-4d56-a39b-3869913cc95e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:26.668086 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4d71a-639d-4d56-a39b-3869913cc95e service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:26.668357 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4d71a-639d-4d56-a39b-3869913cc95e service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:26.668621 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc4d71a-639d-4d56-a39b-3869913cc95e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:26.670269 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-2bc4d71a-639d-4d56-a39b-3869913cc95e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:26.753120 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:26.788671 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4d71a-639d-4d56-a39b-3869913cc95e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:26.790078 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc4d71a-639d-4d56-a39b-3869913cc95e service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:26.808791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 746/1490] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:44:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:44:28.919323 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832381e-4560-45b4-be94-5937fb3007f6 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:28.919888 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832381e-4560-45b4-be94-5937fb3007f6 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:28.920009 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832381e-4560-45b4-be94-5937fb3007f6 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:28.922232 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 745/1491] 10.222.0.49 () {54 vars in 927 bytes} [Wed Aug 24 04:44:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:44:28.930042 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f09c04-42c1-443e-a05f-7f93ab2c7745 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:28.930521 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f09c04-42c1-443e-a05f-7f93ab2c7745 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:28.930626 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f09c04-42c1-443e-a05f-7f93ab2c7745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:29.000595 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-04f09c04-42c1-443e-a05f-7f93ab2c7745 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:44:29.001867 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-04f09c04-42c1-443e-a05f-7f93ab2c7745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:29.102854 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 747/1492] 10.222.0.49 () {58 vars in 1024 bytes} [Wed Aug 24 04:44:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:44:29.393742 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832381e-4560-45b4-be94-5937fb3007f6 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:29.395329 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-0832381e-4560-45b4-be94-5937fb3007f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:29.508596 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832381e-4560-45b4-be94-5937fb3007f6 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:29.588411 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2b252-8560-4ae1-a4cc-00ae65e79a17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:29.589025 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2b252-8560-4ae1-a4cc-00ae65e79a17 service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:29.589301 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2b252-8560-4ae1-a4cc-00ae65e79a17 service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:29.589681 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2b252-8560-4ae1-a4cc-00ae65e79a17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:29.591319 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-79a2b252-8560-4ae1-a4cc-00ae65e79a17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:29.600976 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:29.710813 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2b252-8560-4ae1-a4cc-00ae65e79a17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:29.712214 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2b252-8560-4ae1-a4cc-00ae65e79a17 service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:29.732330 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 746/1493] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:44:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:44:39.100420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=82 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:39.729453 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=50 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:40.995543 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102dc98-ada9-4e39-a7d4-7679ed08ada7 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:40.996470 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102dc98-ada9-4e39-a7d4-7679ed08ada7 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:40.996470 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102dc98-ada9-4e39-a7d4-7679ed08ada7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:41.079891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-e102dc98-ada9-4e39-a7d4-7679ed08ada7 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:45:41.081463 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-e102dc98-ada9-4e39-a7d4-7679ed08ada7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:41.185321 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 748/1494] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:45:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:45:41.193963 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ce582-ffda-45d1-86d9-9c4f0ed548f3 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:41.194527 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ce582-ffda-45d1-86d9-9c4f0ed548f3 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:41.194527 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ce582-ffda-45d1-86d9-9c4f0ed548f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:41.275191 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-391ce582-ffda-45d1-86d9-9c4f0ed548f3 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:45:41.276313 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-391ce582-ffda-45d1-86d9-9c4f0ed548f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:41.400081 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 747/1495] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:45:41.405936 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102dc98-ada9-4e39-a7d4-7679ed08ada7 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:45:41.407847 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-e102dc98-ada9-4e39-a7d4-7679ed08ada7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:41.426084 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102dc98-ada9-4e39-a7d4-7679ed08ada7 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:45:41.493070 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:41.527848 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f90a6-e7df-439e-b3e3-2b21f4178cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:45:41.528401 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f90a6-e7df-439e-b3e3-2b21f4178cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:41.528673 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f90a6-e7df-439e-b3e3-2b21f4178cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:41.528942 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f90a6-e7df-439e-b3e3-2b21f4178cf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:41.529620 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2f90a6-e7df-439e-b3e3-2b21f4178cf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:45:41.529917 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2f90a6-e7df-439e-b3e3-2b21f4178cf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:45:41.530944 dv-cinder-854265-1-smb devstack@keystone.service[93148]: WARNING py.warnings [None req-de2f90a6-e7df-439e-b3e3-2b21f4178cf1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:45:41.530944 dv-cinder-854265-1-smb devstack@keystone.service[93148]: warnings.warn(msg) Aug 24 04:45:41.530944 dv-cinder-854265-1-smb devstack@keystone.service[93148]: Aug 24 04:45:41.531854 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2f90a6-e7df-439e-b3e3-2b21f4178cf1 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:45:41.543738 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 749/1496] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:45:41.552348 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ce582-ffda-45d1-86d9-9c4f0ed548f3 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:45:41.562769 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ce582-ffda-45d1-86d9-9c4f0ed548f3 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:45:41.637974 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:41.674078 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb94cc7-0b1a-4087-b659-582ea3058d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:45:41.674712 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb94cc7-0b1a-4087-b659-582ea3058d42 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:41.674984 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb94cc7-0b1a-4087-b659-582ea3058d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:41.675257 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb94cc7-0b1a-4087-b659-582ea3058d42 admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:41.675881 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb94cc7-0b1a-4087-b659-582ea3058d42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:45:41.677762 dv-cinder-854265-1-smb devstack@keystone.service[93147]: WARNING py.warnings [None req-ccb94cc7-0b1a-4087-b659-582ea3058d42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:45:41.677762 dv-cinder-854265-1-smb devstack@keystone.service[93147]: warnings.warn(msg) Aug 24 04:45:41.677762 dv-cinder-854265-1-smb devstack@keystone.service[93147]: Aug 24 04:45:41.678973 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb94cc7-0b1a-4087-b659-582ea3058d42 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:45:41.739717 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 748/1497] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:45:41 2022] POST /identity/v3/projects => generated 377 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:45:41.744124 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f90a6-e7df-439e-b3e3-2b21f4178cf1 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:45:41.745803 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-de2f90a6-e7df-439e-b3e3-2b21f4178cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:41.781165 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f90a6-e7df-439e-b3e3-2b21f4178cf1 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:45:41.881231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd34fc-6093-456d-950a-5e7ccc630cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:45:41.881873 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd34fc-6093-456d-950a-5e7ccc630cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:41.882145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd34fc-6093-456d-950a-5e7ccc630cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:41.882412 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd34fc-6093-456d-950a-5e7ccc630cb4 admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:41.883032 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd34fc-6093-456d-950a-5e7ccc630cb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:45:41.884053 dv-cinder-854265-1-smb devstack@keystone.service[93148]: WARNING py.warnings [None req-cffd34fc-6093-456d-950a-5e7ccc630cb4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:45:41.884053 dv-cinder-854265-1-smb devstack@keystone.service[93148]: warnings.warn(msg) Aug 24 04:45:41.884053 dv-cinder-854265-1-smb devstack@keystone.service[93148]: Aug 24 04:45:41.885273 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd34fc-6093-456d-950a-5e7ccc630cb4 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:45:41.932140 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 750/1498] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:45:41 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:45:41.937116 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb94cc7-0b1a-4087-b659-582ea3058d42 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:45:41.939665 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-ccb94cc7-0b1a-4087-b659-582ea3058d42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:42.010598 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb94cc7-0b1a-4087-b659-582ea3058d42 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:45:42.097569 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:42.115309 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfdef4-1161-4e24-add7-46cd3e1888d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:45:42.115923 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfdef4-1161-4e24-add7-46cd3e1888d1 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:42.116224 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfdef4-1161-4e24-add7-46cd3e1888d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:42.116490 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfdef4-1161-4e24-add7-46cd3e1888d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:42.117140 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dfdef4-1161-4e24-add7-46cd3e1888d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:45:42.118258 dv-cinder-854265-1-smb devstack@keystone.service[93147]: WARNING py.warnings [None req-81dfdef4-1161-4e24-add7-46cd3e1888d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:45:42.118258 dv-cinder-854265-1-smb devstack@keystone.service[93147]: warnings.warn(msg) Aug 24 04:45:42.118258 dv-cinder-854265-1-smb devstack@keystone.service[93147]: Aug 24 04:45:42.119159 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dfdef4-1161-4e24-add7-46cd3e1888d1 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:45:42.132218 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 749/1499] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:45:42.136461 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd34fc-6093-456d-950a-5e7ccc630cb4 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:45:42.138087 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-cffd34fc-6093-456d-950a-5e7ccc630cb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:42.150063 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd34fc-6093-456d-950a-5e7ccc630cb4 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:45:42.177621 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:42.252526 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb88117-0f60-45c7-ae72-6776e4aaebea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:45:42.253126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb88117-0f60-45c7-ae72-6776e4aaebea admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:42.253435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb88117-0f60-45c7-ae72-6776e4aaebea admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:42.253710 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb88117-0f60-45c7-ae72-6776e4aaebea admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:42.254351 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb88117-0f60-45c7-ae72-6776e4aaebea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:45:42.255364 dv-cinder-854265-1-smb devstack@keystone.service[93148]: WARNING py.warnings [None req-1fb88117-0f60-45c7-ae72-6776e4aaebea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:45:42.255364 dv-cinder-854265-1-smb devstack@keystone.service[93148]: warnings.warn(msg) Aug 24 04:45:42.255364 dv-cinder-854265-1-smb devstack@keystone.service[93148]: Aug 24 04:45:42.256263 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb88117-0f60-45c7-ae72-6776e4aaebea admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:45:42.269378 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 751/1500] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:45:42.273904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfdef4-1161-4e24-add7-46cd3e1888d1 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:45:42.275429 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-81dfdef4-1161-4e24-add7-46cd3e1888d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:42.310474 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfdef4-1161-4e24-add7-46cd3e1888d1 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:45:42.542815 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb74449-5515-40ad-9e45-3feddb213256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:45:42.543377 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb74449-5515-40ad-9e45-3feddb213256 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:42.543645 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb74449-5515-40ad-9e45-3feddb213256 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:42.543908 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb74449-5515-40ad-9e45-3feddb213256 admin admin] PATH_INFO: `/v3/projects/91a413c80d5f4fca9a283e9780f85112/users/afec9946d9c24c2a8ac1273d6823c2c8/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:42.567375 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb74449-5515-40ad-9e45-3feddb213256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91a413c80d5f4fca9a283e9780f85112, user_id=afec9946d9c24c2a8ac1273d6823c2c8, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:45:42.568413 dv-cinder-854265-1-smb devstack@keystone.service[93147]: WARNING py.warnings [None req-ceb74449-5515-40ad-9e45-3feddb213256 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:45:42.568413 dv-cinder-854265-1-smb devstack@keystone.service[93147]: warnings.warn(msg) Aug 24 04:45:42.568413 dv-cinder-854265-1-smb devstack@keystone.service[93147]: Aug 24 04:45:42.570406 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb74449-5515-40ad-9e45-3feddb213256 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:45:42.599037 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 750/1501] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:45:42 2022] PUT /identity/v3/projects/91a413c80d5f4fca9a283e9780f85112/users/afec9946d9c24c2a8ac1273d6823c2c8/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:45:42.611618 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0d271-0dd2-4f65-839f-07a4c399b278 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:42.611905 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0d271-0dd2-4f65-839f-07a4c399b278 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:42.612212 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0d271-0dd2-4f65-839f-07a4c399b278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:42.676316 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-04b0d271-0dd2-4f65-839f-07a4c399b278 None None] MFA Rules not processed for user `afec9946d9c24c2a8ac1273d6823c2c8`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:45:42.677602 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-04b0d271-0dd2-4f65-839f-07a4c399b278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:42.764675 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 752/1502] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:45:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:45:42.779832 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0c2f1-760b-406a-8e38-d18395c987f3 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:42.780329 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0c2f1-760b-406a-8e38-d18395c987f3 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:42.780690 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0c2f1-760b-406a-8e38-d18395c987f3 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:42.783111 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 751/1503] 10.222.0.49 () {54 vars in 964 bytes} [Wed Aug 24 04:45:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:45:42.788382 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d96fc8-7031-42ef-af35-703a920cf82e None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:42.788667 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d96fc8-7031-42ef-af35-703a920cf82e None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:42.788952 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d96fc8-7031-42ef-af35-703a920cf82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:42.821950 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:42.882054 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-a1d96fc8-7031-42ef-af35-703a920cf82e None None] MFA Rules not processed for user `2a957fc61ff14c35aac0b577c3c1baf5`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:45:42.883897 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-a1d96fc8-7031-42ef-af35-703a920cf82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:42.970380 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 753/1504] 10.222.0.49 () {58 vars in 1061 bytes} [Wed Aug 24 04:45:42 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:45:42.982882 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0c2f1-760b-406a-8e38-d18395c987f3 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:45:42.985230 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-a9a0c2f1-760b-406a-8e38-d18395c987f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:43.040690 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:43.100673 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0c2f1-760b-406a-8e38-d18395c987f3 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:45:43.185193 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41acb0a4-176d-4d6e-959b-a402c80cc4a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:45:43.185887 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acb0a4-176d-4d6e-959b-a402c80cc4a1 service cinder] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:43.186158 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acb0a4-176d-4d6e-959b-a402c80cc4a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:43.186420 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41acb0a4-176d-4d6e-959b-a402c80cc4a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:43.188103 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-41acb0a4-176d-4d6e-959b-a402c80cc4a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:43.298053 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41acb0a4-176d-4d6e-959b-a402c80cc4a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:45:43.299507 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41acb0a4-176d-4d6e-959b-a402c80cc4a1 service cinder] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:45:43.303301 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:43.318764 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 752/1505] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:45:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:45:43.364407 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cc89c-c756-4fc2-b172-e72234e386ad None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:43.364855 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cc89c-c756-4fc2-b172-e72234e386ad None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:43.364952 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cc89c-c756-4fc2-b172-e72234e386ad None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:43.366256 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 754/1506] 10.222.0.49 () {52 vars in 830 bytes} [Wed Aug 24 04:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:45:43.370215 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41acb0a4-176d-4d6e-959b-a402c80cc4a1 service cinder] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:45:43.371482 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-41acb0a4-176d-4d6e-959b-a402c80cc4a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:43.481864 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41acb0a4-176d-4d6e-959b-a402c80cc4a1 service cinder] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:45:43.579780 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec663735-18e0-4c4b-a05c-4e47488eaaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:45:43.580404 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec663735-18e0-4c4b-a05c-4e47488eaaca admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:43.580675 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec663735-18e0-4c4b-a05c-4e47488eaaca admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:43.580936 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec663735-18e0-4c4b-a05c-4e47488eaaca admin admin] PATH_INFO: `/v3/users/afec9946d9c24c2a8ac1273d6823c2c8` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:43.593732 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec663735-18e0-4c4b-a05c-4e47488eaaca admin admin] RBAC: Authorizing `identity:delete_user(user_id=afec9946d9c24c2a8ac1273d6823c2c8)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:45:43.594766 dv-cinder-854265-1-smb devstack@keystone.service[93147]: WARNING py.warnings [None req-ec663735-18e0-4c4b-a05c-4e47488eaaca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:45:43.594766 dv-cinder-854265-1-smb devstack@keystone.service[93147]: warnings.warn(msg) Aug 24 04:45:43.594766 dv-cinder-854265-1-smb devstack@keystone.service[93147]: Aug 24 04:45:43.595977 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec663735-18e0-4c4b-a05c-4e47488eaaca admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:45:43.606343 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:43.664919 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-ec663735-18e0-4c4b-a05c-4e47488eaaca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afec9946d9c24c2a8ac1273d6823c2c8'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:45:43.665381 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-ec663735-18e0-4c4b-a05c-4e47488eaaca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afec9946d9c24c2a8ac1273d6823c2c8'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:45:43.665914 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-ec663735-18e0-4c4b-a05c-4e47488eaaca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afec9946d9c24c2a8ac1273d6823c2c8'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:45:43.690710 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-ec663735-18e0-4c4b-a05c-4e47488eaaca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afec9946d9c24c2a8ac1273d6823c2c8'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:45:43.702003 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-ec663735-18e0-4c4b-a05c-4e47488eaaca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afec9946d9c24c2a8ac1273d6823c2c8'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:45:43.721155 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 753/1507] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:45:43 2022] DELETE /identity/v3/users/afec9946d9c24c2a8ac1273d6823c2c8 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:45:43.725631 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f26c1-7208-46ab-a137-6811872a8a9a None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:43.725938 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f26c1-7208-46ab-a137-6811872a8a9a None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:43.726206 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f26c1-7208-46ab-a137-6811872a8a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:43.782385 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-459f26c1-7208-46ab-a137-6811872a8a9a None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:45:43.783573 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-459f26c1-7208-46ab-a137-6811872a8a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:43.866064 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:43.886042 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 755/1508] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:45:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:45:43.896786 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec663735-18e0-4c4b-a05c-4e47488eaaca admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:45:43.898059 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-ec663735-18e0-4c4b-a05c-4e47488eaaca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:44.009576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec663735-18e0-4c4b-a05c-4e47488eaaca admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:45:44.076030 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:44.098036 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f70bdc-f2e7-42b9-bb05-9cd509799b83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:45:44.098653 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f70bdc-f2e7-42b9-bb05-9cd509799b83 service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:44.098935 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f70bdc-f2e7-42b9-bb05-9cd509799b83 service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:44.099204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f70bdc-f2e7-42b9-bb05-9cd509799b83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:44.100910 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-f9f70bdc-f2e7-42b9-bb05-9cd509799b83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:44.217077 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f70bdc-f2e7-42b9-bb05-9cd509799b83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:45:44.218578 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f70bdc-f2e7-42b9-bb05-9cd509799b83 service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:45:44.237803 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 754/1509] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:45:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:45:44.582922 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f26c1-7208-46ab-a137-6811872a8a9a None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:45:44.584270 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-459f26c1-7208-46ab-a137-6811872a8a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:44.599915 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f26c1-7208-46ab-a137-6811872a8a9a None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:45:44.700112 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b76eb4-b49b-4e6d-b6fa-96bfaa91c796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:45:44.700664 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b76eb4-b49b-4e6d-b6fa-96bfaa91c796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:44.700935 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b76eb4-b49b-4e6d-b6fa-96bfaa91c796 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:44.701198 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b76eb4-b49b-4e6d-b6fa-96bfaa91c796 admin admin] PATH_INFO: `/v3/projects/91a413c80d5f4fca9a283e9780f85112` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:44.711554 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b76eb4-b49b-4e6d-b6fa-96bfaa91c796 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91a413c80d5f4fca9a283e9780f85112)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:45:44.712572 dv-cinder-854265-1-smb devstack@keystone.service[93148]: WARNING py.warnings [None req-60b76eb4-b49b-4e6d-b6fa-96bfaa91c796 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:45:44.712572 dv-cinder-854265-1-smb devstack@keystone.service[93148]: warnings.warn(msg) Aug 24 04:45:44.712572 dv-cinder-854265-1-smb devstack@keystone.service[93148]: Aug 24 04:45:44.713804 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b76eb4-b49b-4e6d-b6fa-96bfaa91c796 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:45:44.774997 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-60b76eb4-b49b-4e6d-b6fa-96bfaa91c796 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91a413c80d5f4fca9a283e9780f85112', 'request_id': 'req-60b76eb4-b49b-4e6d-b6fa-96bfaa91c796'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:45:44.788620 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-60b76eb4-b49b-4e6d-b6fa-96bfaa91c796 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91a413c80d5f4fca9a283e9780f85112', 'request_id': 'req-60b76eb4-b49b-4e6d-b6fa-96bfaa91c796'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:45:44.800459 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-60b76eb4-b49b-4e6d-b6fa-96bfaa91c796 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91a413c80d5f4fca9a283e9780f85112', 'request_id': 'req-60b76eb4-b49b-4e6d-b6fa-96bfaa91c796'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:45:44.823943 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-60b76eb4-b49b-4e6d-b6fa-96bfaa91c796 admin admin] The token cache is being invalidate because project 91a413c80d5f4fca9a283e9780f85112 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:45:44.824232 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-60b76eb4-b49b-4e6d-b6fa-96bfaa91c796 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:45:44.824753 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-60b76eb4-b49b-4e6d-b6fa-96bfaa91c796 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:45:44.826188 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 756/1510] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:45:44 2022] DELETE /identity/v3/projects/91a413c80d5f4fca9a283e9780f85112 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:45:54.235383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=62 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:54.821818 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:25.839293 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e373e-5aa4-42e7-b2a8-f3533bca2ef2 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:25.839930 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e373e-5aa4-42e7-b2a8-f3533bca2ef2 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:25.839930 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e373e-5aa4-42e7-b2a8-f3533bca2ef2 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:25.841176 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 755/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:47:25.846693 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f88cb-d18c-44be-a11c-7183d33b99fe None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:25.847274 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f88cb-d18c-44be-a11c-7183d33b99fe None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:25.847392 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f88cb-d18c-44be-a11c-7183d33b99fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:25.935939 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-931f88cb-d18c-44be-a11c-7183d33b99fe None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:47:25.937195 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-931f88cb-d18c-44be-a11c-7183d33b99fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:26.051074 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 757/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:47:26.202400 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e373e-5aa4-42e7-b2a8-f3533bca2ef2 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:47:26.204730 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-a74e373e-5aa4-42e7-b2a8-f3533bca2ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:26.334569 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e373e-5aa4-42e7-b2a8-f3533bca2ef2 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:47:26.344844 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76523470-ca2c-47f5-9ada-e5d6de166e3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:47:26.345735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76523470-ca2c-47f5-9ada-e5d6de166e3f service nova] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:26.346063 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76523470-ca2c-47f5-9ada-e5d6de166e3f service nova] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:26.346388 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76523470-ca2c-47f5-9ada-e5d6de166e3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:26.358088 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76523470-ca2c-47f5-9ada-e5d6de166e3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:47:26.360172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76523470-ca2c-47f5-9ada-e5d6de166e3f service nova] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:47:26.371543 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 756/1513] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:47:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:47:27.227852 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37de6d6-4409-4400-81e7-e85ff19b6bcd None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:27.228461 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37de6d6-4409-4400-81e7-e85ff19b6bcd None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:27.228461 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37de6d6-4409-4400-81e7-e85ff19b6bcd None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:27.229834 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 758/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:47:27.235170 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d86a5-c008-445b-9b00-1481d8663444 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:27.235643 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d86a5-c008-445b-9b00-1481d8663444 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:27.235744 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d86a5-c008-445b-9b00-1481d8663444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:27.260667 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-403d86a5-c008-445b-9b00-1481d8663444 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:47:27.262433 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-403d86a5-c008-445b-9b00-1481d8663444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:27.275076 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 757/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:47:27.424037 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37de6d6-4409-4400-81e7-e85ff19b6bcd None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:47:27.438919 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37de6d6-4409-4400-81e7-e85ff19b6bcd None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:47:27.444950 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3343956-cf60-4673-a077-93fa5e97b8ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:47:27.445565 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3343956-cf60-4673-a077-93fa5e97b8ae service nova] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:27.445841 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3343956-cf60-4673-a077-93fa5e97b8ae service nova] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:27.446103 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3343956-cf60-4673-a077-93fa5e97b8ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:27.454402 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3343956-cf60-4673-a077-93fa5e97b8ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:47:27.455975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3343956-cf60-4673-a077-93fa5e97b8ae service nova] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:47:27.465443 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 759/1516] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:47:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:47:27.546120 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3b7b8-3751-4673-8794-4d6fdf4d1d35 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:27.546389 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3b7b8-3751-4673-8794-4d6fdf4d1d35 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:27.546649 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c3b7b8-3751-4673-8794-4d6fdf4d1d35 None None] PATH_INFO: `/v3` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:27.547990 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 758/1517] 10.222.0.72 () {54 vars in 925 bytes} [Wed Aug 24 04:47:27 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:47:27.555030 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6308f-946f-4f90-bc84-8289d13c6a12 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:27.555279 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6308f-946f-4f90-bc84-8289d13c6a12 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:27.555548 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6308f-946f-4f90-bc84-8289d13c6a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:27.624589 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-00a6308f-946f-4f90-bc84-8289d13c6a12 None None] MFA Rules not processed for user `edf1b960a2eb4e5e9ada736b5f3f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:47:27.625833 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-00a6308f-946f-4f90-bc84-8289d13c6a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:27.642829 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:27.709851 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 760/1518] 10.222.0.72 () {58 vars in 1015 bytes} [Wed Aug 24 04:47:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:47:36.999668 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf3d2a-d782-4225-bf53-6db9348a73f6 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:37.000462 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf3d2a-d782-4225-bf53-6db9348a73f6 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:37.000462 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf3d2a-d782-4225-bf53-6db9348a73f6 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:37.002524 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 759/1519] 10.222.0.49 () {54 vars in 961 bytes} [Wed Aug 24 04:47:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:47:37.008534 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99717459-90f3-4ed1-b9af-7a5d9107d56d None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:37.008970 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99717459-90f3-4ed1-b9af-7a5d9107d56d None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:37.009097 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99717459-90f3-4ed1-b9af-7a5d9107d56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:37.036125 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-99717459-90f3-4ed1-b9af-7a5d9107d56d None None] MFA Rules not processed for user `edf1b960a2eb4e5e9ada736b5f3f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:47:37.037513 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-99717459-90f3-4ed1-b9af-7a5d9107d56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:37.047228 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 761/1520] 10.222.0.49 () {58 vars in 1058 bytes} [Wed Aug 24 04:47:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:47:37.055984 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf3d2a-d782-4225-bf53-6db9348a73f6 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:47:37.074062 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf3d2a-d782-4225-bf53-6db9348a73f6 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:47:37.079276 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ab3ccd-22b1-40f4-a556-a618608f7d37 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf1b960a2eb4e5e9ada736b5f3f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:47:37.079877 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab3ccd-22b1-40f4-a556-a618608f7d37 service placement] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:37.080151 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab3ccd-22b1-40f4-a556-a618608f7d37 service placement] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:37.080416 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab3ccd-22b1-40f4-a556-a618608f7d37 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:37.089152 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab3ccd-22b1-40f4-a556-a618608f7d37 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:47:37.090792 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ab3ccd-22b1-40f4-a556-a618608f7d37 service placement] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:47:37.101465 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 760/1521] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:47:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:47:38.761688 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d5264-6316-402e-8f44-bca1b65a7010 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:38.762230 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d5264-6316-402e-8f44-bca1b65a7010 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:38.762230 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d5264-6316-402e-8f44-bca1b65a7010 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:38.763533 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:47:38.769661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761bb61-5dd3-4671-aa66-e6b0c5b6e118 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:38.770082 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761bb61-5dd3-4671-aa66-e6b0c5b6e118 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:38.770252 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761bb61-5dd3-4671-aa66-e6b0c5b6e118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:38.799146 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-9761bb61-5dd3-4671-aa66-e6b0c5b6e118 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:47:38.800724 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-9761bb61-5dd3-4671-aa66-e6b0c5b6e118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:38.813382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:47:38.969797 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d5264-6316-402e-8f44-bca1b65a7010 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:47:38.991336 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d5264-6316-402e-8f44-bca1b65a7010 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:47:38.997654 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e9328-349b-4668-a0f4-7735406c8a12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:47:38.998316 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e9328-349b-4668-a0f4-7735406c8a12 service nova] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:38.998593 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e9328-349b-4668-a0f4-7735406c8a12 service nova] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:38.998893 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e9328-349b-4668-a0f4-7735406c8a12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:39.008339 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e9328-349b-4668-a0f4-7735406c8a12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:47:39.010006 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e9328-349b-4668-a0f4-7735406c8a12 service nova] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:47:39.020237 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 763/1524] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:47:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:47:39.887101 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6caa82-03a4-4a47-ac8c-64f7b8975ba7 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:39.887995 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6caa82-03a4-4a47-ac8c-64f7b8975ba7 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:39.887995 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6caa82-03a4-4a47-ac8c-64f7b8975ba7 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:39.890063 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 762/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:47:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:47:39.895479 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf1cff-b86c-4b8e-9d0f-0fe3b4d79c5a None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:39.895928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf1cff-b86c-4b8e-9d0f-0fe3b4d79c5a None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:39.896021 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf1cff-b86c-4b8e-9d0f-0fe3b4d79c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:39.917410 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-edbf1cff-b86c-4b8e-9d0f-0fe3b4d79c5a None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:47:39.918618 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-edbf1cff-b86c-4b8e-9d0f-0fe3b4d79c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:39.928013 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 764/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:47:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:47:40.091507 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6caa82-03a4-4a47-ac8c-64f7b8975ba7 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:47:40.107940 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6caa82-03a4-4a47-ac8c-64f7b8975ba7 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:47:40.114427 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad1b722-e297-41a5-8bce-63c5eb93e613 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:47:40.115031 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1b722-e297-41a5-8bce-63c5eb93e613 service nova] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:40.115306 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1b722-e297-41a5-8bce-63c5eb93e613 service nova] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:40.115580 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1b722-e297-41a5-8bce-63c5eb93e613 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:40.124857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1b722-e297-41a5-8bce-63c5eb93e613 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:47:40.126503 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad1b722-e297-41a5-8bce-63c5eb93e613 service nova] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:47:40.138417 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 763/1527] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:47:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:47:44.016698 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4d6bf-4649-4fff-8c90-8366e72de506 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:44.017290 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4d6bf-4649-4fff-8c90-8366e72de506 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:44.017290 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4d6bf-4649-4fff-8c90-8366e72de506 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:44.018750 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:47:44.024204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e96fb7-82f9-4523-ad4d-b83b3226b5c8 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:44.024661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e96fb7-82f9-4523-ad4d-b83b3226b5c8 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:44.024790 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e96fb7-82f9-4523-ad4d-b83b3226b5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:44.044874 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-14e96fb7-82f9-4523-ad4d-b83b3226b5c8 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:47:44.046150 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-14e96fb7-82f9-4523-ad4d-b83b3226b5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:44.054772 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:47:44.370513 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4d6bf-4649-4fff-8c90-8366e72de506 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:47:44.372318 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-ade4d6bf-4649-4fff-8c90-8366e72de506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:44.456145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4d6bf-4649-4fff-8c90-8366e72de506 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:47:44.460000 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657cd21-2ed3-45b8-96b0-bd831f8e456b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:47:44.460857 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657cd21-2ed3-45b8-96b0-bd831f8e456b service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:44.461320 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657cd21-2ed3-45b8-96b0-bd831f8e456b service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:44.461852 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657cd21-2ed3-45b8-96b0-bd831f8e456b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:44.476171 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657cd21-2ed3-45b8-96b0-bd831f8e456b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:47:44.477665 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657cd21-2ed3-45b8-96b0-bd831f8e456b service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:47:44.488271 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 766/1530] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:47:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:47:46.387708 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33079b92-1c30-4367-8e75-d746f237c0f0 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:46.388316 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33079b92-1c30-4367-8e75-d746f237c0f0 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:46.388316 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33079b92-1c30-4367-8e75-d746f237c0f0 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:46.389663 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 765/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:47:46.397593 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a77ab5-d21b-447e-9467-63d04200c638 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:46.398205 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a77ab5-d21b-447e-9467-63d04200c638 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:46.398205 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a77ab5-d21b-447e-9467-63d04200c638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:46.421285 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-56a77ab5-d21b-447e-9467-63d04200c638 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:47:46.422515 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-56a77ab5-d21b-447e-9467-63d04200c638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:46.431956 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 767/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:47:46.719713 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33079b92-1c30-4367-8e75-d746f237c0f0 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:47:46.730995 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33079b92-1c30-4367-8e75-d746f237c0f0 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:47:46.734619 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247624cb-dc65-4cf2-a799-ed3f73c1dd0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:47:46.735222 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247624cb-dc65-4cf2-a799-ed3f73c1dd0c service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:46.735488 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247624cb-dc65-4cf2-a799-ed3f73c1dd0c service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:46.736065 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247624cb-dc65-4cf2-a799-ed3f73c1dd0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:46.745609 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247624cb-dc65-4cf2-a799-ed3f73c1dd0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:47:46.747067 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247624cb-dc65-4cf2-a799-ed3f73c1dd0c service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:47:46.756986 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 766/1533] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:47:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:47:50.567151 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a55b5a-895f-4e1e-9b4c-7cc85be38172 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:50.567707 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a55b5a-895f-4e1e-9b4c-7cc85be38172 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:50.567818 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a55b5a-895f-4e1e-9b4c-7cc85be38172 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:50.569132 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 768/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:47:50.574735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532714b-d2c3-4964-beac-5341e063fcaf None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:50.575193 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532714b-d2c3-4964-beac-5341e063fcaf None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:50.575299 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532714b-d2c3-4964-beac-5341e063fcaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:50.595965 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-d532714b-d2c3-4964-beac-5341e063fcaf None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:47:50.597181 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-d532714b-d2c3-4964-beac-5341e063fcaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:50.607311 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 767/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:47:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:47:51.158306 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a55b5a-895f-4e1e-9b4c-7cc85be38172 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:47:51.160202 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-37a55b5a-895f-4e1e-9b4c-7cc85be38172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:51.241853 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:51.256487 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a55b5a-895f-4e1e-9b4c-7cc85be38172 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:47:51.260506 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667edce-e03c-4ba9-aed7-b973576e99ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:47:51.261092 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667edce-e03c-4ba9-aed7-b973576e99ae service cinder] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:51.261400 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667edce-e03c-4ba9-aed7-b973576e99ae service cinder] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:51.261663 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667edce-e03c-4ba9-aed7-b973576e99ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:51.271145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667edce-e03c-4ba9-aed7-b973576e99ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:47:51.272576 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3667edce-e03c-4ba9-aed7-b973576e99ae service cinder] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:47:51.282143 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 769/1536] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:47:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:47:53.204877 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5805fb8-86b3-4855-8ad3-becc8db2f343 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:53.205471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5805fb8-86b3-4855-8ad3-becc8db2f343 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:53.205570 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5805fb8-86b3-4855-8ad3-becc8db2f343 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:53.207706 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 768/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:47:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:47:53.213314 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28078401-a5e6-495e-9854-d25711617072 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:53.213813 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28078401-a5e6-495e-9854-d25711617072 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:53.213925 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28078401-a5e6-495e-9854-d25711617072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:53.235556 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-28078401-a5e6-495e-9854-d25711617072 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:47:53.237002 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-28078401-a5e6-495e-9854-d25711617072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:53.245268 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 770/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:47:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:47:53.816004 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5805fb8-86b3-4855-8ad3-becc8db2f343 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:47:53.818141 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-f5805fb8-86b3-4855-8ad3-becc8db2f343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:53.834940 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5805fb8-86b3-4855-8ad3-becc8db2f343 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:47:53.839545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b8ad86-988b-425b-a236-e5225fd0d56d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:47:53.840161 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8ad86-988b-425b-a236-e5225fd0d56d service cinder] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:53.840444 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8ad86-988b-425b-a236-e5225fd0d56d service cinder] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:53.840715 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b8ad86-988b-425b-a236-e5225fd0d56d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:53.851035 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8ad86-988b-425b-a236-e5225fd0d56d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:47:53.852524 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b8ad86-988b-425b-a236-e5225fd0d56d service cinder] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:47:53.866149 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 769/1539] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:47:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:48:03.230220 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=11 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:48:03.858575 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=89 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:22.506469 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b457b-07d2-4d09-8027-06358d4a5d60 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:22.507117 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b457b-07d2-4d09-8027-06358d4a5d60 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:22.507117 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b457b-07d2-4d09-8027-06358d4a5d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:22.538755 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-6e9b457b-07d2-4d09-8027-06358d4a5d60 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:22.540124 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-6e9b457b-07d2-4d09-8027-06358d4a5d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:22.552099 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 771/1540] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:49:22.560780 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f40a9-698a-4e56-a265-e2f0ffb8ee47 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:22.561374 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f40a9-698a-4e56-a265-e2f0ffb8ee47 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:22.561374 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f40a9-698a-4e56-a265-e2f0ffb8ee47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:22.587462 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-a71f40a9-698a-4e56-a265-e2f0ffb8ee47 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:22.588763 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-a71f40a9-698a-4e56-a265-e2f0ffb8ee47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:22.596764 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529dcef-42d8-43bf-9ed6-e19de2888ad7 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:22.597098 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529dcef-42d8-43bf-9ed6-e19de2888ad7 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:22.597322 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529dcef-42d8-43bf-9ed6-e19de2888ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:22.599014 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 770/1541] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:22.611306 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f40a9-698a-4e56-a265-e2f0ffb8ee47 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:22.624469 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f40a9-698a-4e56-a265-e2f0ffb8ee47 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:22.630430 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-2529dcef-42d8-43bf-9ed6-e19de2888ad7 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:22.630671 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72bff8-37c4-4d63-8868-d7b4ca8a82bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:22.631263 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72bff8-37c4-4d63-8868-d7b4ca8a82bd admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:22.631550 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72bff8-37c4-4d63-8868-d7b4ca8a82bd admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:22.631678 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-2529dcef-42d8-43bf-9ed6-e19de2888ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:22.631850 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72bff8-37c4-4d63-8868-d7b4ca8a82bd admin admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:22.632486 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c72bff8-37c4-4d63-8868-d7b4ca8a82bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:49:22.632891 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c72bff8-37c4-4d63-8868-d7b4ca8a82bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:22.633968 dv-cinder-854265-1-smb devstack@keystone.service[93147]: WARNING py.warnings [None req-2c72bff8-37c4-4d63-8868-d7b4ca8a82bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:49:22.633968 dv-cinder-854265-1-smb devstack@keystone.service[93147]: warnings.warn(msg) Aug 24 04:49:22.633968 dv-cinder-854265-1-smb devstack@keystone.service[93147]: Aug 24 04:49:22.634865 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c72bff8-37c4-4d63-8868-d7b4ca8a82bd admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:22.647482 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 772/1542] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:49:22.655400 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 771/1543] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:49:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:49:22.660877 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f6189-08ac-4fc4-b6f2-7fde715821b7 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:22.661175 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f6189-08ac-4fc4-b6f2-7fde715821b7 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:22.661469 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f6189-08ac-4fc4-b6f2-7fde715821b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:22.670097 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72bff8-37c4-4d63-8868-d7b4ca8a82bd admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:22.683750 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72bff8-37c4-4d63-8868-d7b4ca8a82bd admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:22.697055 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c5c0c-1143-4633-8a3d-bafb157b2a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:22.697803 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c5c0c-1143-4633-8a3d-bafb157b2a26 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:22.698625 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c5c0c-1143-4633-8a3d-bafb157b2a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:22.698625 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c5c0c-1143-4633-8a3d-bafb157b2a26 admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:22.699057 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c5c0c-1143-4633-8a3d-bafb157b2a26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:22.700586 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-f23f6189-08ac-4fc4-b6f2-7fde715821b7 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:22.701769 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c5c0c-1143-4633-8a3d-bafb157b2a26 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:22.701902 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-f23f6189-08ac-4fc4-b6f2-7fde715821b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:22.731705 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 773/1544] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:22.752338 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f6189-08ac-4fc4-b6f2-7fde715821b7 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:22.767503 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 772/1545] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:49:22 2022] POST /identity/v3/projects => generated 363 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:49:22.767745 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f6189-08ac-4fc4-b6f2-7fde715821b7 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:22.773770 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a7d4b-0e5f-4da6-bd46-f19307f92d2e None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:22.774107 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a7d4b-0e5f-4da6-bd46-f19307f92d2e None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:22.774331 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0a7d4b-0e5f-4da6-bd46-f19307f92d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:22.816058 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-1a0a7d4b-0e5f-4da6-bd46-f19307f92d2e None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:22.818220 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-1a0a7d4b-0e5f-4da6-bd46-f19307f92d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:22.938913 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 773/1546] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:22.939816 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a7d4b-0e5f-4da6-bd46-f19307f92d2e None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:22.944212 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b234d6-08b3-4bfa-bd7f-c2d517d0bc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:22.944850 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b234d6-08b3-4bfa-bd7f-c2d517d0bc81 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:22.945133 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b234d6-08b3-4bfa-bd7f-c2d517d0bc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:22.945511 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b234d6-08b3-4bfa-bd7f-c2d517d0bc81 admin admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:22.946181 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b234d6-08b3-4bfa-bd7f-c2d517d0bc81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:49:22.946485 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b234d6-08b3-4bfa-bd7f-c2d517d0bc81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:22.948448 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b234d6-08b3-4bfa-bd7f-c2d517d0bc81 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:22.957782 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0a7d4b-0e5f-4da6-bd46-f19307f92d2e None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:22.981362 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 774/1547] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:49:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:49:22.981597 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcf5f2-dd53-469c-a301-58efa809bcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:22.981713 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4e8d6-23f4-4756-ae11-e397be4c8c00 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:22.981713 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4e8d6-23f4-4756-ae11-e397be4c8c00 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:22.981876 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcf5f2-dd53-469c-a301-58efa809bcdb admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:22.981954 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4e8d6-23f4-4756-ae11-e397be4c8c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:22.982035 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcf5f2-dd53-469c-a301-58efa809bcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:22.982035 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcf5f2-dd53-469c-a301-58efa809bcdb admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:22.982035 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdcf5f2-dd53-469c-a301-58efa809bcdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:22.982980 dv-cinder-854265-1-smb devstack@keystone.service[93147]: WARNING py.warnings [None req-3cdcf5f2-dd53-469c-a301-58efa809bcdb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:49:22.982980 dv-cinder-854265-1-smb devstack@keystone.service[93147]: warnings.warn(msg) Aug 24 04:49:22.982980 dv-cinder-854265-1-smb devstack@keystone.service[93147]: Aug 24 04:49:22.984208 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdcf5f2-dd53-469c-a301-58efa809bcdb admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:23.039650 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-d7f4e8d6-23f4-4756-ae11-e397be4c8c00 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:23.043212 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-d7f4e8d6-23f4-4756-ae11-e397be4c8c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:23.047181 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 774/1548] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:49:22 2022] POST /identity/v3/users => generated 282 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:23.053671 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcf5f2-dd53-469c-a301-58efa809bcdb admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:23.060371 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 775/1549] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:23.061177 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4e8d6-23f4-4756-ae11-e397be4c8c00 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:23.076510 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcf5f2-dd53-469c-a301-58efa809bcdb admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:23.078303 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4e8d6-23f4-4756-ae11-e397be4c8c00 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:23.082119 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca7ee9-35d1-4f8f-b032-d037fd21c7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:23.082865 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca7ee9-35d1-4f8f-b032-d037fd21c7d4 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:23.083276 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca7ee9-35d1-4f8f-b032-d037fd21c7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:23.083493 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca7ee9-35d1-4f8f-b032-d037fd21c7d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:23.084257 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca7ee9-35d1-4f8f-b032-d037fd21c7d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:23.084556 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985521c-e725-411f-903f-e88de7a4b6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:23.085395 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985521c-e725-411f-903f-e88de7a4b6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:23.085872 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985521c-e725-411f-903f-e88de7a4b6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:23.086338 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985521c-e725-411f-903f-e88de7a4b6e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:23.086696 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca7ee9-35d1-4f8f-b032-d037fd21c7d4 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:23.087382 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2985521c-e725-411f-903f-e88de7a4b6e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:23.089318 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2985521c-e725-411f-903f-e88de7a4b6e8 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:23.106017 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 776/1550] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:23.107361 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985521c-e725-411f-903f-e88de7a4b6e8 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:23.118836 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985521c-e725-411f-903f-e88de7a4b6e8 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:23.122314 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 775/1551] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:49:23 2022] POST /identity/v3/projects => generated 379 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:23.123621 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823b41a-e896-458d-abdf-ef79d770a18c None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:23.123903 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823b41a-e896-458d-abdf-ef79d770a18c None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:23.124172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823b41a-e896-458d-abdf-ef79d770a18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:23.125151 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1684889b-c74f-4d79-ae02-76718592ef15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:23.125791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684889b-c74f-4d79-ae02-76718592ef15 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:23.126068 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684889b-c74f-4d79-ae02-76718592ef15 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:23.126344 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1684889b-c74f-4d79-ae02-76718592ef15 admin admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:23.126989 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684889b-c74f-4d79-ae02-76718592ef15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:49:23.127294 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684889b-c74f-4d79-ae02-76718592ef15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:23.128893 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1684889b-c74f-4d79-ae02-76718592ef15 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:23.141676 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 777/1552] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:49:23.142915 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dd6b3-99db-4173-a827-af4700673920 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:23.143213 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dd6b3-99db-4173-a827-af4700673920 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:23.143509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780dd6b3-99db-4173-a827-af4700673920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:23.146156 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-6823b41a-e896-458d-abdf-ef79d770a18c None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:23.147464 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-6823b41a-e896-458d-abdf-ef79d770a18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:23.165882 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-780dd6b3-99db-4173-a827-af4700673920 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:23.167105 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-780dd6b3-99db-4173-a827-af4700673920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:23.208809 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 776/1553] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:23.210037 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02900d98-10f6-4c24-99f4-184ae5668c22 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:23.210329 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02900d98-10f6-4c24-99f4-184ae5668c22 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:23.210594 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02900d98-10f6-4c24-99f4-184ae5668c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:23.227664 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 778/1554] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:23.228992 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff826e-aba4-47c5-99bc-14de46952946 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:23.229281 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff826e-aba4-47c5-99bc-14de46952946 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:23.229487 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-02900d98-10f6-4c24-99f4-184ae5668c22 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:23.229609 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff826e-aba4-47c5-99bc-14de46952946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:23.230729 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-02900d98-10f6-4c24-99f4-184ae5668c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:23.241029 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 777/1555] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:23.241867 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02900d98-10f6-4c24-99f4-184ae5668c22 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:23.248471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:23.251846 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-ffff826e-aba4-47c5-99bc-14de46952946 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:23.252369 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02900d98-10f6-4c24-99f4-184ae5668c22 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:23.253060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-ffff826e-aba4-47c5-99bc-14de46952946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:23.258307 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc152c0-d012-465e-9237-c9f91068d52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:23.258913 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc152c0-d012-465e-9237-c9f91068d52f admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:23.259193 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc152c0-d012-465e-9237-c9f91068d52f admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:23.259466 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc152c0-d012-465e-9237-c9f91068d52f admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:23.260116 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc152c0-d012-465e-9237-c9f91068d52f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:23.261532 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 779/1556] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:23.261836 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc152c0-d012-465e-9237-c9f91068d52f admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:23.262725 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db152eb2-731e-441d-b591-e04b7c5d3e58 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:23.263040 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db152eb2-731e-441d-b591-e04b7c5d3e58 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:23.263315 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db152eb2-731e-441d-b591-e04b7c5d3e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:23.278285 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 778/1557] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:23.279502 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc152c0-d012-465e-9237-c9f91068d52f admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:23.282994 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-db152eb2-731e-441d-b591-e04b7c5d3e58 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:23.284187 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-db152eb2-731e-441d-b591-e04b7c5d3e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:23.289218 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc152c0-d012-465e-9237-c9f91068d52f admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:23.292128 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 780/1558] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:23.292939 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db152eb2-731e-441d-b591-e04b7c5d3e58 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:23.293995 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e73c50-45cf-47a9-aac4-9cd5b1186e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:23.295623 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e73c50-45cf-47a9-aac4-9cd5b1186e28 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:23.295912 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e73c50-45cf-47a9-aac4-9cd5b1186e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:23.296191 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e73c50-45cf-47a9-aac4-9cd5b1186e28 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:23.296887 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e73c50-45cf-47a9-aac4-9cd5b1186e28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:23.298856 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e73c50-45cf-47a9-aac4-9cd5b1186e28 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:23.302138 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db152eb2-731e-441d-b591-e04b7c5d3e58 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:23.306661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eaf736-0bbd-4e8c-8e5d-c693770b342c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:23.307251 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eaf736-0bbd-4e8c-8e5d-c693770b342c admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:23.307526 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eaf736-0bbd-4e8c-8e5d-c693770b342c admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:23.307795 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eaf736-0bbd-4e8c-8e5d-c693770b342c admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:23.308464 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eaf736-0bbd-4e8c-8e5d-c693770b342c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:23.309589 dv-cinder-854265-1-smb devstack@keystone.service[93148]: WARNING py.warnings [None req-a6eaf736-0bbd-4e8c-8e5d-c693770b342c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:49:23.309589 dv-cinder-854265-1-smb devstack@keystone.service[93148]: warnings.warn(msg) Aug 24 04:49:23.309589 dv-cinder-854265-1-smb devstack@keystone.service[93148]: Aug 24 04:49:23.311004 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eaf736-0bbd-4e8c-8e5d-c693770b342c admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:23.325064 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 779/1559] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:49:23 2022] POST /identity/v3/users => generated 290 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:23.325064 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71464f-6d9a-4458-8c7a-21210dd02861 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:23.325064 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71464f-6d9a-4458-8c7a-21210dd02861 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:23.325064 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71464f-6d9a-4458-8c7a-21210dd02861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:23.342270 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 781/1560] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:49:23 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:23.342270 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f30a52-4931-496c-b0df-4e55ede29f4f None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:23.342270 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f30a52-4931-496c-b0df-4e55ede29f4f None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:23.342270 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f30a52-4931-496c-b0df-4e55ede29f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:23.348529 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-fe71464f-6d9a-4458-8c7a-21210dd02861 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:23.349795 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-fe71464f-6d9a-4458-8c7a-21210dd02861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:23.359412 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-30f30a52-4931-496c-b0df-4e55ede29f4f None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:23.360606 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-30f30a52-4931-496c-b0df-4e55ede29f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:23.364848 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:23.412065 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 780/1561] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:23.413342 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f111c-4593-4958-8e0e-bf85b37fedb7 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:23.413636 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f111c-4593-4958-8e0e-bf85b37fedb7 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:23.413912 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f111c-4593-4958-8e0e-bf85b37fedb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:23.423138 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 782/1562] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:23.424700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40d32f-5326-408b-a504-ef93c48dec3a None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:23.425169 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40d32f-5326-408b-a504-ef93c48dec3a None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:23.425472 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40d32f-5326-408b-a504-ef93c48dec3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:23.433486 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-d48f111c-4593-4958-8e0e-bf85b37fedb7 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:23.434729 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-d48f111c-4593-4958-8e0e-bf85b37fedb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:23.442895 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 781/1563] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:23.443475 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f111c-4593-4958-8e0e-bf85b37fedb7 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:23.444913 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-6b40d32f-5326-408b-a504-ef93c48dec3a None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:23.446128 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-6b40d32f-5326-408b-a504-ef93c48dec3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:23.452792 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f111c-4593-4958-8e0e-bf85b37fedb7 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:23.454339 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 783/1564] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:23.455585 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0c5d2-c4f6-4ccf-aa6a-95c9beb25e11 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:23.455909 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0c5d2-c4f6-4ccf-aa6a-95c9beb25e11 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:23.456137 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0c5d2-c4f6-4ccf-aa6a-95c9beb25e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:23.457600 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7c635-5b1c-4634-8cf6-20045f82201c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:23.458244 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7c635-5b1c-4634-8cf6-20045f82201c admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:23.458521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7c635-5b1c-4634-8cf6-20045f82201c admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:23.458790 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7c635-5b1c-4634-8cf6-20045f82201c admin admin] PATH_INFO: `/v3/projects/df3820a6c392449ba49c45b95c59fbe3/users/dddcaf1222cf488180c22dfad9ee54b9/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:23.473815 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f7c635-5b1c-4634-8cf6-20045f82201c admin admin] RBAC: Authorizing `identity:create_grant(project_id=df3820a6c392449ba49c45b95c59fbe3, user_id=dddcaf1222cf488180c22dfad9ee54b9, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:23.475739 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-28d0c5d2-c4f6-4ccf-aa6a-95c9beb25e11 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:23.476504 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f7c635-5b1c-4634-8cf6-20045f82201c admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:23.476971 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-28d0c5d2-c4f6-4ccf-aa6a-95c9beb25e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:23.485890 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 784/1565] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:23.490189 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0c5d2-c4f6-4ccf-aa6a-95c9beb25e11 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:23.491127 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 782/1566] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:49:23 2022] PUT /identity/v3/projects/df3820a6c392449ba49c45b95c59fbe3/users/dddcaf1222cf488180c22dfad9ee54b9/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:23.491932 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7c635-5b1c-4634-8cf6-20045f82201c admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:23.501295 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0c5d2-c4f6-4ccf-aa6a-95c9beb25e11 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:23.554169 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7c635-5b1c-4634-8cf6-20045f82201c admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:23.558852 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48dfedf-c37d-4a0a-ab55-5cfad88d27e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:23.559458 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48dfedf-c37d-4a0a-ab55-5cfad88d27e2 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:23.559747 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48dfedf-c37d-4a0a-ab55-5cfad88d27e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:23.560006 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48dfedf-c37d-4a0a-ab55-5cfad88d27e2 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:23.560623 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48dfedf-c37d-4a0a-ab55-5cfad88d27e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:23.562583 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48dfedf-c37d-4a0a-ab55-5cfad88d27e2 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:23.575071 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889cc11-bb20-440b-9351-e36a9e16f2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:23.575697 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889cc11-bb20-440b-9351-e36a9e16f2b8 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:23.576022 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889cc11-bb20-440b-9351-e36a9e16f2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:23.576305 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889cc11-bb20-440b-9351-e36a9e16f2b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:23.577001 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e889cc11-bb20-440b-9351-e36a9e16f2b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:23.579788 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e889cc11-bb20-440b-9351-e36a9e16f2b8 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:23.584964 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 783/1567] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:49:23 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:23.585918 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48dfedf-c37d-4a0a-ab55-5cfad88d27e2 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:23.592116 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 785/1568] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:23.592940 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889cc11-bb20-440b-9351-e36a9e16f2b8 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:23.596626 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48dfedf-c37d-4a0a-ab55-5cfad88d27e2 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:23.602052 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828eb70-7877-4f46-a1dd-39b1fbb11a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:23.602700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889cc11-bb20-440b-9351-e36a9e16f2b8 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:23.602831 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828eb70-7877-4f46-a1dd-39b1fbb11a99 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:23.602956 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828eb70-7877-4f46-a1dd-39b1fbb11a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:23.603178 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828eb70-7877-4f46-a1dd-39b1fbb11a99 admin admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:23.603827 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828eb70-7877-4f46-a1dd-39b1fbb11a99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:49:23.604146 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828eb70-7877-4f46-a1dd-39b1fbb11a99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:23.605842 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828eb70-7877-4f46-a1dd-39b1fbb11a99 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:23.607268 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e1522-b883-4d79-aca9-dd6b862ec7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:23.607850 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e1522-b883-4d79-aca9-dd6b862ec7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:23.608130 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e1522-b883-4d79-aca9-dd6b862ec7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:23.608410 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e1522-b883-4d79-aca9-dd6b862ec7b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:23.609052 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e1522-b883-4d79-aca9-dd6b862ec7b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:49:23.609426 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e1522-b883-4d79-aca9-dd6b862ec7b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:23.611023 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e1522-b883-4d79-aca9-dd6b862ec7b1 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:23.618606 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 784/1569] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:49:23.619824 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828eb70-7877-4f46-a1dd-39b1fbb11a99 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:23.629735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828eb70-7877-4f46-a1dd-39b1fbb11a99 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:23.636805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 786/1570] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:49:23.636805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e1522-b883-4d79-aca9-dd6b862ec7b1 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:23.641487 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72061e-8e86-442a-a6b6-d51ce76c91b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:23.642040 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e1522-b883-4d79-aca9-dd6b862ec7b1 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:23.642172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72061e-8e86-442a-a6b6-d51ce76c91b2 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:23.643462 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72061e-8e86-442a-a6b6-d51ce76c91b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:23.643745 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72061e-8e86-442a-a6b6-d51ce76c91b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:23.644426 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e72061e-8e86-442a-a6b6-d51ce76c91b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:49:23.644727 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e72061e-8e86-442a-a6b6-d51ce76c91b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:23.646368 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e72061e-8e86-442a-a6b6-d51ce76c91b2 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:23.646561 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8f796-3c49-47a9-bab1-ffa5d28e2e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:23.647137 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8f796-3c49-47a9-bab1-ffa5d28e2e09 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:23.647415 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8f796-3c49-47a9-bab1-ffa5d28e2e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:23.647685 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8f796-3c49-47a9-bab1-ffa5d28e2e09 admin admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:23.648315 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8f796-3c49-47a9-bab1-ffa5d28e2e09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:49:23.648615 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8f796-3c49-47a9-bab1-ffa5d28e2e09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:23.650248 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8f796-3c49-47a9-bab1-ffa5d28e2e09 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:23.665948 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 785/1571] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:49:23.665948 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72061e-8e86-442a-a6b6-d51ce76c91b2 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:23.666227 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 787/1572] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:49:23.666227 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adba448-b7b1-4356-8b13-87f0345448fb None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:23.666227 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adba448-b7b1-4356-8b13-87f0345448fb None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:23.666227 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adba448-b7b1-4356-8b13-87f0345448fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:23.674925 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72061e-8e86-442a-a6b6-d51ce76c91b2 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:23.679507 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7848538-d385-4de4-95c5-697d70fd1ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:23.680145 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7848538-d385-4de4-95c5-697d70fd1ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:23.680434 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7848538-d385-4de4-95c5-697d70fd1ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:23.680708 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7848538-d385-4de4-95c5-697d70fd1ae1 admin admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:23.681383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7848538-d385-4de4-95c5-697d70fd1ae1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:49:23.681705 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7848538-d385-4de4-95c5-697d70fd1ae1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:23.683375 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7848538-d385-4de4-95c5-697d70fd1ae1 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:23.686715 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:23.694370 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-3adba448-b7b1-4356-8b13-87f0345448fb None None] MFA Rules not processed for user `dddcaf1222cf488180c22dfad9ee54b9`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:23.695597 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-3adba448-b7b1-4356-8b13-87f0345448fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:23.703915 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 786/1573] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:49:23.703915 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7848538-d385-4de4-95c5-697d70fd1ae1 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:23.713499 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7848538-d385-4de4-95c5-697d70fd1ae1 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:23.717985 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af7cad-7ffa-4668-9873-b0a413426801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:23.718568 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af7cad-7ffa-4668-9873-b0a413426801 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:23.718844 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af7cad-7ffa-4668-9873-b0a413426801 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:23.719117 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af7cad-7ffa-4668-9873-b0a413426801 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:23.719754 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af7cad-7ffa-4668-9873-b0a413426801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:23.721369 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6af7cad-7ffa-4668-9873-b0a413426801 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:23.731413 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 787/1574] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:23.732131 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af7cad-7ffa-4668-9873-b0a413426801 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:23.742337 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af7cad-7ffa-4668-9873-b0a413426801 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:23.747933 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6571c-9a74-4602-bad7-7e6d6bff45fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:23.748544 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6571c-9a74-4602-bad7-7e6d6bff45fc admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:23.748819 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6571c-9a74-4602-bad7-7e6d6bff45fc admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:23.749086 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6571c-9a74-4602-bad7-7e6d6bff45fc admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:23.749768 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6571c-9a74-4602-bad7-7e6d6bff45fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:23.751332 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af6571c-9a74-4602-bad7-7e6d6bff45fc admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:23.758725 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:23.761235 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 788/1575] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:23.762112 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6571c-9a74-4602-bad7-7e6d6bff45fc admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:23.771998 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 788/1576] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:23.771998 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adba448-b7b1-4356-8b13-87f0345448fb None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:23.774937 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af6571c-9a74-4602-bad7-7e6d6bff45fc admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:23.783515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8027e6-de6c-40d4-a537-d5b05caa2e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:23.784313 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8027e6-de6c-40d4-a537-d5b05caa2e83 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:23.784591 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8027e6-de6c-40d4-a537-d5b05caa2e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:23.784862 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8027e6-de6c-40d4-a537-d5b05caa2e83 admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:23.785756 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8027e6-de6c-40d4-a537-d5b05caa2e83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:23.788290 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8027e6-de6c-40d4-a537-d5b05caa2e83 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:23.790659 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adba448-b7b1-4356-8b13-87f0345448fb None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:23.795302 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3c082-7ceb-45eb-a3da-2d97a803116c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:23.795906 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3c082-7ceb-45eb-a3da-2d97a803116c admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:23.796181 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3c082-7ceb-45eb-a3da-2d97a803116c admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:23.796447 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3c082-7ceb-45eb-a3da-2d97a803116c admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:23.797064 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3c082-7ceb-45eb-a3da-2d97a803116c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:23.798991 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3c082-7ceb-45eb-a3da-2d97a803116c admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:23.817271 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 789/1577] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:49:23 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:23.818331 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8027e6-de6c-40d4-a537-d5b05caa2e83 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:23.829959 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 789/1578] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:49:23 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:23.830795 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3c082-7ceb-45eb-a3da-2d97a803116c admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:23.890193 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8027e6-de6c-40d4-a537-d5b05caa2e83 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:23.908262 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3c082-7ceb-45eb-a3da-2d97a803116c admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:23.914338 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2686a0-da9d-4eda-b3b5-5e1c80899751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:23.914974 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2686a0-da9d-4eda-b3b5-5e1c80899751 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:23.915251 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2686a0-da9d-4eda-b3b5-5e1c80899751 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:23.915519 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2686a0-da9d-4eda-b3b5-5e1c80899751 admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:23.916200 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2686a0-da9d-4eda-b3b5-5e1c80899751 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:23.918360 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2686a0-da9d-4eda-b3b5-5e1c80899751 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:23.947569 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 790/1579] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:49:23 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:23.948552 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2686a0-da9d-4eda-b3b5-5e1c80899751 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:23.960208 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1affc0fd-9278-44cd-85dd-3fa69f18c08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:23.960830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1affc0fd-9278-44cd-85dd-3fa69f18c08c admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:23.961105 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1affc0fd-9278-44cd-85dd-3fa69f18c08c admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:23.961435 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1affc0fd-9278-44cd-85dd-3fa69f18c08c admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:23.962125 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1affc0fd-9278-44cd-85dd-3fa69f18c08c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:23.964088 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1affc0fd-9278-44cd-85dd-3fa69f18c08c admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:23.993954 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 790/1580] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:49:23 2022] POST /identity/v3/projects => generated 405 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:23.995233 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1affc0fd-9278-44cd-85dd-3fa69f18c08c admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:24.013142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2686a0-da9d-4eda-b3b5-5e1c80899751 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:24.039690 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:24.057753 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1affc0fd-9278-44cd-85dd-3fa69f18c08c admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:24.062738 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eac6b0-f402-42c7-888c-e12815073936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:24.063366 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eac6b0-f402-42c7-888c-e12815073936 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:24.063669 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eac6b0-f402-42c7-888c-e12815073936 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:24.063899 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eac6b0-f402-42c7-888c-e12815073936 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:24.064661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eac6b0-f402-42c7-888c-e12815073936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:24.066301 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eac6b0-f402-42c7-888c-e12815073936 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:24.071379 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46847600-4776-4e6f-b44c-a02751890e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:24.071997 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46847600-4776-4e6f-b44c-a02751890e97 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:24.072289 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46847600-4776-4e6f-b44c-a02751890e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:24.072556 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46847600-4776-4e6f-b44c-a02751890e97 admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:24.073217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46847600-4776-4e6f-b44c-a02751890e97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:24.075256 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46847600-4776-4e6f-b44c-a02751890e97 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:24.077188 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 791/1581] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:24.078002 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eac6b0-f402-42c7-888c-e12815073936 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:24.087317 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:24.088066 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eac6b0-f402-42c7-888c-e12815073936 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:24.093013 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb31ec-00d7-4312-82ff-69d984c2310c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:24.093697 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb31ec-00d7-4312-82ff-69d984c2310c admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:24.093966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb31ec-00d7-4312-82ff-69d984c2310c admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:24.094245 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb31ec-00d7-4312-82ff-69d984c2310c admin admin] PATH_INFO: `/v3/projects/35277b5a0b954300859020aea7d676f4/users/0a0a837efc394b70b9e2b1d4a4857c04/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:24.106960 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 791/1582] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:49:23 2022] POST /identity/v3/projects => generated 393 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:24.107908 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46847600-4776-4e6f-b44c-a02751890e97 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:24.112401 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb31ec-00d7-4312-82ff-69d984c2310c admin admin] RBAC: Authorizing `identity:create_grant(project_id=35277b5a0b954300859020aea7d676f4, user_id=0a0a837efc394b70b9e2b1d4a4857c04, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:24.115272 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb31ec-00d7-4312-82ff-69d984c2310c admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:24.130761 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 792/1583] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:49:24 2022] PUT /identity/v3/projects/35277b5a0b954300859020aea7d676f4/users/0a0a837efc394b70b9e2b1d4a4857c04/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:24.135351 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb31ec-00d7-4312-82ff-69d984c2310c admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:24.170700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46847600-4776-4e6f-b44c-a02751890e97 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:24.198734 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb31ec-00d7-4312-82ff-69d984c2310c admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:24.203393 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d2446-7d4a-4cf0-a4ba-ebd0ec68426f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:24.204023 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d2446-7d4a-4cf0-a4ba-ebd0ec68426f admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:24.204313 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d2446-7d4a-4cf0-a4ba-ebd0ec68426f admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:24.204592 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d2446-7d4a-4cf0-a4ba-ebd0ec68426f admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:24.205229 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d2446-7d4a-4cf0-a4ba-ebd0ec68426f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:24.207246 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d2446-7d4a-4cf0-a4ba-ebd0ec68426f admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:24.227494 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51300d4b-ec83-4ea8-bb8f-9aecec0b7b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:24.228149 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51300d4b-ec83-4ea8-bb8f-9aecec0b7b84 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:24.228426 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51300d4b-ec83-4ea8-bb8f-9aecec0b7b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:24.228710 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51300d4b-ec83-4ea8-bb8f-9aecec0b7b84 admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:24.229316 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51300d4b-ec83-4ea8-bb8f-9aecec0b7b84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:24.231343 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51300d4b-ec83-4ea8-bb8f-9aecec0b7b84 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:24.231753 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 793/1584] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:49:24 2022] POST /identity/v3/users => generated 285 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:24.231753 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d2446-7d4a-4cf0-a4ba-ebd0ec68426f admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:24.251555 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d2446-7d4a-4cf0-a4ba-ebd0ec68426f admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:24.257417 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6219fe5-c530-48b4-9a94-9b7fb8d31e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:24.258100 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6219fe5-c530-48b4-9a94-9b7fb8d31e31 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:24.258426 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6219fe5-c530-48b4-9a94-9b7fb8d31e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:24.258715 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6219fe5-c530-48b4-9a94-9b7fb8d31e31 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:24.259368 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6219fe5-c530-48b4-9a94-9b7fb8d31e31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:24.261358 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6219fe5-c530-48b4-9a94-9b7fb8d31e31 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:24.267650 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 792/1585] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:49:24 2022] POST /identity/v3/projects => generated 365 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:24.267650 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51300d4b-ec83-4ea8-bb8f-9aecec0b7b84 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:24.288864 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 794/1586] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:49:24 2022] POST /identity/v3/users => generated 287 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:24.288864 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6219fe5-c530-48b4-9a94-9b7fb8d31e31 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:24.296972 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6219fe5-c530-48b4-9a94-9b7fb8d31e31 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:24.333102 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51300d4b-ec83-4ea8-bb8f-9aecec0b7b84 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:24.338164 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675abeb9-d676-4efd-80a5-30bfd7d00c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:24.338941 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675abeb9-d676-4efd-80a5-30bfd7d00c8d admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:24.339226 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675abeb9-d676-4efd-80a5-30bfd7d00c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:24.339448 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675abeb9-d676-4efd-80a5-30bfd7d00c8d admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:24.340008 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675abeb9-d676-4efd-80a5-30bfd7d00c8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:24.342047 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675abeb9-d676-4efd-80a5-30bfd7d00c8d admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:24.358140 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99352f-5cce-40c5-8d22-60af8f96c46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:24.358918 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99352f-5cce-40c5-8d22-60af8f96c46c admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:24.359101 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99352f-5cce-40c5-8d22-60af8f96c46c admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:24.359318 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99352f-5cce-40c5-8d22-60af8f96c46c admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:24.359964 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99352f-5cce-40c5-8d22-60af8f96c46c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:24.362015 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99352f-5cce-40c5-8d22-60af8f96c46c admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:24.368972 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 793/1587] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:49:24 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:24.368972 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675abeb9-d676-4efd-80a5-30bfd7d00c8d admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:24.377172 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675abeb9-d676-4efd-80a5-30bfd7d00c8d admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:24.382451 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456efbc1-acf7-485a-bef4-52c1a5ff44fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:24.383136 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456efbc1-acf7-485a-bef4-52c1a5ff44fd admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:24.383417 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456efbc1-acf7-485a-bef4-52c1a5ff44fd admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:24.383688 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456efbc1-acf7-485a-bef4-52c1a5ff44fd admin admin] PATH_INFO: `/v3/projects/cbcb723b1bfa400b807873faeac1bcd5/users/7c1211261c204ed982348835ddff7e1f/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:24.388546 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 795/1588] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:49:24 2022] POST /identity/v3/users => generated 303 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:24.388546 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99352f-5cce-40c5-8d22-60af8f96c46c admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:24.396068 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99352f-5cce-40c5-8d22-60af8f96c46c admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:24.398723 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:24.401098 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18f071-d8cd-4afe-bf88-63de70cf160e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:24.401786 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18f071-d8cd-4afe-bf88-63de70cf160e admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:24.402093 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18f071-d8cd-4afe-bf88-63de70cf160e admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:24.402482 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18f071-d8cd-4afe-bf88-63de70cf160e admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:24.403134 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18f071-d8cd-4afe-bf88-63de70cf160e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:24.404339 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456efbc1-acf7-485a-bef4-52c1a5ff44fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbcb723b1bfa400b807873faeac1bcd5, user_id=7c1211261c204ed982348835ddff7e1f, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:24.405286 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18f071-d8cd-4afe-bf88-63de70cf160e admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:24.405520 dv-cinder-854265-1-smb devstack@keystone.service[93148]: WARNING py.warnings [None req-456efbc1-acf7-485a-bef4-52c1a5ff44fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:49:24.405520 dv-cinder-854265-1-smb devstack@keystone.service[93148]: warnings.warn(msg) Aug 24 04:49:24.405520 dv-cinder-854265-1-smb devstack@keystone.service[93148]: Aug 24 04:49:24.407670 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456efbc1-acf7-485a-bef4-52c1a5ff44fd admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:24.433706 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 794/1589] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:49:24 2022] PUT /identity/v3/projects/cbcb723b1bfa400b807873faeac1bcd5/users/7c1211261c204ed982348835ddff7e1f/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:24.433706 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2c32a-7bb8-4ace-b88d-930e7aa4d89d None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:24.433971 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:24.434084 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2c32a-7bb8-4ace-b88d-930e7aa4d89d None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:24.434084 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f2c32a-7bb8-4ace-b88d-930e7aa4d89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:24.436465 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 796/1590] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:49:24 2022] POST /identity/v3/users => generated 297 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:24.440478 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18f071-d8cd-4afe-bf88-63de70cf160e admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:24.451163 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18f071-d8cd-4afe-bf88-63de70cf160e admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:24.452121 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-58f2c32a-7bb8-4ace-b88d-930e7aa4d89d None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:24.453360 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-58f2c32a-7bb8-4ace-b88d-930e7aa4d89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:24.513666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37e77d-3cc5-47c7-8295-4fa5e240b1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:24.514297 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37e77d-3cc5-47c7-8295-4fa5e240b1bb admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:24.514645 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37e77d-3cc5-47c7-8295-4fa5e240b1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:24.514982 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37e77d-3cc5-47c7-8295-4fa5e240b1bb admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:24.515195 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 795/1591] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:24.515767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e37e77d-3cc5-47c7-8295-4fa5e240b1bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:24.516165 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2c32a-7bb8-4ace-b88d-930e7aa4d89d None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:24.517528 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e37e77d-3cc5-47c7-8295-4fa5e240b1bb admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:24.527818 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f2c32a-7bb8-4ace-b88d-930e7aa4d89d None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:24.530981 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 797/1592] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:24.530981 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37e77d-3cc5-47c7-8295-4fa5e240b1bb admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:24.532856 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a27870-7d8b-44ee-896b-b129770d7002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:24.533525 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a27870-7d8b-44ee-896b-b129770d7002 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:24.533813 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a27870-7d8b-44ee-896b-b129770d7002 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:24.534089 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a27870-7d8b-44ee-896b-b129770d7002 admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:24.534724 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a27870-7d8b-44ee-896b-b129770d7002 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:24.536808 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a27870-7d8b-44ee-896b-b129770d7002 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:24.538954 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37e77d-3cc5-47c7-8295-4fa5e240b1bb admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:24.543673 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3b07f-423c-4634-a0ef-0713ffee07e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:24.544257 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3b07f-423c-4634-a0ef-0713ffee07e6 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:24.544536 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3b07f-423c-4634-a0ef-0713ffee07e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:24.544811 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3b07f-423c-4634-a0ef-0713ffee07e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:24.545491 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3b07f-423c-4634-a0ef-0713ffee07e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:24.547203 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3b07f-423c-4634-a0ef-0713ffee07e6 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:24.562786 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 798/1593] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:24.563718 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 796/1594] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:49:24 2022] POST /identity/v3/users => generated 289 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:24.563847 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3b07f-423c-4634-a0ef-0713ffee07e6 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:24.563939 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a27870-7d8b-44ee-896b-b129770d7002 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:24.571257 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a27870-7d8b-44ee-896b-b129770d7002 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:24.573508 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3b07f-423c-4634-a0ef-0713ffee07e6 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:24.576440 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcf04fd-9dea-47a7-b669-46c896bdc88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:24.577067 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf04fd-9dea-47a7-b669-46c896bdc88f admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:24.577380 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf04fd-9dea-47a7-b669-46c896bdc88f admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:24.577695 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcf04fd-9dea-47a7-b669-46c896bdc88f admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:24.578361 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf04fd-9dea-47a7-b669-46c896bdc88f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:24.579986 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1566fd2-564d-43d3-b350-20b81d2fde67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:24.580136 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcf04fd-9dea-47a7-b669-46c896bdc88f admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:24.580629 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1566fd2-564d-43d3-b350-20b81d2fde67 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:24.580907 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1566fd2-564d-43d3-b350-20b81d2fde67 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:24.581232 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1566fd2-564d-43d3-b350-20b81d2fde67 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:24.581901 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1566fd2-564d-43d3-b350-20b81d2fde67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:24.583627 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1566fd2-564d-43d3-b350-20b81d2fde67 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:24.591773 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 797/1595] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:24.593064 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf8210-6c48-4596-a5bd-f1145512680c None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:24.593371 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf8210-6c48-4596-a5bd-f1145512680c None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:24.593645 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf8210-6c48-4596-a5bd-f1145512680c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:24.598428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 799/1596] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:24.599450 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1566fd2-564d-43d3-b350-20b81d2fde67 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:24.613206 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1566fd2-564d-43d3-b350-20b81d2fde67 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:24.621211 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0e573-0700-4514-a4fc-56887ffc2311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:24.622257 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0e573-0700-4514-a4fc-56887ffc2311 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:24.622680 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0e573-0700-4514-a4fc-56887ffc2311 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:24.623065 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0e573-0700-4514-a4fc-56887ffc2311 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:24.624110 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0e573-0700-4514-a4fc-56887ffc2311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:24.625462 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-9fbf8210-6c48-4596-a5bd-f1145512680c None None] MFA Rules not processed for user `7c1211261c204ed982348835ddff7e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:24.626689 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-9fbf8210-6c48-4596-a5bd-f1145512680c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:24.627099 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0e573-0700-4514-a4fc-56887ffc2311 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:24.642649 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 800/1597] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:24.642649 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0e573-0700-4514-a4fc-56887ffc2311 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:24.698168 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0e573-0700-4514-a4fc-56887ffc2311 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:24.699391 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 798/1598] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:24.700405 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf8210-6c48-4596-a5bd-f1145512680c None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:24.707669 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82a17d-60ed-454c-af29-8a347dc78779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:24.708554 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82a17d-60ed-454c-af29-8a347dc78779 service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:24.709123 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82a17d-60ed-454c-af29-8a347dc78779 service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:24.709717 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82a17d-60ed-454c-af29-8a347dc78779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:24.716133 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf8210-6c48-4596-a5bd-f1145512680c None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:24.721770 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89ebfb-dbc6-41e2-a332-c61cb9868ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:24.722875 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89ebfb-dbc6-41e2-a332-c61cb9868ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:24.723263 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89ebfb-dbc6-41e2-a332-c61cb9868ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:24.723525 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89ebfb-dbc6-41e2-a332-c61cb9868ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:24.723645 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82a17d-60ed-454c-af29-8a347dc78779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:24.724723 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89ebfb-dbc6-41e2-a332-c61cb9868ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:24.725255 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82a17d-60ed-454c-af29-8a347dc78779 service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:24.727019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89ebfb-dbc6-41e2-a332-c61cb9868ce7 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:24.736720 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 801/1599] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:49:24.737657 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82a17d-60ed-454c-af29-8a347dc78779 service neutron] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:24.740442 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 799/1600] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:24.742805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89ebfb-dbc6-41e2-a332-c61cb9868ce7 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:24.747878 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82a17d-60ed-454c-af29-8a347dc78779 service neutron] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:24.752820 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ab917-d1c2-41df-b43c-310dac5a66b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:24.753459 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ab917-d1c2-41df-b43c-310dac5a66b7 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:24.753728 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ab917-d1c2-41df-b43c-310dac5a66b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:24.754003 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ab917-d1c2-41df-b43c-310dac5a66b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:24.754646 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ab917-d1c2-41df-b43c-310dac5a66b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:24.754870 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89ebfb-dbc6-41e2-a332-c61cb9868ce7 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:24.756314 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ab917-d1c2-41df-b43c-310dac5a66b7 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:24.760791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d22f99-a042-4e48-a064-89ebd31e94b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:24.761897 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d22f99-a042-4e48-a064-89ebd31e94b3 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:24.761897 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d22f99-a042-4e48-a064-89ebd31e94b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:24.762301 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d22f99-a042-4e48-a064-89ebd31e94b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:24.762966 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d22f99-a042-4e48-a064-89ebd31e94b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:24.764703 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d22f99-a042-4e48-a064-89ebd31e94b3 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:24.768806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 802/1601] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:24.770091 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ab917-d1c2-41df-b43c-310dac5a66b7 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:24.775949 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 800/1602] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:24.776819 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d22f99-a042-4e48-a064-89ebd31e94b3 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:24.784720 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ab917-d1c2-41df-b43c-310dac5a66b7 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:24.786881 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d22f99-a042-4e48-a064-89ebd31e94b3 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:24.789724 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f33da5-5daf-4909-9824-7207714a25aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:24.790402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f33da5-5daf-4909-9824-7207714a25aa admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:24.790711 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f33da5-5daf-4909-9824-7207714a25aa admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:24.790985 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f33da5-5daf-4909-9824-7207714a25aa admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:24.791633 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f33da5-5daf-4909-9824-7207714a25aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:24.791751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fff418-7f1c-4227-ab80-4911a42cd7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:24.792434 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fff418-7f1c-4227-ab80-4911a42cd7d1 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:24.792851 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fff418-7f1c-4227-ab80-4911a42cd7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:24.793143 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fff418-7f1c-4227-ab80-4911a42cd7d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:24.793411 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f33da5-5daf-4909-9824-7207714a25aa admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:24.793919 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fff418-7f1c-4227-ab80-4911a42cd7d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:24.795635 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fff418-7f1c-4227-ab80-4911a42cd7d1 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:24.807663 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 803/1603] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:24.811270 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 801/1604] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:24.811270 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bee24-0f0e-44a4-ade0-5f13c078f3bf None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:24.811270 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bee24-0f0e-44a4-ade0-5f13c078f3bf None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:24.811270 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bee24-0f0e-44a4-ade0-5f13c078f3bf None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:24.811961 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 802/1605] 10.222.0.49 () {54 vars in 962 bytes} [Wed Aug 24 04:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:49:24.812730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053bee24-0f0e-44a4-ade0-5f13c078f3bf None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:24.813119 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f33da5-5daf-4909-9824-7207714a25aa admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:24.824719 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f33da5-5daf-4909-9824-7207714a25aa admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:24.827353 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053bee24-0f0e-44a4-ade0-5f13c078f3bf None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:24.829533 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9272f-8ee9-4c38-945b-d6efa5b70dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:24.830286 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9272f-8ee9-4c38-945b-d6efa5b70dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:24.830629 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9272f-8ee9-4c38-945b-d6efa5b70dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:24.830976 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9272f-8ee9-4c38-945b-d6efa5b70dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:24.831619 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b9272f-8ee9-4c38-945b-d6efa5b70dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:24.832684 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db03e4bb-8517-480f-8da2-cf326693dc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:24.833320 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b9272f-8ee9-4c38-945b-d6efa5b70dd2 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:24.833470 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03e4bb-8517-480f-8da2-cf326693dc4d admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:24.833745 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03e4bb-8517-480f-8da2-cf326693dc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:24.833948 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03e4bb-8517-480f-8da2-cf326693dc4d admin admin] PATH_INFO: `/v3/projects/4d2dd5f1419642c4961b45f67d5fe6c6/users/f06a5a8ce9e44a769e9088bf6afcf73a/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:24.848281 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 804/1606] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:24.848281 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9272f-8ee9-4c38-945b-d6efa5b70dd2 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:24.858914 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9272f-8ee9-4c38-945b-d6efa5b70dd2 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:24.859695 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db03e4bb-8517-480f-8da2-cf326693dc4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d2dd5f1419642c4961b45f67d5fe6c6, user_id=f06a5a8ce9e44a769e9088bf6afcf73a, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:24.862598 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db03e4bb-8517-480f-8da2-cf326693dc4d admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:24.864199 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc494848-5269-4abd-ac53-bf51b7d74eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:24.864984 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc494848-5269-4abd-ac53-bf51b7d74eef admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:24.865325 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc494848-5269-4abd-ac53-bf51b7d74eef admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:24.865472 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:24.865624 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc494848-5269-4abd-ac53-bf51b7d74eef admin admin] PATH_INFO: `/v3/projects/69fcca9c08f945079051cd44a90982d6/users/0bdb7acbe00c4c0fa98e14a668918863/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:24.879859 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 803/1607] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:49:24 2022] PUT /identity/v3/projects/4d2dd5f1419642c4961b45f67d5fe6c6/users/f06a5a8ce9e44a769e9088bf6afcf73a/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:24.881017 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db03e4bb-8517-480f-8da2-cf326693dc4d admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:24.886215 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc494848-5269-4abd-ac53-bf51b7d74eef admin admin] RBAC: Authorizing `identity:create_grant(project_id=69fcca9c08f945079051cd44a90982d6, user_id=0bdb7acbe00c4c0fa98e14a668918863, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:24.889155 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc494848-5269-4abd-ac53-bf51b7d74eef admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:24.905618 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 805/1608] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:49:24 2022] PUT /identity/v3/projects/69fcca9c08f945079051cd44a90982d6/users/0bdb7acbe00c4c0fa98e14a668918863/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:24.917812 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc494848-5269-4abd-ac53-bf51b7d74eef admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:24.930928 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:24.965921 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db03e4bb-8517-480f-8da2-cf326693dc4d admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:25.043739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc494848-5269-4abd-ac53-bf51b7d74eef admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:25.051080 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0886b-32c2-4b1d-833c-3aee023ef949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:25.052199 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0886b-32c2-4b1d-833c-3aee023ef949 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:25.052327 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9e996-67e1-4a39-bdba-a181d7620e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:25.052650 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0886b-32c2-4b1d-833c-3aee023ef949 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:25.053086 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0886b-32c2-4b1d-833c-3aee023ef949 admin admin] PATH_INFO: `/v3/projects/75a380d491184c7994a7200c459a6bf8/users/4a3c89fa96764be79919ce58cccdcfb0/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:25.053527 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9e996-67e1-4a39-bdba-a181d7620e42 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:25.054019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9e996-67e1-4a39-bdba-a181d7620e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:25.054557 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9e996-67e1-4a39-bdba-a181d7620e42 admin admin] PATH_INFO: `/v3/projects/2356089057374d049abd79d06438aa84/users/022a47b9818447a69761bad5dcb940f0/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:25.072893 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0886b-32c2-4b1d-833c-3aee023ef949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75a380d491184c7994a7200c459a6bf8, user_id=4a3c89fa96764be79919ce58cccdcfb0, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:25.076908 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0886b-32c2-4b1d-833c-3aee023ef949 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:25.078206 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9e996-67e1-4a39-bdba-a181d7620e42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2356089057374d049abd79d06438aa84, user_id=022a47b9818447a69761bad5dcb940f0, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:25.082808 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9e996-67e1-4a39-bdba-a181d7620e42 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:25.101413 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 806/1609] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:49:24 2022] PUT /identity/v3/projects/75a380d491184c7994a7200c459a6bf8/users/4a3c89fa96764be79919ce58cccdcfb0/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:25.101413 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0886b-32c2-4b1d-833c-3aee023ef949 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:25.112399 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 804/1610] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:49:24 2022] PUT /identity/v3/projects/2356089057374d049abd79d06438aa84/users/022a47b9818447a69761bad5dcb940f0/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:25.115043 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6860829-79b3-411f-8419-5a07bddab9a5 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:25.115525 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6860829-79b3-411f-8419-5a07bddab9a5 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:25.116014 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6860829-79b3-411f-8419-5a07bddab9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:25.187667 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0886b-32c2-4b1d-833c-3aee023ef949 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:25.198281 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-b6860829-79b3-411f-8419-5a07bddab9a5 None None] MFA Rules not processed for user `9dc9a3cf381e4a2da36ed82b407a2d94`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:25.200000 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-b6860829-79b3-411f-8419-5a07bddab9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:25.275421 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de51b1-f36c-489c-8b0c-8ac7dada3c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:25.276269 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de51b1-f36c-489c-8b0c-8ac7dada3c64 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:25.276560 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de51b1-f36c-489c-8b0c-8ac7dada3c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:25.276821 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de51b1-f36c-489c-8b0c-8ac7dada3c64 admin admin] PATH_INFO: `/v3/projects/8efad2d2c0d34ee9921c32b6b654f482/users/d6811ba6d5fc41c499fdbe5f93dceb0d/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:25.293167 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 805/1611] 10.222.0.49 () {58 vars in 1059 bytes} [Wed Aug 24 04:49:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:25.293391 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de51b1-f36c-489c-8b0c-8ac7dada3c64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8efad2d2c0d34ee9921c32b6b654f482, user_id=d6811ba6d5fc41c499fdbe5f93dceb0d, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:25.296025 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de51b1-f36c-489c-8b0c-8ac7dada3c64 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:25.301183 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6860829-79b3-411f-8419-5a07bddab9a5 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:25.309848 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:25.317435 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 807/1612] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:49:25 2022] PUT /identity/v3/projects/8efad2d2c0d34ee9921c32b6b654f482/users/d6811ba6d5fc41c499fdbe5f93dceb0d/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:25.318327 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6860829-79b3-411f-8419-5a07bddab9a5 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:25.319033 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac65977-d1aa-48b6-bca7-a1da859c4444 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:25.319321 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac65977-d1aa-48b6-bca7-a1da859c4444 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:25.319605 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac65977-d1aa-48b6-bca7-a1da859c4444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:25.350132 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-5ac65977-d1aa-48b6-bca7-a1da859c4444 None None] MFA Rules not processed for user `f06a5a8ce9e44a769e9088bf6afcf73a`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:25.351452 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-5ac65977-d1aa-48b6-bca7-a1da859c4444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:25.361619 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:25.383316 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f1e9f8-689b-47bf-974a-8992f74e41ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:25.384014 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1e9f8-689b-47bf-974a-8992f74e41ad admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:25.384298 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1e9f8-689b-47bf-974a-8992f74e41ad admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:25.384606 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1e9f8-689b-47bf-974a-8992f74e41ad admin admin] PATH_INFO: `/v3/projects/07419bc87e5148899a0ef56c66f7c46e/users/12af555605384136af2082486782b584/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:25.400696 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f1e9f8-689b-47bf-974a-8992f74e41ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=07419bc87e5148899a0ef56c66f7c46e, user_id=12af555605384136af2082486782b584, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:25.403449 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f1e9f8-689b-47bf-974a-8992f74e41ad admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:25.422871 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 806/1613] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:49:25 2022] PUT /identity/v3/projects/07419bc87e5148899a0ef56c66f7c46e/users/12af555605384136af2082486782b584/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:25.422871 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d6ebb-b5dd-4f8c-9118-2fbfb0567697 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:25.422871 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d6ebb-b5dd-4f8c-9118-2fbfb0567697 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:25.422871 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d6ebb-b5dd-4f8c-9118-2fbfb0567697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:25.431549 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 808/1614] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:25.431549 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59082f-353b-4c77-bf10-b7ce1413b140 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:25.431549 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59082f-353b-4c77-bf10-b7ce1413b140 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:25.431549 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59082f-353b-4c77-bf10-b7ce1413b140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:25.450974 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-3b59082f-353b-4c77-bf10-b7ce1413b140 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:25.451969 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-3b59082f-353b-4c77-bf10-b7ce1413b140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:25.457589 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-811d6ebb-b5dd-4f8c-9118-2fbfb0567697 None None] MFA Rules not processed for user `0bdb7acbe00c4c0fa98e14a668918863`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:25.458490 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-811d6ebb-b5dd-4f8c-9118-2fbfb0567697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:25.535581 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 809/1615] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:25.536876 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59082f-353b-4c77-bf10-b7ce1413b140 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:25.539630 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 807/1616] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:25.540681 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d6ebb-b5dd-4f8c-9118-2fbfb0567697 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:25.552315 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59082f-353b-4c77-bf10-b7ce1413b140 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:25.558246 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1315b-63cf-47aa-b7a6-4fdc206a9aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:25.558865 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1315b-63cf-47aa-b7a6-4fdc206a9aed admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:25.559447 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1315b-63cf-47aa-b7a6-4fdc206a9aed admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:25.559726 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1315b-63cf-47aa-b7a6-4fdc206a9aed admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:25.560408 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd1315b-63cf-47aa-b7a6-4fdc206a9aed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:25.562176 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd1315b-63cf-47aa-b7a6-4fdc206a9aed admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:25.574674 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 810/1617] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:25.576705 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be42c9f-2de0-4213-acef-86e9b853fdeb None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:25.577150 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be42c9f-2de0-4213-acef-86e9b853fdeb None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:25.577524 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be42c9f-2de0-4213-acef-86e9b853fdeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:25.604104 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-2be42c9f-2de0-4213-acef-86e9b853fdeb None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:25.605439 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-2be42c9f-2de0-4213-acef-86e9b853fdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:25.617430 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 811/1618] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:25.618863 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b7f6d-aa69-4bf4-aafb-011baba1a3fd None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:25.619152 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b7f6d-aa69-4bf4-aafb-011baba1a3fd None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:25.619742 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b7f6d-aa69-4bf4-aafb-011baba1a3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:25.635650 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d6ebb-b5dd-4f8c-9118-2fbfb0567697 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:25.642559 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c9122-4d13-4aa2-8496-233fc0ae8f04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:25.643354 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-b44b7f6d-aa69-4bf4-aafb-011baba1a3fd None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:25.643693 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c9122-4d13-4aa2-8496-233fc0ae8f04 service nova] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:25.644161 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c9122-4d13-4aa2-8496-233fc0ae8f04 service nova] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:25.644611 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7c9122-4d13-4aa2-8496-233fc0ae8f04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:25.644721 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-b44b7f6d-aa69-4bf4-aafb-011baba1a3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:25.659841 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 812/1619] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:25.659841 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b7f6d-aa69-4bf4-aafb-011baba1a3fd None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:25.660015 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:25.684836 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b7f6d-aa69-4bf4-aafb-011baba1a3fd None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:25.696238 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a027dd-b492-4279-b581-577d1cef8ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:25.700051 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a027dd-b492-4279-b581-577d1cef8ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:25.700344 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a027dd-b492-4279-b581-577d1cef8ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:25.700621 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a027dd-b492-4279-b581-577d1cef8ca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:25.701741 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a027dd-b492-4279-b581-577d1cef8ca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:25.705100 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a027dd-b492-4279-b581-577d1cef8ca4 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:25.738304 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c9122-4d13-4aa2-8496-233fc0ae8f04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:25.740329 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7c9122-4d13-4aa2-8496-233fc0ae8f04 service nova] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:25.747732 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 813/1620] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:49:25 2022] POST /identity/v3/projects => generated 369 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:25.747732 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a027dd-b492-4279-b581-577d1cef8ca4 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:25.754819 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 808/1621] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:49:25.756091 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c9122-4d13-4aa2-8496-233fc0ae8f04 service nova] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:25.819859 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7c9122-4d13-4aa2-8496-233fc0ae8f04 service nova] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:25.831157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a027dd-b492-4279-b581-577d1cef8ca4 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:25.837009 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e2d6e-2e92-4dd2-8e80-4e37ab0e1d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:25.837676 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e2d6e-2e92-4dd2-8e80-4e37ab0e1d27 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:25.837951 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e2d6e-2e92-4dd2-8e80-4e37ab0e1d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:25.838216 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e2d6e-2e92-4dd2-8e80-4e37ab0e1d27 admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:25.838841 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e2d6e-2e92-4dd2-8e80-4e37ab0e1d27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:25.840840 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e2d6e-2e92-4dd2-8e80-4e37ab0e1d27 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:25.856176 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:25.882348 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 814/1622] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:49:25 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:25.883397 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e2d6e-2e92-4dd2-8e80-4e37ab0e1d27 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:25.912833 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e14c62-b6e3-491d-82db-a77f1d0a2469 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:25.914547 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e14c62-b6e3-491d-82db-a77f1d0a2469 service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:25.915155 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e14c62-b6e3-491d-82db-a77f1d0a2469 service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:25.915638 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e14c62-b6e3-491d-82db-a77f1d0a2469 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:25.929215 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e14c62-b6e3-491d-82db-a77f1d0a2469 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:25.932847 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e14c62-b6e3-491d-82db-a77f1d0a2469 service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:25.952755 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 809/1623] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:49:25.953999 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e14c62-b6e3-491d-82db-a77f1d0a2469 service neutron] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:25.956465 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-f6e14c62-b6e3-491d-82db-a77f1d0a2469 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:25.972635 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e14c62-b6e3-491d-82db-a77f1d0a2469 service neutron] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:25.974933 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e2d6e-2e92-4dd2-8e80-4e37ab0e1d27 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:25.981528 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260eab48-be94-4657-8ad8-4024e49b7988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:25.982656 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260eab48-be94-4657-8ad8-4024e49b7988 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:25.983136 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260eab48-be94-4657-8ad8-4024e49b7988 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:25.983682 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260eab48-be94-4657-8ad8-4024e49b7988 admin admin] PATH_INFO: `/v3/projects/2356089057374d049abd79d06438aa84/users/022a47b9818447a69761bad5dcb940f0/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:25.985991 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260eab48-be94-4657-8ad8-4024e49b7988 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2356089057374d049abd79d06438aa84, user_id=022a47b9818447a69761bad5dcb940f0, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:25.989717 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260eab48-be94-4657-8ad8-4024e49b7988 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:26.005445 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 815/1624] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:49:25 2022] PUT /identity/v3/projects/2356089057374d049abd79d06438aa84/users/022a47b9818447a69761bad5dcb940f0/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:26.007153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260eab48-be94-4657-8ad8-4024e49b7988 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:26.040132 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840a8fc-0ad3-4199-ac8c-feb9ce76ad29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:26.040843 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840a8fc-0ad3-4199-ac8c-feb9ce76ad29 service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:26.041191 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840a8fc-0ad3-4199-ac8c-feb9ce76ad29 service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:26.041556 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840a8fc-0ad3-4199-ac8c-feb9ce76ad29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:26.054623 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840a8fc-0ad3-4199-ac8c-feb9ce76ad29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:26.056751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840a8fc-0ad3-4199-ac8c-feb9ce76ad29 service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:26.073652 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 810/1625] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:49:26.075454 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840a8fc-0ad3-4199-ac8c-feb9ce76ad29 service neutron] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:26.088091 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840a8fc-0ad3-4199-ac8c-feb9ce76ad29 service neutron] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:26.096091 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260eab48-be94-4657-8ad8-4024e49b7988 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:26.099712 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:26.103046 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b39455-0222-4717-96c9-13664f4aeb5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:26.103851 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b39455-0222-4717-96c9-13664f4aeb5e service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:26.104140 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b39455-0222-4717-96c9-13664f4aeb5e service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:26.105305 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b39455-0222-4717-96c9-13664f4aeb5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:26.168958 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2beb9c-dbf2-4d57-b4e0-741d39d0e51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:26.170397 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2beb9c-dbf2-4d57-b4e0-741d39d0e51f admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:26.170675 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2beb9c-dbf2-4d57-b4e0-741d39d0e51f admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:26.170943 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2beb9c-dbf2-4d57-b4e0-741d39d0e51f admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:26.171585 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2beb9c-dbf2-4d57-b4e0-741d39d0e51f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:26.173715 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2beb9c-dbf2-4d57-b4e0-741d39d0e51f admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:26.212145 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b39455-0222-4717-96c9-13664f4aeb5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:26.212384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b39455-0222-4717-96c9-13664f4aeb5e service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:26.213001 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 811/1626] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:49:26 2022] POST /identity/v3/users => generated 291 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:26.214307 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2beb9c-dbf2-4d57-b4e0-741d39d0e51f admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:26.234673 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2beb9c-dbf2-4d57-b4e0-741d39d0e51f admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:26.236493 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 816/1627] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:49:26.238320 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea742294-2ed5-413f-b8f5-40c2c8cca937 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:26.238602 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea742294-2ed5-413f-b8f5-40c2c8cca937 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:26.238876 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea742294-2ed5-413f-b8f5-40c2c8cca937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:26.244619 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d866d-d7d4-487b-b2a5-e99e6798885c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:26.245761 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d866d-d7d4-487b-b2a5-e99e6798885c admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:26.246368 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d866d-d7d4-487b-b2a5-e99e6798885c admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:26.246924 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d866d-d7d4-487b-b2a5-e99e6798885c admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:26.248255 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d866d-d7d4-487b-b2a5-e99e6798885c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:26.251050 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d866d-d7d4-487b-b2a5-e99e6798885c admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:26.280164 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-ea742294-2ed5-413f-b8f5-40c2c8cca937 None None] MFA Rules not processed for user `022a47b9818447a69761bad5dcb940f0`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:26.283565 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-ea742294-2ed5-413f-b8f5-40c2c8cca937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:26.289832 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 812/1628] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:49:26 2022] POST /identity/v3/users => generated 293 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:26.291971 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675ccdc-1765-4fc1-83b6-fd4cccfa38eb None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:26.295056 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675ccdc-1765-4fc1-83b6-fd4cccfa38eb None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:26.295348 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675ccdc-1765-4fc1-83b6-fd4cccfa38eb None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:26.296783 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 813/1629] 10.222.0.49 () {54 vars in 912 bytes} [Wed Aug 24 04:49:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:49:26.298768 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675ccdc-1765-4fc1-83b6-fd4cccfa38eb None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:26.324655 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675ccdc-1765-4fc1-83b6-fd4cccfa38eb None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:26.336002 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764c0a5-63d5-4c60-906d-68b11d332730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:26.336663 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764c0a5-63d5-4c60-906d-68b11d332730 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:26.336985 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764c0a5-63d5-4c60-906d-68b11d332730 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:26.337648 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764c0a5-63d5-4c60-906d-68b11d332730 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:26.337935 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:26.338493 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c764c0a5-63d5-4c60-906d-68b11d332730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:26.344263 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c764c0a5-63d5-4c60-906d-68b11d332730 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:26.364613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 814/1630] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:26.366243 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764c0a5-63d5-4c60-906d-68b11d332730 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:26.380052 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764c0a5-63d5-4c60-906d-68b11d332730 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:26.386979 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b349750-e4c4-4fb8-a278-8d8eb9e3490e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:26.387881 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b349750-e4c4-4fb8-a278-8d8eb9e3490e admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:26.388406 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b349750-e4c4-4fb8-a278-8d8eb9e3490e admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:26.388859 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b349750-e4c4-4fb8-a278-8d8eb9e3490e admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:26.390262 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b349750-e4c4-4fb8-a278-8d8eb9e3490e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:26.392057 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b349750-e4c4-4fb8-a278-8d8eb9e3490e admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:26.407186 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 817/1631] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:26 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:26.407186 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a21ee-08e8-42f4-9e82-0f81697eb43e None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:26.407186 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a21ee-08e8-42f4-9e82-0f81697eb43e None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:26.407186 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a21ee-08e8-42f4-9e82-0f81697eb43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:26.410537 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 815/1632] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:26.411458 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b349750-e4c4-4fb8-a278-8d8eb9e3490e admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:26.433081 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-793a21ee-08e8-42f4-9e82-0f81697eb43e None None] MFA Rules not processed for user `9dc9a3cf381e4a2da36ed82b407a2d94`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:26.435160 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b349750-e4c4-4fb8-a278-8d8eb9e3490e admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:26.437027 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-793a21ee-08e8-42f4-9e82-0f81697eb43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:26.446165 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d6902-e04d-4b4f-9206-f5461b934600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:26.446851 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d6902-e04d-4b4f-9206-f5461b934600 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:26.447122 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d6902-e04d-4b4f-9206-f5461b934600 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:26.447395 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d6902-e04d-4b4f-9206-f5461b934600 admin admin] PATH_INFO: `/v3/projects/51fd74f8ea9340a1b05c66f9f18d78ca/users/16b75cead2c948e596962eb9b377ed18/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:26.474104 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d6902-e04d-4b4f-9206-f5461b934600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51fd74f8ea9340a1b05c66f9f18d78ca, user_id=16b75cead2c948e596962eb9b377ed18, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:26.476994 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d6902-e04d-4b4f-9206-f5461b934600 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:26.534176 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 816/1633] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:49:26 2022] PUT /identity/v3/projects/51fd74f8ea9340a1b05c66f9f18d78ca/users/16b75cead2c948e596962eb9b377ed18/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:26.539387 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d6902-e04d-4b4f-9206-f5461b934600 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:26.554181 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 818/1634] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 24 04:49:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:26.555570 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a21ee-08e8-42f4-9e82-0f81697eb43e None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:26.700945 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a21ee-08e8-42f4-9e82-0f81697eb43e None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:26.719886 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d6902-e04d-4b4f-9206-f5461b934600 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:26.727047 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf807b-7f77-41a9-8032-5fb6d6ea02ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:26.727998 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf807b-7f77-41a9-8032-5fb6d6ea02ea admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:26.728586 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf807b-7f77-41a9-8032-5fb6d6ea02ea admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:26.728908 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf807b-7f77-41a9-8032-5fb6d6ea02ea admin admin] PATH_INFO: `/v3/projects/075d37cda17242dfbf47128fa3edf2b7/users/9d09c031e086416f986b9ecda61baf36/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:26.759903 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf807b-7f77-41a9-8032-5fb6d6ea02ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=075d37cda17242dfbf47128fa3edf2b7, user_id=9d09c031e086416f986b9ecda61baf36, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:26.764016 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf807b-7f77-41a9-8032-5fb6d6ea02ea admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:26.793959 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be11e8-e0e4-4b99-ac24-1e3857ab3e96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:26.794803 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be11e8-e0e4-4b99-ac24-1e3857ab3e96 service cinder] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:26.795804 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be11e8-e0e4-4b99-ac24-1e3857ab3e96 service cinder] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:26.795956 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 817/1635] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:49:26 2022] PUT /identity/v3/projects/075d37cda17242dfbf47128fa3edf2b7/users/9d09c031e086416f986b9ecda61baf36/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:26.796286 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be11e8-e0e4-4b99-ac24-1e3857ab3e96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:26.796843 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf807b-7f77-41a9-8032-5fb6d6ea02ea admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:26.843125 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:26.849589 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:26.908205 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf807b-7f77-41a9-8032-5fb6d6ea02ea admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:26.914727 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2d38b-9ca8-483a-bfe1-19d077a9ea8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:26.915644 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2d38b-9ca8-483a-bfe1-19d077a9ea8d admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:26.915985 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2d38b-9ca8-483a-bfe1-19d077a9ea8d admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:26.916348 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2d38b-9ca8-483a-bfe1-19d077a9ea8d admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:26.917551 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2d38b-9ca8-483a-bfe1-19d077a9ea8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:26.919039 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2d38b-9ca8-483a-bfe1-19d077a9ea8d admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:26.936135 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 818/1636] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:26.937119 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2d38b-9ca8-483a-bfe1-19d077a9ea8d admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:26.970900 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be11e8-e0e4-4b99-ac24-1e3857ab3e96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:26.977436 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be11e8-e0e4-4b99-ac24-1e3857ab3e96 service cinder] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:26.999669 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 819/1637] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:26 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:49:27.002875 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be11e8-e0e4-4b99-ac24-1e3857ab3e96 service cinder] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:27.025107 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be11e8-e0e4-4b99-ac24-1e3857ab3e96 service cinder] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:27.039451 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ac3d5-9d53-46ad-a2f1-02c970244500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:27.040980 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ac3d5-9d53-46ad-a2f1-02c970244500 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:27.046207 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ac3d5-9d53-46ad-a2f1-02c970244500 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:27.047520 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ac3d5-9d53-46ad-a2f1-02c970244500 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:27.048377 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ac3d5-9d53-46ad-a2f1-02c970244500 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:27.051401 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ac3d5-9d53-46ad-a2f1-02c970244500 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:27.059695 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2d38b-9ca8-483a-bfe1-19d077a9ea8d admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:27.069197 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2d98c-9531-46db-bd66-c92c0cb344cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:27.070470 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2d98c-9531-46db-bd66-c92c0cb344cf service cinder] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:27.074431 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2d98c-9531-46db-bd66-c92c0cb344cf service cinder] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:27.074431 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2d98c-9531-46db-bd66-c92c0cb344cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:27.089435 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 820/1638] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:27.089435 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ac3d5-9d53-46ad-a2f1-02c970244500 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:27.107985 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ac3d5-9d53-46ad-a2f1-02c970244500 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:27.122638 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4663ace-e7c0-4285-9f8c-75546b2d741d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:27.123437 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4663ace-e7c0-4285-9f8c-75546b2d741d admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:27.124702 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4663ace-e7c0-4285-9f8c-75546b2d741d admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:27.125085 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4663ace-e7c0-4285-9f8c-75546b2d741d admin admin] PATH_INFO: `/v3/projects/51fd74f8ea9340a1b05c66f9f18d78ca/users/16b75cead2c948e596962eb9b377ed18/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:27.136802 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4663ace-e7c0-4285-9f8c-75546b2d741d admin admin] RBAC: Authorizing `identity:create_grant(project_id=51fd74f8ea9340a1b05c66f9f18d78ca, user_id=16b75cead2c948e596962eb9b377ed18, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:27.139709 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4663ace-e7c0-4285-9f8c-75546b2d741d admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:27.172228 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 821/1639] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:49:27 2022] PUT /identity/v3/projects/51fd74f8ea9340a1b05c66f9f18d78ca/users/16b75cead2c948e596962eb9b377ed18/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:27.183445 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4663ace-e7c0-4285-9f8c-75546b2d741d admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:27.241644 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2d98c-9531-46db-bd66-c92c0cb344cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:27.244136 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2d98c-9531-46db-bd66-c92c0cb344cf service cinder] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:27.263209 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 819/1640] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:49:27.267198 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7aa02-640e-44c5-9d06-93add713cf1f None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:27.267486 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7aa02-640e-44c5-9d06-93add713cf1f None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:27.272038 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7aa02-640e-44c5-9d06-93add713cf1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:27.310787 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4663ace-e7c0-4285-9f8c-75546b2d741d admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:27.316324 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0491d-c11e-482f-be99-98f75bcb6e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:27.317662 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0491d-c11e-482f-be99-98f75bcb6e12 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:27.317948 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0491d-c11e-482f-be99-98f75bcb6e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:27.318225 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0491d-c11e-482f-be99-98f75bcb6e12 admin admin] PATH_INFO: `/v3/projects/075d37cda17242dfbf47128fa3edf2b7/users/9d09c031e086416f986b9ecda61baf36/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:27.321783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0491d-c11e-482f-be99-98f75bcb6e12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=075d37cda17242dfbf47128fa3edf2b7, user_id=9d09c031e086416f986b9ecda61baf36, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:27.325481 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0491d-c11e-482f-be99-98f75bcb6e12 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:27.339225 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 822/1641] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:49:27 2022] PUT /identity/v3/projects/075d37cda17242dfbf47128fa3edf2b7/users/9d09c031e086416f986b9ecda61baf36/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:27.340408 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0491d-c11e-482f-be99-98f75bcb6e12 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:27.342343 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-7ca7aa02-640e-44c5-9d06-93add713cf1f None None] MFA Rules not processed for user `16b75cead2c948e596962eb9b377ed18`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:27.343566 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-7ca7aa02-640e-44c5-9d06-93add713cf1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:27.444100 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:27.471897 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0491d-c11e-482f-be99-98f75bcb6e12 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:27.478996 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85536479-1a0d-4493-9f13-ce44cb0717ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:27.479671 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85536479-1a0d-4493-9f13-ce44cb0717ac service cinder] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:27.480037 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85536479-1a0d-4493-9f13-ce44cb0717ac service cinder] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:27.480390 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85536479-1a0d-4493-9f13-ce44cb0717ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:27.496224 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 820/1642] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:27.498154 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c774373-215d-4314-81a2-45dfd0200d38 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:27.498634 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c774373-215d-4314-81a2-45dfd0200d38 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:27.499076 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c774373-215d-4314-81a2-45dfd0200d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:27.555902 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:27.560186 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-1c774373-215d-4314-81a2-45dfd0200d38 None None] MFA Rules not processed for user `9d09c031e086416f986b9ecda61baf36`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:27.563689 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-1c774373-215d-4314-81a2-45dfd0200d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:27.577752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85536479-1a0d-4493-9f13-ce44cb0717ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:27.579674 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85536479-1a0d-4493-9f13-ce44cb0717ac service cinder] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:27.591373 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 823/1643] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:49:27.707071 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 821/1644] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:28.047172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85536479-1a0d-4493-9f13-ce44cb0717ac service cinder] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:28.062444 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85536479-1a0d-4493-9f13-ce44cb0717ac service cinder] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:28.111795 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576e9f3-1542-4fa3-88cd-633ca13bcf2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:28.118958 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576e9f3-1542-4fa3-88cd-633ca13bcf2e service cinder] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:28.120283 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576e9f3-1542-4fa3-88cd-633ca13bcf2e service cinder] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:28.121134 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576e9f3-1542-4fa3-88cd-633ca13bcf2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:28.150649 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576e9f3-1542-4fa3-88cd-633ca13bcf2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:28.156428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576e9f3-1542-4fa3-88cd-633ca13bcf2e service cinder] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:28.208073 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 824/1645] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:49:28.320496 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c774373-215d-4314-81a2-45dfd0200d38 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:28.337781 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c774373-215d-4314-81a2-45dfd0200d38 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:28.348632 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0f211-54e5-4d38-bc22-be1a4389a548 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:28.349267 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0f211-54e5-4d38-bc22-be1a4389a548 service cinder] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:28.349556 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0f211-54e5-4d38-bc22-be1a4389a548 service cinder] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:28.349828 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0f211-54e5-4d38-bc22-be1a4389a548 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:28.369080 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac0f211-54e5-4d38-bc22-be1a4389a548 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:28.372757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac0f211-54e5-4d38-bc22-be1a4389a548 service cinder] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:28.408208 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 822/1646] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:28 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:49:28.820580 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576e9f3-1542-4fa3-88cd-633ca13bcf2e service cinder] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:28.841647 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576e9f3-1542-4fa3-88cd-633ca13bcf2e service cinder] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:28.853154 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8f881-9e26-4d71-beb8-45de37fcafd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:28.856567 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8f881-9e26-4d71-beb8-45de37fcafd1 service cinder] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:28.856861 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8f881-9e26-4d71-beb8-45de37fcafd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:28.859216 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8f881-9e26-4d71-beb8-45de37fcafd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:28.905717 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827d2ce-6225-4e83-80d0-db79c838c270 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:28.906231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827d2ce-6225-4e83-80d0-db79c838c270 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:28.906666 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f827d2ce-6225-4e83-80d0-db79c838c270 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:28.908571 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 823/1647] 10.222.0.49 () {54 vars in 962 bytes} [Wed Aug 24 04:49:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:49:28.917504 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2290fd8-fb39-4882-b4fb-3a7fcdc643f0 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:28.918094 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2290fd8-fb39-4882-b4fb-3a7fcdc643f0 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:28.919185 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2290fd8-fb39-4882-b4fb-3a7fcdc643f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:28.948406 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-c2290fd8-fb39-4882-b4fb-3a7fcdc643f0 None None] MFA Rules not processed for user `9dc9a3cf381e4a2da36ed82b407a2d94`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:28.950209 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-c2290fd8-fb39-4882-b4fb-3a7fcdc643f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:29.057923 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 824/1648] 10.222.0.49 () {58 vars in 1059 bytes} [Wed Aug 24 04:49:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:49:29.059859 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b8cf3-dc03-4f9a-bd62-7a4f4bc52064 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:29.061931 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b8cf3-dc03-4f9a-bd62-7a4f4bc52064 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:29.062465 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b8cf3-dc03-4f9a-bd62-7a4f4bc52064 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:29.070409 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 825/1649] 10.222.0.49 () {54 vars in 912 bytes} [Wed Aug 24 04:49:29 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:49:29.072350 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505a222-5cc6-422d-99a7-14d33b988a3e None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:29.073513 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505a222-5cc6-422d-99a7-14d33b988a3e None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:29.074627 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505a222-5cc6-422d-99a7-14d33b988a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:29.090063 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8f881-9e26-4d71-beb8-45de37fcafd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:29.096077 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8f881-9e26-4d71-beb8-45de37fcafd1 service cinder] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:29.153045 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 825/1650] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:49:29.163740 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-1505a222-5cc6-422d-99a7-14d33b988a3e None None] MFA Rules not processed for user `9dc9a3cf381e4a2da36ed82b407a2d94`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:29.165436 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-1505a222-5cc6-422d-99a7-14d33b988a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:29.207465 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 826/1651] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 24 04:49:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:29.300999 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e398f-2a58-42aa-a3e4-67886a211a3c None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:29.301292 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e398f-2a58-42aa-a3e4-67886a211a3c None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:29.301800 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e398f-2a58-42aa-a3e4-67886a211a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:29.367198 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-493e398f-2a58-42aa-a3e4-67886a211a3c None None] MFA Rules not processed for user `4a3c89fa96764be79919ce58cccdcfb0`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:29.368446 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-493e398f-2a58-42aa-a3e4-67886a211a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:29.444708 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505a222-5cc6-422d-99a7-14d33b988a3e None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:29.461930 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505a222-5cc6-422d-99a7-14d33b988a3e None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:29.473010 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb7c30-3d31-47bb-8fb9-097580461640 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:29.474291 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb7c30-3d31-47bb-8fb9-097580461640 service cinder] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:29.474291 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb7c30-3d31-47bb-8fb9-097580461640 service cinder] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:29.474291 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb7c30-3d31-47bb-8fb9-097580461640 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:29.518005 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb7c30-3d31-47bb-8fb9-097580461640 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:29.521854 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb7c30-3d31-47bb-8fb9-097580461640 service cinder] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:29.556978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 827/1652] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:49:29.570915 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 826/1653] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:29 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:29.575245 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb7c30-3d31-47bb-8fb9-097580461640 service cinder] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:29.621996 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:29.664203 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb7c30-3d31-47bb-8fb9-097580461640 service cinder] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:29.675666 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a0bbd-57e6-4b89-901a-fe3a7ad1c622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:29.676701 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a0bbd-57e6-4b89-901a-fe3a7ad1c622 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:29.677249 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a0bbd-57e6-4b89-901a-fe3a7ad1c622 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:29.677831 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a0bbd-57e6-4b89-901a-fe3a7ad1c622 admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:29.678910 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a0bbd-57e6-4b89-901a-fe3a7ad1c622 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:29.681613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a0bbd-57e6-4b89-901a-fe3a7ad1c622 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:29.723973 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 828/1654] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:49:29 2022] POST /identity/v3/projects => generated 403 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:49:29.727064 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e398f-2a58-42aa-a3e4-67886a211a3c None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:29.746087 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e398f-2a58-42aa-a3e4-67886a211a3c None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:29.926726 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:29.947340 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0f9b7-5523-4e18-9354-d36626bf4987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:29.947985 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0f9b7-5523-4e18-9354-d36626bf4987 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:29.948661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0f9b7-5523-4e18-9354-d36626bf4987 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:29.949043 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0f9b7-5523-4e18-9354-d36626bf4987 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:29.951443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0f9b7-5523-4e18-9354-d36626bf4987 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:29.959086 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0f9b7-5523-4e18-9354-d36626bf4987 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:30.036827 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 827/1655] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:49:29 2022] POST /identity/v3/users => generated 308 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:30.040720 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a0bbd-57e6-4b89-901a-fe3a7ad1c622 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:30.054051 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a0bbd-57e6-4b89-901a-fe3a7ad1c622 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:30.061814 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58764a4-8877-41f7-a987-e325bd3a53a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:30.063000 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58764a4-8877-41f7-a987-e325bd3a53a3 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:30.063943 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58764a4-8877-41f7-a987-e325bd3a53a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:30.064544 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58764a4-8877-41f7-a987-e325bd3a53a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:30.066472 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58764a4-8877-41f7-a987-e325bd3a53a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:30.104547 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58764a4-8877-41f7-a987-e325bd3a53a3 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:30.119532 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 829/1656] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:30.121365 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0f9b7-5523-4e18-9354-d36626bf4987 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:30.134091 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0f9b7-5523-4e18-9354-d36626bf4987 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:30.140032 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa07de6-0f81-4dda-a756-96a5c4ff2960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:30.140957 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa07de6-0f81-4dda-a756-96a5c4ff2960 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:30.141448 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa07de6-0f81-4dda-a756-96a5c4ff2960 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:30.141851 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa07de6-0f81-4dda-a756-96a5c4ff2960 admin admin] PATH_INFO: `/v3/projects/4984ad57a16c41e7a96bbb64bde0a3b5/users/5f831a03bfb849788fad6a7dea42d595/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:30.179246 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa07de6-0f81-4dda-a756-96a5c4ff2960 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4984ad57a16c41e7a96bbb64bde0a3b5, user_id=5f831a03bfb849788fad6a7dea42d595, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:30.182462 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa07de6-0f81-4dda-a756-96a5c4ff2960 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:30.212982 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 828/1657] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:49:30 2022] PUT /identity/v3/projects/4984ad57a16c41e7a96bbb64bde0a3b5/users/5f831a03bfb849788fad6a7dea42d595/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:30.217698 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58764a4-8877-41f7-a987-e325bd3a53a3 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:30.239802 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58764a4-8877-41f7-a987-e325bd3a53a3 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:30.416915 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48e64c-874e-41d8-b1c4-2292f5f36277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:30.417817 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48e64c-874e-41d8-b1c4-2292f5f36277 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:30.418111 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48e64c-874e-41d8-b1c4-2292f5f36277 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:30.418516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48e64c-874e-41d8-b1c4-2292f5f36277 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:30.419217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48e64c-874e-41d8-b1c4-2292f5f36277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:30.421072 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48e64c-874e-41d8-b1c4-2292f5f36277 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:30.455560 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 830/1658] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:30.459316 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa07de6-0f81-4dda-a756-96a5c4ff2960 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:30.476698 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa07de6-0f81-4dda-a756-96a5c4ff2960 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:30.489619 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47866b5-1fd5-4204-9816-b424e2c8020b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:30.494595 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47866b5-1fd5-4204-9816-b424e2c8020b admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:30.496798 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47866b5-1fd5-4204-9816-b424e2c8020b admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:30.497242 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47866b5-1fd5-4204-9816-b424e2c8020b admin admin] PATH_INFO: `/v3/projects/4984ad57a16c41e7a96bbb64bde0a3b5/users/5f831a03bfb849788fad6a7dea42d595/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:30.513484 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47866b5-1fd5-4204-9816-b424e2c8020b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4984ad57a16c41e7a96bbb64bde0a3b5, user_id=5f831a03bfb849788fad6a7dea42d595, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:30.516368 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47866b5-1fd5-4204-9816-b424e2c8020b admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:30.550558 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 829/1659] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:49:30 2022] PUT /identity/v3/projects/4984ad57a16c41e7a96bbb64bde0a3b5/users/5f831a03bfb849788fad6a7dea42d595/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:31.720089 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48e64c-874e-41d8-b1c4-2292f5f36277 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:31.735016 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48e64c-874e-41d8-b1c4-2292f5f36277 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:31.899557 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456fbbd-ce5b-4d5f-8c48-ef49d724a918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:31.900273 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456fbbd-ce5b-4d5f-8c48-ef49d724a918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:31.900552 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456fbbd-ce5b-4d5f-8c48-ef49d724a918 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:31.900830 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456fbbd-ce5b-4d5f-8c48-ef49d724a918 admin admin] PATH_INFO: `/v3/users/7c1211261c204ed982348835ddff7e1f` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:31.902453 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456fbbd-ce5b-4d5f-8c48-ef49d724a918 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c1211261c204ed982348835ddff7e1f)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:31.903534 dv-cinder-854265-1-smb devstack@keystone.service[93148]: WARNING py.warnings [None req-e456fbbd-ce5b-4d5f-8c48-ef49d724a918 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:49:31.903534 dv-cinder-854265-1-smb devstack@keystone.service[93148]: warnings.warn(msg) Aug 24 04:49:31.903534 dv-cinder-854265-1-smb devstack@keystone.service[93148]: Aug 24 04:49:31.908538 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456fbbd-ce5b-4d5f-8c48-ef49d724a918 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:32.067208 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:32.100999 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-e456fbbd-ce5b-4d5f-8c48-ef49d724a918 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c1211261c204ed982348835ddff7e1f'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:32.102093 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-e456fbbd-ce5b-4d5f-8c48-ef49d724a918 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c1211261c204ed982348835ddff7e1f'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:32.102896 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-e456fbbd-ce5b-4d5f-8c48-ef49d724a918 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c1211261c204ed982348835ddff7e1f'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:32.173256 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-e456fbbd-ce5b-4d5f-8c48-ef49d724a918 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c1211261c204ed982348835ddff7e1f'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:32.203000 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-e456fbbd-ce5b-4d5f-8c48-ef49d724a918 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c1211261c204ed982348835ddff7e1f'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:32.295393 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 831/1660] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:49:31 2022] DELETE /identity/v3/users/7c1211261c204ed982348835ddff7e1f => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:32.298210 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69165485-f1d1-410f-9c03-1d2bffe16798 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:32.298667 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69165485-f1d1-410f-9c03-1d2bffe16798 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:32.299097 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69165485-f1d1-410f-9c03-1d2bffe16798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:32.368032 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-69165485-f1d1-410f-9c03-1d2bffe16798 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:32.369363 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-69165485-f1d1-410f-9c03-1d2bffe16798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:32.613895 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 830/1661] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:32.687265 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456fbbd-ce5b-4d5f-8c48-ef49d724a918 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:32.689124 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-e456fbbd-ce5b-4d5f-8c48-ef49d724a918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:32.834305 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456fbbd-ce5b-4d5f-8c48-ef49d724a918 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:32.839112 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db1892-0239-46b2-bb2e-f6fc7ffb4dd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:32.840161 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db1892-0239-46b2-bb2e-f6fc7ffb4dd8 service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:32.840583 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db1892-0239-46b2-bb2e-f6fc7ffb4dd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:32.840994 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db1892-0239-46b2-bb2e-f6fc7ffb4dd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:32.852419 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db1892-0239-46b2-bb2e-f6fc7ffb4dd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:32.854135 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db1892-0239-46b2-bb2e-f6fc7ffb4dd8 service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:32.867315 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 832/1662] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:49:33.752386 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9685a-4ef2-460f-b127-227d60179ead None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:33.753790 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9685a-4ef2-460f-b127-227d60179ead None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:33.754610 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9685a-4ef2-460f-b127-227d60179ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:33.875805 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-2fc9685a-4ef2-460f-b127-227d60179ead None None] MFA Rules not processed for user `5f831a03bfb849788fad6a7dea42d595`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:33.880853 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-2fc9685a-4ef2-460f-b127-227d60179ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:34.171957 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 831/1663] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:33 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:34.301589 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db1892-0239-46b2-bb2e-f6fc7ffb4dd8 service neutron] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:34.303182 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-d5db1892-0239-46b2-bb2e-f6fc7ffb4dd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:34.327414 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db1892-0239-46b2-bb2e-f6fc7ffb4dd8 service neutron] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:34.340529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038caee9-15a3-421d-923c-fc4b1fb97932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:34.341359 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038caee9-15a3-421d-923c-fc4b1fb97932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:34.342481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038caee9-15a3-421d-923c-fc4b1fb97932 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:34.344720 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038caee9-15a3-421d-923c-fc4b1fb97932 admin admin] PATH_INFO: `/v3/users/f06a5a8ce9e44a769e9088bf6afcf73a` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:34.346541 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038caee9-15a3-421d-923c-fc4b1fb97932 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f06a5a8ce9e44a769e9088bf6afcf73a)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:34.349791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038caee9-15a3-421d-923c-fc4b1fb97932 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:34.486533 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-038caee9-15a3-421d-923c-fc4b1fb97932 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f06a5a8ce9e44a769e9088bf6afcf73a'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:34.490804 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-038caee9-15a3-421d-923c-fc4b1fb97932 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f06a5a8ce9e44a769e9088bf6afcf73a'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:34.491464 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-038caee9-15a3-421d-923c-fc4b1fb97932 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f06a5a8ce9e44a769e9088bf6afcf73a'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:34.518039 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-038caee9-15a3-421d-923c-fc4b1fb97932 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f06a5a8ce9e44a769e9088bf6afcf73a'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:34.537556 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-038caee9-15a3-421d-923c-fc4b1fb97932 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f06a5a8ce9e44a769e9088bf6afcf73a'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:34.564889 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 833/1664] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:49:34 2022] DELETE /identity/v3/users/f06a5a8ce9e44a769e9088bf6afcf73a => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:34.569107 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f73a0c-d286-475b-bb81-5308dd105ccd None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:34.570287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f73a0c-d286-475b-bb81-5308dd105ccd None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:34.570768 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f73a0c-d286-475b-bb81-5308dd105ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:34.606981 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-21f73a0c-d286-475b-bb81-5308dd105ccd None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:34.608580 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-21f73a0c-d286-475b-bb81-5308dd105ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:34.676704 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:34.745552 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 832/1665] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:34.814365 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038caee9-15a3-421d-923c-fc4b1fb97932 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:34.816448 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-038caee9-15a3-421d-923c-fc4b1fb97932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:34.916601 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:34.979950 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038caee9-15a3-421d-923c-fc4b1fb97932 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:34.992756 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498d758-e141-4df1-aff7-cb71bab3bdfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:34.993817 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498d758-e141-4df1-aff7-cb71bab3bdfb service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:34.994306 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498d758-e141-4df1-aff7-cb71bab3bdfb service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:34.994762 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498d758-e141-4df1-aff7-cb71bab3bdfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:35.011668 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498d758-e141-4df1-aff7-cb71bab3bdfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:35.013765 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498d758-e141-4df1-aff7-cb71bab3bdfb service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:35.027331 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 834/1666] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:49:36.399489 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f73a0c-d286-475b-bb81-5308dd105ccd None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:36.401114 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-21f73a0c-d286-475b-bb81-5308dd105ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:36.427493 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f73a0c-d286-475b-bb81-5308dd105ccd None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:36.442629 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad68cb-312b-4674-ae44-b746af605fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:36.443587 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad68cb-312b-4674-ae44-b746af605fc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:36.444078 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad68cb-312b-4674-ae44-b746af605fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:36.444546 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad68cb-312b-4674-ae44-b746af605fc0 admin admin] PATH_INFO: `/v3/projects/4d2dd5f1419642c4961b45f67d5fe6c6` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:36.447363 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ad68cb-312b-4674-ae44-b746af605fc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d2dd5f1419642c4961b45f67d5fe6c6)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:36.448772 dv-cinder-854265-1-smb devstack@keystone.service[93147]: WARNING py.warnings [None req-30ad68cb-312b-4674-ae44-b746af605fc0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:49:36.448772 dv-cinder-854265-1-smb devstack@keystone.service[93147]: warnings.warn(msg) Aug 24 04:49:36.448772 dv-cinder-854265-1-smb devstack@keystone.service[93147]: Aug 24 04:49:36.450596 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ad68cb-312b-4674-ae44-b746af605fc0 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:36.628168 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-30ad68cb-312b-4674-ae44-b746af605fc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d2dd5f1419642c4961b45f67d5fe6c6', 'request_id': 'req-30ad68cb-312b-4674-ae44-b746af605fc0'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:36.643334 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-30ad68cb-312b-4674-ae44-b746af605fc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d2dd5f1419642c4961b45f67d5fe6c6', 'request_id': 'req-30ad68cb-312b-4674-ae44-b746af605fc0'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:36.685163 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-30ad68cb-312b-4674-ae44-b746af605fc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d2dd5f1419642c4961b45f67d5fe6c6', 'request_id': 'req-30ad68cb-312b-4674-ae44-b746af605fc0'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:36.725780 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-30ad68cb-312b-4674-ae44-b746af605fc0 admin admin] The token cache is being invalidate because project 4d2dd5f1419642c4961b45f67d5fe6c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:49:36.727890 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-30ad68cb-312b-4674-ae44-b746af605fc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:36.733034 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-30ad68cb-312b-4674-ae44-b746af605fc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:36.746345 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 833/1667] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:49:36 2022] DELETE /identity/v3/projects/4d2dd5f1419642c4961b45f67d5fe6c6 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:36.751003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498d758-e141-4df1-aff7-cb71bab3bdfb service neutron] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:36.766982 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498d758-e141-4df1-aff7-cb71bab3bdfb service neutron] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:36.905366 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad68cb-312b-4674-ae44-b746af605fc0 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:36.907265 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-30ad68cb-312b-4674-ae44-b746af605fc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:36.969303 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1c313-80f4-4d9b-a05c-dfb348c9e7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:36.972207 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1c313-80f4-4d9b-a05c-dfb348c9e7b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:36.972493 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1c313-80f4-4d9b-a05c-dfb348c9e7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:36.972775 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1c313-80f4-4d9b-a05c-dfb348c9e7b9 admin admin] PATH_INFO: `/v3/users/16b75cead2c948e596962eb9b377ed18` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:36.981713 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1c313-80f4-4d9b-a05c-dfb348c9e7b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16b75cead2c948e596962eb9b377ed18)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:36.987911 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1c313-80f4-4d9b-a05c-dfb348c9e7b9 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:37.171091 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad68cb-312b-4674-ae44-b746af605fc0 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:37.176133 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-baa1c313-80f4-4d9b-a05c-dfb348c9e7b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16b75cead2c948e596962eb9b377ed18'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:37.179203 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-baa1c313-80f4-4d9b-a05c-dfb348c9e7b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16b75cead2c948e596962eb9b377ed18'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:37.180703 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-baa1c313-80f4-4d9b-a05c-dfb348c9e7b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16b75cead2c948e596962eb9b377ed18'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:37.184808 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf2eb3-056c-490a-a4fa-6add90542036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:37.187157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf2eb3-056c-490a-a4fa-6add90542036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:37.187448 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf2eb3-056c-490a-a4fa-6add90542036 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:37.187726 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf2eb3-056c-490a-a4fa-6add90542036 admin admin] PATH_INFO: `/v3/projects/cbcb723b1bfa400b807873faeac1bcd5` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:37.199205 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdf2eb3-056c-490a-a4fa-6add90542036 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbcb723b1bfa400b807873faeac1bcd5)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:37.205759 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdf2eb3-056c-490a-a4fa-6add90542036 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:37.208685 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-baa1c313-80f4-4d9b-a05c-dfb348c9e7b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16b75cead2c948e596962eb9b377ed18'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:37.232055 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-baa1c313-80f4-4d9b-a05c-dfb348c9e7b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16b75cead2c948e596962eb9b377ed18'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:37.261954 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 835/1668] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:49:36 2022] DELETE /identity/v3/users/16b75cead2c948e596962eb9b377ed18 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:37.263571 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79260c-127f-4766-a26f-0a7ef212730d None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:37.264013 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79260c-127f-4766-a26f-0a7ef212730d None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:37.264416 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79260c-127f-4766-a26f-0a7ef212730d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:37.320680 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-6e79260c-127f-4766-a26f-0a7ef212730d None None] MFA Rules not processed for user `0a0a837efc394b70b9e2b1d4a4857c04`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:37.322053 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-6e79260c-127f-4766-a26f-0a7ef212730d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:37.382093 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-3bdf2eb3-056c-490a-a4fa-6add90542036 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbcb723b1bfa400b807873faeac1bcd5', 'request_id': 'req-3bdf2eb3-056c-490a-a4fa-6add90542036'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:37.408210 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-3bdf2eb3-056c-490a-a4fa-6add90542036 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbcb723b1bfa400b807873faeac1bcd5', 'request_id': 'req-3bdf2eb3-056c-490a-a4fa-6add90542036'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:37.427845 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:37.438866 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-3bdf2eb3-056c-490a-a4fa-6add90542036 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbcb723b1bfa400b807873faeac1bcd5', 'request_id': 'req-3bdf2eb3-056c-490a-a4fa-6add90542036'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:37.442081 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:37.474143 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-3bdf2eb3-056c-490a-a4fa-6add90542036 admin admin] The token cache is being invalidate because project cbcb723b1bfa400b807873faeac1bcd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:49:37.474448 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-3bdf2eb3-056c-490a-a4fa-6add90542036 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:37.476935 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-3bdf2eb3-056c-490a-a4fa-6add90542036 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:37.485102 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 834/1669] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:49:36 2022] DELETE /identity/v3/projects/cbcb723b1bfa400b807873faeac1bcd5 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:49:37.485572 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 836/1670] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:37.489275 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051afe5-7eea-4968-8188-72e0bf4999a0 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:37.489594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051afe5-7eea-4968-8188-72e0bf4999a0 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:37.489867 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0051afe5-7eea-4968-8188-72e0bf4999a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:37.491349 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685344a2-1c5b-46e1-a71b-c7644f8d448d None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:37.492841 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685344a2-1c5b-46e1-a71b-c7644f8d448d None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:37.493127 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685344a2-1c5b-46e1-a71b-c7644f8d448d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:37.534265 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-0051afe5-7eea-4968-8188-72e0bf4999a0 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:37.536592 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-0051afe5-7eea-4968-8188-72e0bf4999a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:37.546058 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-685344a2-1c5b-46e1-a71b-c7644f8d448d None None] MFA Rules not processed for user `0a0a837efc394b70b9e2b1d4a4857c04`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:37.547652 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-685344a2-1c5b-46e1-a71b-c7644f8d448d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:37.571206 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 835/1671] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:37.583418 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685344a2-1c5b-46e1-a71b-c7644f8d448d None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:37.586177 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-685344a2-1c5b-46e1-a71b-c7644f8d448d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:37.735335 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 837/1672] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:37.744982 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287871a-bc5d-4ca7-9e16-9ba16755f55d None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:37.745275 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287871a-bc5d-4ca7-9e16-9ba16755f55d None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:37.747633 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287871a-bc5d-4ca7-9e16-9ba16755f55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:37.800998 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-f287871a-bc5d-4ca7-9e16-9ba16755f55d None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:37.802183 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685344a2-1c5b-46e1-a71b-c7644f8d448d None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:37.807078 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-f287871a-bc5d-4ca7-9e16-9ba16755f55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:37.828292 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ae9b8-edc5-482d-8978-ff8d03323588 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:37.829004 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ae9b8-edc5-482d-8978-ff8d03323588 service nova] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:37.829286 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ae9b8-edc5-482d-8978-ff8d03323588 service nova] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:37.829599 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ae9b8-edc5-482d-8978-ff8d03323588 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:37.839589 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-d41ae9b8-edc5-482d-8978-ff8d03323588 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:37.840873 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 838/1673] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:37.843122 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287871a-bc5d-4ca7-9e16-9ba16755f55d None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:37.875545 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287871a-bc5d-4ca7-9e16-9ba16755f55d None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:37.879340 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ae9b8-edc5-482d-8978-ff8d03323588 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:37.881265 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ae9b8-edc5-482d-8978-ff8d03323588 service nova] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:37.895021 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fa3e5-ef0a-40c5-8f3a-9145b625574a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:37.895663 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fa3e5-ef0a-40c5-8f3a-9145b625574a admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:37.895938 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fa3e5-ef0a-40c5-8f3a-9145b625574a admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:37.896961 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fa3e5-ef0a-40c5-8f3a-9145b625574a admin admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:37.898507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315fa3e5-ef0a-40c5-8f3a-9145b625574a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:49:37.901140 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315fa3e5-ef0a-40c5-8f3a-9145b625574a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:37.905675 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315fa3e5-ef0a-40c5-8f3a-9145b625574a admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:37.916175 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 836/1674] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:49:37.933285 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 839/1675] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:49:37.935350 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ae9b8-edc5-482d-8978-ff8d03323588 service nova] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:37.963709 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ae9b8-edc5-482d-8978-ff8d03323588 service nova] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:37.977181 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf37793-ace4-4751-9255-66b0e4701f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:37.979183 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf37793-ace4-4751-9255-66b0e4701f96 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:37.979910 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf37793-ace4-4751-9255-66b0e4701f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:37.980320 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf37793-ace4-4751-9255-66b0e4701f96 admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:37.981812 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf37793-ace4-4751-9255-66b0e4701f96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:37.988638 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf37793-ace4-4751-9255-66b0e4701f96 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:38.048029 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101faad-2475-4617-8102-ace2fc36dc07 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:38.048416 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101faad-2475-4617-8102-ace2fc36dc07 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:38.048771 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3101faad-2475-4617-8102-ace2fc36dc07 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:38.050668 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 840/1676] 10.222.0.49 () {54 vars in 921 bytes} [Wed Aug 24 04:49:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:49:38.076270 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 837/1677] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:49:37 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:38.081010 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3101faad-2475-4617-8102-ace2fc36dc07 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:38.101695 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e1c9d-1db7-46ad-9639-49130f120851 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:38.101983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e1c9d-1db7-46ad-9639-49130f120851 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:38.102257 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e1c9d-1db7-46ad-9639-49130f120851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:38.187183 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-117e1c9d-1db7-46ad-9639-49130f120851 None None] MFA Rules not processed for user `edf1b960a2eb4e5e9ada736b5f3f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:38.188643 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-117e1c9d-1db7-46ad-9639-49130f120851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:38.315865 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3101faad-2475-4617-8102-ace2fc36dc07 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:38.331035 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd01a1-752b-45ee-adc9-ff0b2a8abf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:38.331568 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd01a1-752b-45ee-adc9-ff0b2a8abf02 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:38.331850 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd01a1-752b-45ee-adc9-ff0b2a8abf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:38.332118 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd01a1-752b-45ee-adc9-ff0b2a8abf02 admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:38.332766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd01a1-752b-45ee-adc9-ff0b2a8abf02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:38.336839 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd01a1-752b-45ee-adc9-ff0b2a8abf02 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:38.353715 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 838/1678] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Aug 24 04:49:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:38.355073 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e1c9d-1db7-46ad-9639-49130f120851 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:38.360181 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-117e1c9d-1db7-46ad-9639-49130f120851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:38.389321 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 841/1679] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:49:38 2022] POST /identity/v3/users => generated 288 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:38.389321 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd01a1-752b-45ee-adc9-ff0b2a8abf02 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:38.391286 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-a8cd01a1-752b-45ee-adc9-ff0b2a8abf02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:38.415146 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e1c9d-1db7-46ad-9639-49130f120851 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:38.417372 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd01a1-752b-45ee-adc9-ff0b2a8abf02 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:38.423587 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6220fb86-83c7-4d01-ad8b-c21fece2b028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:38.426900 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220fb86-83c7-4d01-ad8b-c21fece2b028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:38.428691 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220fb86-83c7-4d01-ad8b-c21fece2b028 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:38.429057 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eebb1f-9c41-44ed-94bb-62e2d598c684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:38.429392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220fb86-83c7-4d01-ad8b-c21fece2b028 admin admin] PATH_INFO: `/v3/projects/51fd74f8ea9340a1b05c66f9f18d78ca` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:38.431893 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6220fb86-83c7-4d01-ad8b-c21fece2b028 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51fd74f8ea9340a1b05c66f9f18d78ca)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:38.432464 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eebb1f-9c41-44ed-94bb-62e2d598c684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:38.433094 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eebb1f-9c41-44ed-94bb-62e2d598c684 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:38.433431 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eebb1f-9c41-44ed-94bb-62e2d598c684 admin admin] PATH_INFO: `/v3/users/dddcaf1222cf488180c22dfad9ee54b9` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:38.437656 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eebb1f-9c41-44ed-94bb-62e2d598c684 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dddcaf1222cf488180c22dfad9ee54b9)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:38.439903 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eebb1f-9c41-44ed-94bb-62e2d598c684 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:38.441873 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6220fb86-83c7-4d01-ad8b-c21fece2b028 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:38.530360 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-54eebb1f-9c41-44ed-94bb-62e2d598c684 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dddcaf1222cf488180c22dfad9ee54b9'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:38.531818 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-54eebb1f-9c41-44ed-94bb-62e2d598c684 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dddcaf1222cf488180c22dfad9ee54b9'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:38.534270 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-54eebb1f-9c41-44ed-94bb-62e2d598c684 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dddcaf1222cf488180c22dfad9ee54b9'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:38.544870 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:38.560864 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:38.580969 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-54eebb1f-9c41-44ed-94bb-62e2d598c684 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dddcaf1222cf488180c22dfad9ee54b9'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:38.586498 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-6220fb86-83c7-4d01-ad8b-c21fece2b028 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51fd74f8ea9340a1b05c66f9f18d78ca', 'request_id': 'req-6220fb86-83c7-4d01-ad8b-c21fece2b028'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:38.599218 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-54eebb1f-9c41-44ed-94bb-62e2d598c684 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dddcaf1222cf488180c22dfad9ee54b9'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:38.609677 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-6220fb86-83c7-4d01-ad8b-c21fece2b028 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51fd74f8ea9340a1b05c66f9f18d78ca', 'request_id': 'req-6220fb86-83c7-4d01-ad8b-c21fece2b028'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:38.625116 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-6220fb86-83c7-4d01-ad8b-c21fece2b028 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51fd74f8ea9340a1b05c66f9f18d78ca', 'request_id': 'req-6220fb86-83c7-4d01-ad8b-c21fece2b028'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:38.631839 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 842/1680] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:49:38 2022] DELETE /identity/v3/users/dddcaf1222cf488180c22dfad9ee54b9 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:38.635035 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eebb1f-9c41-44ed-94bb-62e2d598c684 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:38.635945 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-54eebb1f-9c41-44ed-94bb-62e2d598c684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:38.648062 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-6220fb86-83c7-4d01-ad8b-c21fece2b028 admin admin] The token cache is being invalidate because project 51fd74f8ea9340a1b05c66f9f18d78ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:49:38.648373 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-6220fb86-83c7-4d01-ad8b-c21fece2b028 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:38.650234 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-6220fb86-83c7-4d01-ad8b-c21fece2b028 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:38.652138 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 839/1681] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:49:38 2022] DELETE /identity/v3/projects/51fd74f8ea9340a1b05c66f9f18d78ca => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:38.654346 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b12c3-d6c2-4b84-8079-ccdbee568e32 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:38.654635 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b12c3-d6c2-4b84-8079-ccdbee568e32 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:38.655259 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b12c3-d6c2-4b84-8079-ccdbee568e32 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:38.660276 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 840/1682] 10.222.0.49 () {54 vars in 961 bytes} [Wed Aug 24 04:49:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:49:38.662386 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b30a7e-c1f0-493a-b4fc-6cf2b2827ee3 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:38.662919 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b30a7e-c1f0-493a-b4fc-6cf2b2827ee3 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:38.663746 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b30a7e-c1f0-493a-b4fc-6cf2b2827ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:38.730085 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-31b30a7e-c1f0-493a-b4fc-6cf2b2827ee3 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:38.734680 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-31b30a7e-c1f0-493a-b4fc-6cf2b2827ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:38.778275 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eebb1f-9c41-44ed-94bb-62e2d598c684 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:38.793540 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa79c31-c8e4-40a6-b5ff-75c2e145f833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:38.794186 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa79c31-c8e4-40a6-b5ff-75c2e145f833 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:38.794521 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa79c31-c8e4-40a6-b5ff-75c2e145f833 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:38.795064 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa79c31-c8e4-40a6-b5ff-75c2e145f833 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:38.795863 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa79c31-c8e4-40a6-b5ff-75c2e145f833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:38.797705 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa79c31-c8e4-40a6-b5ff-75c2e145f833 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:38.818404 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 843/1683] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:38.821843 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1066ce-923a-43c6-b84a-994ed19e75cb None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:38.823715 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1066ce-923a-43c6-b84a-994ed19e75cb None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:38.824137 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1066ce-923a-43c6-b84a-994ed19e75cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:38.843364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 841/1684] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:38.845878 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1a285-1132-4ff6-9b0e-d8fefbd49945 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:38.845978 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1a285-1132-4ff6-9b0e-d8fefbd49945 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:38.846403 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1a285-1132-4ff6-9b0e-d8fefbd49945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:38.875297 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-4f1066ce-923a-43c6-b84a-994ed19e75cb None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:38.878057 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-4f1066ce-923a-43c6-b84a-994ed19e75cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:38.892864 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-f4c1a285-1132-4ff6-9b0e-d8fefbd49945 None None] MFA Rules not processed for user `edf1b960a2eb4e5e9ada736b5f3f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:38.896757 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-f4c1a285-1132-4ff6-9b0e-d8fefbd49945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:38.901649 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 844/1685] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:38.903100 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1066ce-923a-43c6-b84a-994ed19e75cb None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:38.918409 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-4f1066ce-923a-43c6-b84a-994ed19e75cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:38.953717 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1066ce-923a-43c6-b84a-994ed19e75cb None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:38.969045 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f60f9-435d-4d2b-b064-dbebdbc74eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:38.970162 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f60f9-435d-4d2b-b064-dbebdbc74eaf admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:38.972257 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f60f9-435d-4d2b-b064-dbebdbc74eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:38.972653 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f60f9-435d-4d2b-b064-dbebdbc74eaf admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:38.973470 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f60f9-435d-4d2b-b064-dbebdbc74eaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:38.979421 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f60f9-435d-4d2b-b064-dbebdbc74eaf admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:39.021944 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 845/1686] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:39.024115 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f60f9-435d-4d2b-b064-dbebdbc74eaf admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:39.028443 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-884f60f9-435d-4d2b-b064-dbebdbc74eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:39.122964 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 842/1687] 10.222.0.49 () {58 vars in 1058 bytes} [Wed Aug 24 04:49:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:39.124758 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20c39a-7c2a-4c17-84f6-597cf18b8b04 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:39.127224 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20c39a-7c2a-4c17-84f6-597cf18b8b04 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:39.128213 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20c39a-7c2a-4c17-84f6-597cf18b8b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:39.185204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-1c20c39a-7c2a-4c17-84f6-597cf18b8b04 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:39.187895 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-1c20c39a-7c2a-4c17-84f6-597cf18b8b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:39.227837 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 843/1688] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:39.230162 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631cc74-3c23-48e5-b0be-37ddc76f707e None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:39.234095 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631cc74-3c23-48e5-b0be-37ddc76f707e None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:39.235606 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f60f9-435d-4d2b-b064-dbebdbc74eaf admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:39.237774 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631cc74-3c23-48e5-b0be-37ddc76f707e None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:39.241119 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 844/1689] 10.222.0.49 () {54 vars in 912 bytes} [Wed Aug 24 04:49:39 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:49:39.253029 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631cc74-3c23-48e5-b0be-37ddc76f707e None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:39.268795 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3d812-eab9-45a2-8855-2be017a21ea0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:39.269523 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3d812-eab9-45a2-8855-2be017a21ea0 service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:39.269834 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3d812-eab9-45a2-8855-2be017a21ea0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:39.270134 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3d812-eab9-45a2-8855-2be017a21ea0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:39.289772 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a3d812-eab9-45a2-8855-2be017a21ea0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:39.291573 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a3d812-eab9-45a2-8855-2be017a21ea0 service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:39.301299 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631cc74-3c23-48e5-b0be-37ddc76f707e None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:39.315209 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a3574-1e5e-480c-a62e-eb7529d48b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:39.315896 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a3574-1e5e-480c-a62e-eb7529d48b21 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:39.318693 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a3574-1e5e-480c-a62e-eb7529d48b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:39.319169 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3a3574-1e5e-480c-a62e-eb7529d48b21 admin admin] PATH_INFO: `/v3/projects/4383722c79ce40dda9ad2ad615ed0775/users/20d6039651dc42678611415778d05d9e/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:39.351744 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 846/1690] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:49:39.353021 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3d812-eab9-45a2-8855-2be017a21ea0 service neutron] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:39.357188 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a3574-1e5e-480c-a62e-eb7529d48b21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4383722c79ce40dda9ad2ad615ed0775, user_id=20d6039651dc42678611415778d05d9e, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:39.363177 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3a3574-1e5e-480c-a62e-eb7529d48b21 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:39.393951 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 845/1691] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:49:39 2022] PUT /identity/v3/projects/4383722c79ce40dda9ad2ad615ed0775/users/20d6039651dc42678611415778d05d9e/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:39.394891 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a3574-1e5e-480c-a62e-eb7529d48b21 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:39.402659 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3d812-eab9-45a2-8855-2be017a21ea0 service neutron] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:39.488294 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:39.568101 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:39.596322 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3a3574-1e5e-480c-a62e-eb7529d48b21 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:39.621973 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc74432-8e53-49a7-a070-06f1df65945e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:39.631112 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e381cd-6768-4629-beec-2e4d8c4cf5e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf1b960a2eb4e5e9ada736b5f3f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:39.632088 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc74432-8e53-49a7-a070-06f1df65945e admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:39.632380 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc74432-8e53-49a7-a070-06f1df65945e admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:39.632657 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc74432-8e53-49a7-a070-06f1df65945e admin admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:39.633536 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e381cd-6768-4629-beec-2e4d8c4cf5e0 service placement] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:39.636056 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e381cd-6768-4629-beec-2e4d8c4cf5e0 service placement] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:39.636429 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e381cd-6768-4629-beec-2e4d8c4cf5e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:39.638409 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc74432-8e53-49a7-a070-06f1df65945e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:49:39.638728 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc74432-8e53-49a7-a070-06f1df65945e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:39.640128 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-d2e381cd-6768-4629-beec-2e4d8c4cf5e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:39.647490 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc74432-8e53-49a7-a070-06f1df65945e admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:39.709185 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 846/1692] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:49:39.710801 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee7462-864c-4481-a369-98f3e0bc86aa None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:39.711093 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee7462-864c-4481-a369-98f3e0bc86aa None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:39.718683 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee7462-864c-4481-a369-98f3e0bc86aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:39.733842 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e381cd-6768-4629-beec-2e4d8c4cf5e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:39.736088 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e381cd-6768-4629-beec-2e4d8c4cf5e0 service placement] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:39.780071 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 847/1693] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:49:39.782345 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e240300-c94e-4eb5-b0fb-c2ab38d0149f None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:39.782900 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e240300-c94e-4eb5-b0fb-c2ab38d0149f None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:39.783341 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e240300-c94e-4eb5-b0fb-c2ab38d0149f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:39.883306 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-ffee7462-864c-4481-a369-98f3e0bc86aa None None] MFA Rules not processed for user `087c0311906a4987b294729706a08810`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:39.884248 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-3e240300-c94e-4eb5-b0fb-c2ab38d0149f None None] MFA Rules not processed for user `20d6039651dc42678611415778d05d9e`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:39.884690 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-ffee7462-864c-4481-a369-98f3e0bc86aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:39.888561 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-3e240300-c94e-4eb5-b0fb-c2ab38d0149f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:40.085647 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 847/1694] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 24 04:49:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:40.092400 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee7462-864c-4481-a369-98f3e0bc86aa None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:40.094370 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 848/1695] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:40.096038 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2074d64-1a92-4e96-863f-3418a981209b None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:40.096499 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2074d64-1a92-4e96-863f-3418a981209b None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:40.096993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2074d64-1a92-4e96-863f-3418a981209b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:40.118592 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee7462-864c-4481-a369-98f3e0bc86aa None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:40.134311 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf50a6b-e3d5-461c-83fd-6b9389b7021e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:40.135054 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf50a6b-e3d5-461c-83fd-6b9389b7021e admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:40.135397 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf50a6b-e3d5-461c-83fd-6b9389b7021e admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:40.135729 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf50a6b-e3d5-461c-83fd-6b9389b7021e admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:40.136442 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf50a6b-e3d5-461c-83fd-6b9389b7021e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:40.138626 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf50a6b-e3d5-461c-83fd-6b9389b7021e admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:40.146660 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-c2074d64-1a92-4e96-863f-3418a981209b None None] MFA Rules not processed for user `12af555605384136af2082486782b584`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:40.149788 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-c2074d64-1a92-4e96-863f-3418a981209b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:40.217180 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 848/1696] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:49:40 2022] POST /identity/v3/projects => generated 387 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:40.218207 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf50a6b-e3d5-461c-83fd-6b9389b7021e admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:40.220169 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-2bf50a6b-e3d5-461c-83fd-6b9389b7021e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:40.266096 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 849/1697] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:40.267281 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2074d64-1a92-4e96-863f-3418a981209b None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:40.276767 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-c2074d64-1a92-4e96-863f-3418a981209b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:40.399639 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf50a6b-e3d5-461c-83fd-6b9389b7021e admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:40.411165 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793f8e8-bf4a-4534-80c6-7aac0abd6c5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:40.412922 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793f8e8-bf4a-4534-80c6-7aac0abd6c5d service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:40.413217 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793f8e8-bf4a-4534-80c6-7aac0abd6c5d service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:40.413528 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793f8e8-bf4a-4534-80c6-7aac0abd6c5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:40.431801 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793f8e8-bf4a-4534-80c6-7aac0abd6c5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:40.433164 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:40.433466 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793f8e8-bf4a-4534-80c6-7aac0abd6c5d service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:40.476170 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 849/1698] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:49:40.479774 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793f8e8-bf4a-4534-80c6-7aac0abd6c5d service neutron] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:40.490725 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2074d64-1a92-4e96-863f-3418a981209b None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:40.595384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:40.635957 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793f8e8-bf4a-4534-80c6-7aac0abd6c5d service neutron] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:40.640411 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869909d-3af8-4076-af0f-c026f9980441 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:40.641366 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869909d-3af8-4076-af0f-c026f9980441 service nova] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:40.642271 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869909d-3af8-4076-af0f-c026f9980441 service nova] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:40.642271 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869909d-3af8-4076-af0f-c026f9980441 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:40.648921 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d9e6d-8c1e-404a-9674-9002dd3b1195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:40.649603 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d9e6d-8c1e-404a-9674-9002dd3b1195 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:40.650026 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d9e6d-8c1e-404a-9674-9002dd3b1195 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:40.650301 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d9e6d-8c1e-404a-9674-9002dd3b1195 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:40.650949 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d9e6d-8c1e-404a-9674-9002dd3b1195 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:40.653957 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d9e6d-8c1e-404a-9674-9002dd3b1195 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:40.709475 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 850/1699] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:49:40 2022] POST /identity/v3/users => generated 294 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:40.711022 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4196a3-0195-415c-877c-b42cecd4acb6 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:40.711309 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4196a3-0195-415c-877c-b42cecd4acb6 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:40.711579 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4196a3-0195-415c-877c-b42cecd4acb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:40.748928 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-9e4196a3-0195-415c-877c-b42cecd4acb6 None None] MFA Rules not processed for user `d6811ba6d5fc41c499fdbe5f93dceb0d`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:40.749912 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-9e4196a3-0195-415c-877c-b42cecd4acb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:40.815661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7869909d-3af8-4076-af0f-c026f9980441 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:40.817709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7869909d-3af8-4076-af0f-c026f9980441 service nova] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:40.833848 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 851/1700] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:40.835427 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49684b5-cf71-4d92-9263-ad55685f4c87 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:40.835809 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49684b5-cf71-4d92-9263-ad55685f4c87 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:40.836381 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49684b5-cf71-4d92-9263-ad55685f4c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:40.843887 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 850/1701] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:49:40.848939 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869909d-3af8-4076-af0f-c026f9980441 service nova] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:40.875440 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869909d-3af8-4076-af0f-c026f9980441 service nova] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:40.887260 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80854905-234e-49ca-8229-c6e274d97f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:40.895455 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80854905-234e-49ca-8229-c6e274d97f86 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:40.895757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80854905-234e-49ca-8229-c6e274d97f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:40.896040 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80854905-234e-49ca-8229-c6e274d97f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:40.901844 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80854905-234e-49ca-8229-c6e274d97f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:40.907636 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80854905-234e-49ca-8229-c6e274d97f86 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:40.936940 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-a49684b5-cf71-4d92-9263-ad55685f4c87 None None] MFA Rules not processed for user `12af555605384136af2082486782b584`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:40.941240 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 851/1702] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:40.941240 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80854905-234e-49ca-8229-c6e274d97f86 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:40.941748 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-80854905-234e-49ca-8229-c6e274d97f86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:40.947636 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-a49684b5-cf71-4d92-9263-ad55685f4c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:40.963383 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80854905-234e-49ca-8229-c6e274d97f86 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:40.974952 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a0c107-e805-49b7-b134-79f9ccc5832b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:40.976236 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0c107-e805-49b7-b134-79f9ccc5832b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:40.976397 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0c107-e805-49b7-b134-79f9ccc5832b admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:40.977117 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0c107-e805-49b7-b134-79f9ccc5832b admin admin] PATH_INFO: `/v3/users/4a3c89fa96764be79919ce58cccdcfb0` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:40.981376 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a0c107-e805-49b7-b134-79f9ccc5832b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a3c89fa96764be79919ce58cccdcfb0)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:40.983484 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a0c107-e805-49b7-b134-79f9ccc5832b admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:41.066852 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-56a0c107-e805-49b7-b134-79f9ccc5832b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a3c89fa96764be79919ce58cccdcfb0'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:41.068458 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-56a0c107-e805-49b7-b134-79f9ccc5832b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a3c89fa96764be79919ce58cccdcfb0'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:41.069470 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-56a0c107-e805-49b7-b134-79f9ccc5832b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a3c89fa96764be79919ce58cccdcfb0'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:41.102213 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-56a0c107-e805-49b7-b134-79f9ccc5832b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a3c89fa96764be79919ce58cccdcfb0'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:41.117219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-56a0c107-e805-49b7-b134-79f9ccc5832b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a3c89fa96764be79919ce58cccdcfb0'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:41.125445 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:41.128102 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 852/1703] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:41.141227 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49684b5-cf71-4d92-9263-ad55685f4c87 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:41.148647 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-a49684b5-cf71-4d92-9263-ad55685f4c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:41.150751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 852/1704] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:49:40 2022] DELETE /identity/v3/users/4a3c89fa96764be79919ce58cccdcfb0 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:41.151641 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a0c107-e805-49b7-b134-79f9ccc5832b admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:41.157671 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-56a0c107-e805-49b7-b134-79f9ccc5832b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:41.207088 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49684b5-cf71-4d92-9263-ad55685f4c87 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:41.366390 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:41.394157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800354b-28aa-46a4-9e3e-6f1cfa99af3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:41.394942 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800354b-28aa-46a4-9e3e-6f1cfa99af3c service nova] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:41.396261 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800354b-28aa-46a4-9e3e-6f1cfa99af3c service nova] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:41.397832 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f800354b-28aa-46a4-9e3e-6f1cfa99af3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:41.400934 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-f800354b-28aa-46a4-9e3e-6f1cfa99af3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:41.441598 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a0c107-e805-49b7-b134-79f9ccc5832b admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:41.462655 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3a29a-2cb7-4de8-b4ab-258a8f125397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:41.463654 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3a29a-2cb7-4de8-b4ab-258a8f125397 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:41.468150 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3a29a-2cb7-4de8-b4ab-258a8f125397 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:41.468561 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb3a29a-2cb7-4de8-b4ab-258a8f125397 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:41.469345 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3a29a-2cb7-4de8-b4ab-258a8f125397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:41.478477 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb3a29a-2cb7-4de8-b4ab-258a8f125397 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:41.507158 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 853/1705] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:41.507158 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3a29a-2cb7-4de8-b4ab-258a8f125397 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:41.508443 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-ecb3a29a-2cb7-4de8-b4ab-258a8f125397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:41.542877 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb3a29a-2cb7-4de8-b4ab-258a8f125397 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:41.553833 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec0924-be10-431b-a892-34318740610a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:41.554830 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec0924-be10-431b-a892-34318740610a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:41.554830 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec0924-be10-431b-a892-34318740610a admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:41.555112 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec0924-be10-431b-a892-34318740610a admin admin] PATH_INFO: `/v3/projects/df3820a6c392449ba49c45b95c59fbe3` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:41.557554 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec0924-be10-431b-a892-34318740610a admin admin] RBAC: Authorizing `identity:delete_project(project_id=df3820a6c392449ba49c45b95c59fbe3)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:41.559704 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec0924-be10-431b-a892-34318740610a admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:41.581130 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f800354b-28aa-46a4-9e3e-6f1cfa99af3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:41.584718 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f800354b-28aa-46a4-9e3e-6f1cfa99af3c service nova] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:41.618794 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 853/1706] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:49:41.621111 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800354b-28aa-46a4-9e3e-6f1cfa99af3c service nova] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:41.623355 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-f800354b-28aa-46a4-9e3e-6f1cfa99af3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:41.665242 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-33ec0924-be10-431b-a892-34318740610a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df3820a6c392449ba49c45b95c59fbe3', 'request_id': 'req-33ec0924-be10-431b-a892-34318740610a'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:41.669316 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f800354b-28aa-46a4-9e3e-6f1cfa99af3c service nova] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:41.682012 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-33ec0924-be10-431b-a892-34318740610a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df3820a6c392449ba49c45b95c59fbe3', 'request_id': 'req-33ec0924-be10-431b-a892-34318740610a'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:41.707087 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-33ec0924-be10-431b-a892-34318740610a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df3820a6c392449ba49c45b95c59fbe3', 'request_id': 'req-33ec0924-be10-431b-a892-34318740610a'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:41.729003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-33ec0924-be10-431b-a892-34318740610a admin admin] The token cache is being invalidate because project df3820a6c392449ba49c45b95c59fbe3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:49:41.730511 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-33ec0924-be10-431b-a892-34318740610a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:41.733687 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-33ec0924-be10-431b-a892-34318740610a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:41.738384 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 854/1707] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:49:41 2022] DELETE /identity/v3/projects/df3820a6c392449ba49c45b95c59fbe3 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:41.739691 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec0924-be10-431b-a892-34318740610a admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:41.741675 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-33ec0924-be10-431b-a892-34318740610a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:41.799290 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ab169-36c6-4ca5-af41-93fc7ecb507f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:41.801271 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ab169-36c6-4ca5-af41-93fc7ecb507f service nova] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:41.802491 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ab169-36c6-4ca5-af41-93fc7ecb507f service nova] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:41.802835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ab169-36c6-4ca5-af41-93fc7ecb507f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:41.810552 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-415ab169-36c6-4ca5-af41-93fc7ecb507f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:41.859814 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec0924-be10-431b-a892-34318740610a admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:41.869923 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c08386-1437-4ff3-8cdd-99eae9c588a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:41.871937 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c08386-1437-4ff3-8cdd-99eae9c588a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:41.872448 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c08386-1437-4ff3-8cdd-99eae9c588a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:41.873005 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c08386-1437-4ff3-8cdd-99eae9c588a9 admin admin] PATH_INFO: `/v3/projects/0b96014e6576444da06022077ae59013/users/be269976f5a2474d88f6478cd11464eb/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:41.914443 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c08386-1437-4ff3-8cdd-99eae9c588a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b96014e6576444da06022077ae59013, user_id=be269976f5a2474d88f6478cd11464eb, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:41.921176 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c08386-1437-4ff3-8cdd-99eae9c588a9 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:41.930648 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:41.951317 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 855/1708] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:49:41 2022] PUT /identity/v3/projects/0b96014e6576444da06022077ae59013/users/be269976f5a2474d88f6478cd11464eb/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:41.952640 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c08386-1437-4ff3-8cdd-99eae9c588a9 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:41.957981 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-74c08386-1437-4ff3-8cdd-99eae9c588a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:41.972438 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ab169-36c6-4ca5-af41-93fc7ecb507f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:41.975371 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ab169-36c6-4ca5-af41-93fc7ecb507f service nova] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:42.054345 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 854/1709] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:41 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:49:42.055364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ab169-36c6-4ca5-af41-93fc7ecb507f service nova] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:42.064097 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-415ab169-36c6-4ca5-af41-93fc7ecb507f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:42.104154 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ab169-36c6-4ca5-af41-93fc7ecb507f service nova] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:42.182428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:42.183461 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c08386-1437-4ff3-8cdd-99eae9c588a9 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:42.201541 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e99737-c269-4966-92f5-d33074b34ee5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf1b960a2eb4e5e9ada736b5f3f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:42.202341 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e99737-c269-4966-92f5-d33074b34ee5 service placement] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:42.203463 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e99737-c269-4966-92f5-d33074b34ee5 service placement] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:42.203747 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e99737-c269-4966-92f5-d33074b34ee5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:42.210783 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-39e99737-c269-4966-92f5-d33074b34ee5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:42.231707 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5d946-56b2-43f0-bac3-a801e3309a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:42.232361 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5d946-56b2-43f0-bac3-a801e3309a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:42.232639 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5d946-56b2-43f0-bac3-a801e3309a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:42.232918 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5d946-56b2-43f0-bac3-a801e3309a96 admin admin] PATH_INFO: `/v3/projects/75a380d491184c7994a7200c459a6bf8` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:42.235988 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5d946-56b2-43f0-bac3-a801e3309a96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75a380d491184c7994a7200c459a6bf8)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:42.242215 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a5d946-56b2-43f0-bac3-a801e3309a96 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:42.243541 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e99737-c269-4966-92f5-d33074b34ee5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:42.246558 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e99737-c269-4966-92f5-d33074b34ee5 service placement] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:42.260840 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 856/1710] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:49:42.264232 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e99737-c269-4966-92f5-d33074b34ee5 service placement] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:42.264546 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-39e99737-c269-4966-92f5-d33074b34ee5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:42.281846 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e99737-c269-4966-92f5-d33074b34ee5 service placement] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:42.288747 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc8c89-1716-4548-9e3c-998a368efa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:42.290334 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc8c89-1716-4548-9e3c-998a368efa84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:42.290666 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc8c89-1716-4548-9e3c-998a368efa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:42.291179 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc8c89-1716-4548-9e3c-998a368efa84 admin admin] PATH_INFO: `/v3/users/022a47b9818447a69761bad5dcb940f0` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:42.294091 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc8c89-1716-4548-9e3c-998a368efa84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=022a47b9818447a69761bad5dcb940f0)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:42.296491 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc8c89-1716-4548-9e3c-998a368efa84 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:42.432236 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-d7fc8c89-1716-4548-9e3c-998a368efa84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '022a47b9818447a69761bad5dcb940f0'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:42.438585 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-d7fc8c89-1716-4548-9e3c-998a368efa84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '022a47b9818447a69761bad5dcb940f0'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:42.446261 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-d7fc8c89-1716-4548-9e3c-998a368efa84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '022a47b9818447a69761bad5dcb940f0'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:42.472226 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-78a5d946-56b2-43f0-bac3-a801e3309a96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75a380d491184c7994a7200c459a6bf8', 'request_id': 'req-78a5d946-56b2-43f0-bac3-a801e3309a96'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:42.475446 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-d7fc8c89-1716-4548-9e3c-998a368efa84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '022a47b9818447a69761bad5dcb940f0'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:42.491385 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-d7fc8c89-1716-4548-9e3c-998a368efa84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '022a47b9818447a69761bad5dcb940f0'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:42.497966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-78a5d946-56b2-43f0-bac3-a801e3309a96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75a380d491184c7994a7200c459a6bf8', 'request_id': 'req-78a5d946-56b2-43f0-bac3-a801e3309a96'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:42.508490 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-78a5d946-56b2-43f0-bac3-a801e3309a96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75a380d491184c7994a7200c459a6bf8', 'request_id': 'req-78a5d946-56b2-43f0-bac3-a801e3309a96'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:42.523953 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 857/1711] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:49:42 2022] DELETE /identity/v3/users/022a47b9818447a69761bad5dcb940f0 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:42.529066 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09a413-22a8-4f4f-85d2-885206ed5662 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:42.529391 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09a413-22a8-4f4f-85d2-885206ed5662 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:42.529685 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09a413-22a8-4f4f-85d2-885206ed5662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:42.541227 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-78a5d946-56b2-43f0-bac3-a801e3309a96 admin admin] The token cache is being invalidate because project 75a380d491184c7994a7200c459a6bf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:49:42.541428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-78a5d946-56b2-43f0-bac3-a801e3309a96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:42.542070 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-78a5d946-56b2-43f0-bac3-a801e3309a96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:42.550685 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 855/1712] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:49:42 2022] DELETE /identity/v3/projects/75a380d491184c7994a7200c459a6bf8 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:42.550685 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5d946-56b2-43f0-bac3-a801e3309a96 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:42.552024 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-78a5d946-56b2-43f0-bac3-a801e3309a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:42.624713 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-5b09a413-22a8-4f4f-85d2-885206ed5662 None None] MFA Rules not processed for user `be269976f5a2474d88f6478cd11464eb`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:42.625977 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-5b09a413-22a8-4f4f-85d2-885206ed5662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:42.684172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a5d946-56b2-43f0-bac3-a801e3309a96 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:42.763777 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:42.784682 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a33f6f-96ad-4ef9-95f3-1760cbe6f877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:42.785435 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a33f6f-96ad-4ef9-95f3-1760cbe6f877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:42.785803 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a33f6f-96ad-4ef9-95f3-1760cbe6f877 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:42.785977 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a33f6f-96ad-4ef9-95f3-1760cbe6f877 admin admin] PATH_INFO: `/v3/users/20d6039651dc42678611415778d05d9e` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:42.798983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a33f6f-96ad-4ef9-95f3-1760cbe6f877 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20d6039651dc42678611415778d05d9e)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:42.806274 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a33f6f-96ad-4ef9-95f3-1760cbe6f877 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:42.857582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 858/1713] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:42.859471 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09a413-22a8-4f4f-85d2-885206ed5662 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:42.866764 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-5b09a413-22a8-4f4f-85d2-885206ed5662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:42.885205 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:42.910363 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09a413-22a8-4f4f-85d2-885206ed5662 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:42.931740 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ba7a1-5561-474d-a601-37574c855bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:42.932406 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ba7a1-5561-474d-a601-37574c855bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:42.932658 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ba7a1-5561-474d-a601-37574c855bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:42.932910 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ba7a1-5561-474d-a601-37574c855bcd admin admin] PATH_INFO: `/v3/users/5f831a03bfb849788fad6a7dea42d595` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:42.937520 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ba7a1-5561-474d-a601-37574c855bcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f831a03bfb849788fad6a7dea42d595)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:42.947178 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ba7a1-5561-474d-a601-37574c855bcd admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:42.952691 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-f6a33f6f-96ad-4ef9-95f3-1760cbe6f877 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20d6039651dc42678611415778d05d9e'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:42.953958 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-f6a33f6f-96ad-4ef9-95f3-1760cbe6f877 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20d6039651dc42678611415778d05d9e'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:42.958015 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-f6a33f6f-96ad-4ef9-95f3-1760cbe6f877 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20d6039651dc42678611415778d05d9e'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:43.040028 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-f6a33f6f-96ad-4ef9-95f3-1760cbe6f877 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20d6039651dc42678611415778d05d9e'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:43.073472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-f6a33f6f-96ad-4ef9-95f3-1760cbe6f877 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20d6039651dc42678611415778d05d9e'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:43.094460 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-e52ba7a1-5561-474d-a601-37574c855bcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f831a03bfb849788fad6a7dea42d595'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:43.095530 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-e52ba7a1-5561-474d-a601-37574c855bcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f831a03bfb849788fad6a7dea42d595'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:43.096183 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-e52ba7a1-5561-474d-a601-37574c855bcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f831a03bfb849788fad6a7dea42d595'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:43.122474 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-e52ba7a1-5561-474d-a601-37574c855bcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f831a03bfb849788fad6a7dea42d595'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:43.143024 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 856/1714] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:49:42 2022] DELETE /identity/v3/users/20d6039651dc42678611415778d05d9e => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:43.143912 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a33f6f-96ad-4ef9-95f3-1760cbe6f877 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:43.148221 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-e52ba7a1-5561-474d-a601-37574c855bcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f831a03bfb849788fad6a7dea42d595'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:43.149154 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-f6a33f6f-96ad-4ef9-95f3-1760cbe6f877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:43.181124 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 859/1715] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:49:42 2022] DELETE /identity/v3/users/5f831a03bfb849788fad6a7dea42d595 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:43.183684 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c9db1-1174-473b-9de7-2cc5f027ce9f None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:43.184120 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c9db1-1174-473b-9de7-2cc5f027ce9f None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:43.184572 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c9db1-1174-473b-9de7-2cc5f027ce9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:43.224811 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-989c9db1-1174-473b-9de7-2cc5f027ce9f None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:43.226354 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-989c9db1-1174-473b-9de7-2cc5f027ce9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:43.348492 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 860/1716] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:43.424631 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c9db1-1174-473b-9de7-2cc5f027ce9f None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:43.434474 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-989c9db1-1174-473b-9de7-2cc5f027ce9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:43.472351 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a33f6f-96ad-4ef9-95f3-1760cbe6f877 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:43.508758 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af1811-8454-415f-832e-0a3f8a22c13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:43.509365 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af1811-8454-415f-832e-0a3f8a22c13c admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:43.509693 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af1811-8454-415f-832e-0a3f8a22c13c admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:43.509960 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af1811-8454-415f-832e-0a3f8a22c13c admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:43.510603 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af1811-8454-415f-832e-0a3f8a22c13c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:43.512606 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af1811-8454-415f-832e-0a3f8a22c13c admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:43.668460 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 857/1717] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:49:43 2022] POST /identity/v3/projects => generated 389 bytes in 524 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:43.675258 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af1811-8454-415f-832e-0a3f8a22c13c admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:43.679102 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-34af1811-8454-415f-832e-0a3f8a22c13c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:43.682328 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c9db1-1174-473b-9de7-2cc5f027ce9f None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:43.720906 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:43.905908 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4eb3d2-12e1-4c5d-9de2-2c951e4d3188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:43.915830 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4eb3d2-12e1-4c5d-9de2-2c951e4d3188 service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:43.919104 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4eb3d2-12e1-4c5d-9de2-2c951e4d3188 service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:43.926532 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4eb3d2-12e1-4c5d-9de2-2c951e4d3188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:43.968660 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4eb3d2-12e1-4c5d-9de2-2c951e4d3188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:43.982549 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4eb3d2-12e1-4c5d-9de2-2c951e4d3188 service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:43.985799 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af1811-8454-415f-832e-0a3f8a22c13c admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:44.000921 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9bd600-79c5-416b-a4e8-174323274fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:44.003075 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9bd600-79c5-416b-a4e8-174323274fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:44.003387 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9bd600-79c5-416b-a4e8-174323274fef admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:44.003669 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9bd600-79c5-416b-a4e8-174323274fef admin admin] PATH_INFO: `/v3/projects/2356089057374d049abd79d06438aa84` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:44.007627 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9bd600-79c5-416b-a4e8-174323274fef admin admin] RBAC: Authorizing `identity:delete_project(project_id=2356089057374d049abd79d06438aa84)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:44.012221 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 861/1718] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:49:44.012899 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4eb3d2-12e1-4c5d-9de2-2c951e4d3188 service neutron] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:44.017811 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9bd600-79c5-416b-a4e8-174323274fef admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:44.020629 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-8e4eb3d2-12e1-4c5d-9de2-2c951e4d3188 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:44.072936 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4eb3d2-12e1-4c5d-9de2-2c951e4d3188 service neutron] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:44.085144 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6b628-8466-4823-bb47-98cb2d2c5c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:44.086061 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6b628-8466-4823-bb47-98cb2d2c5c75 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:44.086769 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6b628-8466-4823-bb47-98cb2d2c5c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:44.087115 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6b628-8466-4823-bb47-98cb2d2c5c75 admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:44.087828 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6b628-8466-4823-bb47-98cb2d2c5c75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:44.090440 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c6b628-8466-4823-bb47-98cb2d2c5c75 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:44.097801 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:44.154830 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 862/1719] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:49:44 2022] POST /identity/v3/users => generated 301 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:44.161056 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7de895-83b7-491a-a5dd-1218f54e4de0 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:44.161564 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7de895-83b7-491a-a5dd-1218f54e4de0 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:44.162466 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7de895-83b7-491a-a5dd-1218f54e4de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:44.206127 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-2b7de895-83b7-491a-a5dd-1218f54e4de0 None None] MFA Rules not processed for user `12af555605384136af2082486782b584`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:44.207820 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-2b7de895-83b7-491a-a5dd-1218f54e4de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:44.219198 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-6b9bd600-79c5-416b-a4e8-174323274fef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2356089057374d049abd79d06438aa84', 'request_id': 'req-6b9bd600-79c5-416b-a4e8-174323274fef'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:44.249644 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-6b9bd600-79c5-416b-a4e8-174323274fef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2356089057374d049abd79d06438aa84', 'request_id': 'req-6b9bd600-79c5-416b-a4e8-174323274fef'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:44.288493 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-6b9bd600-79c5-416b-a4e8-174323274fef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2356089057374d049abd79d06438aa84', 'request_id': 'req-6b9bd600-79c5-416b-a4e8-174323274fef'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:44.346236 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-6b9bd600-79c5-416b-a4e8-174323274fef admin admin] The token cache is being invalidate because project 2356089057374d049abd79d06438aa84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:49:44.346681 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-6b9bd600-79c5-416b-a4e8-174323274fef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:44.353958 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-6b9bd600-79c5-416b-a4e8-174323274fef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:44.364531 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 858/1720] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:49:43 2022] DELETE /identity/v3/projects/2356089057374d049abd79d06438aa84 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:44.366088 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9bd600-79c5-416b-a4e8-174323274fef admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:44.370444 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-6b9bd600-79c5-416b-a4e8-174323274fef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:44.423299 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 863/1721] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:44.423299 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7de895-83b7-491a-a5dd-1218f54e4de0 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:44.433197 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-2b7de895-83b7-491a-a5dd-1218f54e4de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:44.695247 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7de895-83b7-491a-a5dd-1218f54e4de0 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:44.702435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b974409e-14e2-41ab-81c7-502a0962e848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:44.703604 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974409e-14e2-41ab-81c7-502a0962e848 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:44.704057 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974409e-14e2-41ab-81c7-502a0962e848 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:44.706084 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974409e-14e2-41ab-81c7-502a0962e848 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:44.708063 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b974409e-14e2-41ab-81c7-502a0962e848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:44.710212 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b974409e-14e2-41ab-81c7-502a0962e848 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:44.731024 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 864/1722] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:44.732906 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1886cbe-b4f7-4b7c-bb09-b2d37fa118e9 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:44.734076 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1886cbe-b4f7-4b7c-bb09-b2d37fa118e9 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:44.734458 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1886cbe-b4f7-4b7c-bb09-b2d37fa118e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:44.754448 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9bd600-79c5-416b-a4e8-174323274fef admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:44.766708 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d1a82-6e20-437c-8191-18eb7203a9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:44.767663 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d1a82-6e20-437c-8191-18eb7203a9fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:44.768155 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d1a82-6e20-437c-8191-18eb7203a9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:44.768688 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d1a82-6e20-437c-8191-18eb7203a9fe admin admin] PATH_INFO: `/v3/projects/4984ad57a16c41e7a96bbb64bde0a3b5` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:44.770885 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d1a82-6e20-437c-8191-18eb7203a9fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=4984ad57a16c41e7a96bbb64bde0a3b5)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:44.779392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d1a82-6e20-437c-8191-18eb7203a9fe admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:44.783328 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-a1886cbe-b4f7-4b7c-bb09-b2d37fa118e9 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:44.785378 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-a1886cbe-b4f7-4b7c-bb09-b2d37fa118e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:44.804944 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 865/1723] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:44.806059 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1886cbe-b4f7-4b7c-bb09-b2d37fa118e9 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:44.831742 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1886cbe-b4f7-4b7c-bb09-b2d37fa118e9 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:44.841472 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba6f56-5f6a-4a74-be59-142b4e44d875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:44.843436 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba6f56-5f6a-4a74-be59-142b4e44d875 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:44.843863 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba6f56-5f6a-4a74-be59-142b4e44d875 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:44.844346 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba6f56-5f6a-4a74-be59-142b4e44d875 admin admin] PATH_INFO: `/v3/projects/e26f8bb71df74d80ab232b73441eb2a0/users/e3a6064cfd42438ba1eb6bc0b7e9a386/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:44.894764 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba6f56-5f6a-4a74-be59-142b4e44d875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e26f8bb71df74d80ab232b73441eb2a0, user_id=e3a6064cfd42438ba1eb6bc0b7e9a386, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:44.910013 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba6f56-5f6a-4a74-be59-142b4e44d875 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:44.962919 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 866/1724] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:49:44 2022] PUT /identity/v3/projects/e26f8bb71df74d80ab232b73441eb2a0/users/e3a6064cfd42438ba1eb6bc0b7e9a386/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:44.964764 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe93ea9-6ee3-4f75-b25e-c5d12fcf6956 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:44.965207 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe93ea9-6ee3-4f75-b25e-c5d12fcf6956 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:44.967355 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-1c5d1a82-6e20-437c-8191-18eb7203a9fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4984ad57a16c41e7a96bbb64bde0a3b5', 'request_id': 'req-1c5d1a82-6e20-437c-8191-18eb7203a9fe'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:44.967805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe93ea9-6ee3-4f75-b25e-c5d12fcf6956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:45.008060 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-1c5d1a82-6e20-437c-8191-18eb7203a9fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4984ad57a16c41e7a96bbb64bde0a3b5', 'request_id': 'req-1c5d1a82-6e20-437c-8191-18eb7203a9fe'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:45.027493 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-1c5d1a82-6e20-437c-8191-18eb7203a9fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4984ad57a16c41e7a96bbb64bde0a3b5', 'request_id': 'req-1c5d1a82-6e20-437c-8191-18eb7203a9fe'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:45.059290 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-1c5d1a82-6e20-437c-8191-18eb7203a9fe admin admin] The token cache is being invalidate because project 4984ad57a16c41e7a96bbb64bde0a3b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:49:45.060589 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-1c5d1a82-6e20-437c-8191-18eb7203a9fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:45.063384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-1c5d1a82-6e20-437c-8191-18eb7203a9fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:45.067897 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 859/1725] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:49:44 2022] DELETE /identity/v3/projects/4984ad57a16c41e7a96bbb64bde0a3b5 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:45.070331 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d1a82-6e20-437c-8191-18eb7203a9fe admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:45.073814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-1c5d1a82-6e20-437c-8191-18eb7203a9fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:45.090461 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-ffe93ea9-6ee3-4f75-b25e-c5d12fcf6956 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:45.101699 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-ffe93ea9-6ee3-4f75-b25e-c5d12fcf6956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:45.128985 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:45.195014 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:45.239470 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d1a82-6e20-437c-8191-18eb7203a9fe admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:45.382641 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 867/1726] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:45.385943 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77305636-2ebc-4b77-ac6d-14436b0e661e None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:45.385943 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77305636-2ebc-4b77-ac6d-14436b0e661e None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:45.385943 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77305636-2ebc-4b77-ac6d-14436b0e661e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:45.408682 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c48e55-5fb7-4678-a0ba-56479c80638a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:45.412359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c48e55-5fb7-4678-a0ba-56479c80638a admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:45.423111 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c48e55-5fb7-4678-a0ba-56479c80638a admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:45.424035 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c48e55-5fb7-4678-a0ba-56479c80638a admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:45.424982 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c48e55-5fb7-4678-a0ba-56479c80638a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:45.431899 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c48e55-5fb7-4678-a0ba-56479c80638a admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:45.446031 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-77305636-2ebc-4b77-ac6d-14436b0e661e None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:45.453171 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-77305636-2ebc-4b77-ac6d-14436b0e661e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:45.482163 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 860/1727] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:45.482163 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c48e55-5fb7-4678-a0ba-56479c80638a admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:45.486987 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 868/1728] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:45.487914 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77305636-2ebc-4b77-ac6d-14436b0e661e None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:45.509599 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77305636-2ebc-4b77-ac6d-14436b0e661e None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:45.517769 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c48e55-5fb7-4678-a0ba-56479c80638a admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:45.523851 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3866b-05fb-449d-a015-22ae2ed261b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:45.538623 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3866b-05fb-449d-a015-22ae2ed261b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:45.541214 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3866b-05fb-449d-a015-22ae2ed261b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:45.541945 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3866b-05fb-449d-a015-22ae2ed261b9 admin admin] PATH_INFO: `/v3/projects/e26f8bb71df74d80ab232b73441eb2a0/users/e3a6064cfd42438ba1eb6bc0b7e9a386/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:45.543662 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4faa7-414e-49d8-88e4-e69e690b5c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:45.545924 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4faa7-414e-49d8-88e4-e69e690b5c99 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:45.546799 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4faa7-414e-49d8-88e4-e69e690b5c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:45.548145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3866b-05fb-449d-a015-22ae2ed261b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e26f8bb71df74d80ab232b73441eb2a0, user_id=e3a6064cfd42438ba1eb6bc0b7e9a386, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:45.548603 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4faa7-414e-49d8-88e4-e69e690b5c99 admin admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:45.551005 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c4faa7-414e-49d8-88e4-e69e690b5c99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:49:45.552990 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c4faa7-414e-49d8-88e4-e69e690b5c99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:45.557029 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3866b-05fb-449d-a015-22ae2ed261b9 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:45.558357 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c4faa7-414e-49d8-88e4-e69e690b5c99 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:45.593301 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 869/1729] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:49:45 2022] PUT /identity/v3/projects/e26f8bb71df74d80ab232b73441eb2a0/users/e3a6064cfd42438ba1eb6bc0b7e9a386/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:45.595966 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3866b-05fb-449d-a015-22ae2ed261b9 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:45.598155 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 861/1730] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:49:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:49:45.600038 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b4c12-6121-4ef2-8c67-2fe16738e69a None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:45.600703 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b4c12-6121-4ef2-8c67-2fe16738e69a None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:45.601263 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b4c12-6121-4ef2-8c67-2fe16738e69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:45.610791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-5fc3866b-05fb-449d-a015-22ae2ed261b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:45.661461 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-d40b4c12-6121-4ef2-8c67-2fe16738e69a None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:45.665122 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-d40b4c12-6121-4ef2-8c67-2fe16738e69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:45.768826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3866b-05fb-449d-a015-22ae2ed261b9 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:45.789534 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49609fb2-ce11-410e-ad12-17eb4bb8726b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:45.791687 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49609fb2-ce11-410e-ad12-17eb4bb8726b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:45.792683 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49609fb2-ce11-410e-ad12-17eb4bb8726b admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:45.793114 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49609fb2-ce11-410e-ad12-17eb4bb8726b admin admin] PATH_INFO: `/v3/projects/4383722c79ce40dda9ad2ad615ed0775` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:45.796104 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49609fb2-ce11-410e-ad12-17eb4bb8726b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4383722c79ce40dda9ad2ad615ed0775)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:45.799939 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49609fb2-ce11-410e-ad12-17eb4bb8726b admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:45.859409 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 862/1731] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:45.862176 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a41eb-28c5-43fe-be56-044ec85d498d None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:45.866116 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a41eb-28c5-43fe-be56-044ec85d498d None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:45.866448 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a41eb-28c5-43fe-be56-044ec85d498d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:45.912239 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-49609fb2-ce11-410e-ad12-17eb4bb8726b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4383722c79ce40dda9ad2ad615ed0775', 'request_id': 'req-49609fb2-ce11-410e-ad12-17eb4bb8726b'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:45.942840 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-49609fb2-ce11-410e-ad12-17eb4bb8726b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4383722c79ce40dda9ad2ad615ed0775', 'request_id': 'req-49609fb2-ce11-410e-ad12-17eb4bb8726b'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:45.966865 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-543a41eb-28c5-43fe-be56-044ec85d498d None None] MFA Rules not processed for user `e3a6064cfd42438ba1eb6bc0b7e9a386`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:45.969569 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-49609fb2-ce11-410e-ad12-17eb4bb8726b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4383722c79ce40dda9ad2ad615ed0775', 'request_id': 'req-49609fb2-ce11-410e-ad12-17eb4bb8726b'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:45.974763 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-543a41eb-28c5-43fe-be56-044ec85d498d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:46.001000 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-49609fb2-ce11-410e-ad12-17eb4bb8726b admin admin] The token cache is being invalidate because project 4383722c79ce40dda9ad2ad615ed0775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:49:46.001459 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-49609fb2-ce11-410e-ad12-17eb4bb8726b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:46.003504 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-49609fb2-ce11-410e-ad12-17eb4bb8726b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:46.006061 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 870/1732] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:49:45 2022] DELETE /identity/v3/projects/4383722c79ce40dda9ad2ad615ed0775 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:46.007455 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49609fb2-ce11-410e-ad12-17eb4bb8726b admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:46.010500 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-49609fb2-ce11-410e-ad12-17eb4bb8726b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:46.071980 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:46.113522 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:46.136220 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 863/1733] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:45 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:46.137161 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a41eb-28c5-43fe-be56-044ec85d498d None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:46.142712 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-543a41eb-28c5-43fe-be56-044ec85d498d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:46.206613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49609fb2-ce11-410e-ad12-17eb4bb8726b admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:46.230564 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e83280-f5d4-4c1f-8bcd-8a603a67205e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:46.231282 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e83280-f5d4-4c1f-8bcd-8a603a67205e admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:46.231578 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e83280-f5d4-4c1f-8bcd-8a603a67205e admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:46.231850 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e83280-f5d4-4c1f-8bcd-8a603a67205e admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:46.232514 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e83280-f5d4-4c1f-8bcd-8a603a67205e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:46.234762 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e83280-f5d4-4c1f-8bcd-8a603a67205e admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:46.301790 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 871/1734] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:49:46 2022] POST /identity/v3/projects => generated 367 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:46.303103 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45b959-d0b9-42b1-b802-c5ccf1080613 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:46.303390 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45b959-d0b9-42b1-b802-c5ccf1080613 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:46.303664 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45b959-d0b9-42b1-b802-c5ccf1080613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:46.351352 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-cb45b959-d0b9-42b1-b802-c5ccf1080613 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:46.353413 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-cb45b959-d0b9-42b1-b802-c5ccf1080613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:46.380145 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a41eb-28c5-43fe-be56-044ec85d498d None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:46.499507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 872/1735] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:46.500543 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45b959-d0b9-42b1-b802-c5ccf1080613 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:46.502526 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-cb45b959-d0b9-42b1-b802-c5ccf1080613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:46.538384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ecc61-154e-49f1-b77d-9fa92f28bf4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:46.539360 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ecc61-154e-49f1-b77d-9fa92f28bf4c admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:46.540279 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ecc61-154e-49f1-b77d-9fa92f28bf4c admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:46.540709 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ecc61-154e-49f1-b77d-9fa92f28bf4c admin admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:46.542225 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ecc61-154e-49f1-b77d-9fa92f28bf4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:49:46.543138 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ecc61-154e-49f1-b77d-9fa92f28bf4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:46.545041 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ecc61-154e-49f1-b77d-9fa92f28bf4c admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:46.564289 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 864/1736] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:49:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:49:46.566321 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dd1ca-8cd4-4427-95ec-664ab30078cf None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:46.566800 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dd1ca-8cd4-4427-95ec-664ab30078cf None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:46.567527 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dd1ca-8cd4-4427-95ec-664ab30078cf None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:46.569116 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 865/1737] 10.222.0.49 () {54 vars in 912 bytes} [Wed Aug 24 04:49:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:49:46.570230 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78dd1ca-8cd4-4427-95ec-664ab30078cf None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:46.599567 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78dd1ca-8cd4-4427-95ec-664ab30078cf None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:46.617032 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c7699-7392-48b7-b45b-63c4d19df61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:46.619908 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c7699-7392-48b7-b45b-63c4d19df61b admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:46.620371 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c7699-7392-48b7-b45b-63c4d19df61b admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:46.623023 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c7699-7392-48b7-b45b-63c4d19df61b admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:46.624803 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c7699-7392-48b7-b45b-63c4d19df61b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:46.628503 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c7699-7392-48b7-b45b-63c4d19df61b admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:46.660299 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45b959-d0b9-42b1-b802-c5ccf1080613 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:46.666558 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 866/1738] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:49:46 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:46.668929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cc012-219c-4b4b-b4db-1d88e9e2c686 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:46.669324 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cc012-219c-4b4b-b4db-1d88e9e2c686 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:46.669621 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cc012-219c-4b4b-b4db-1d88e9e2c686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:46.674362 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70419ec6-1c24-4ea7-ba13-469d5a2ae667 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:46.674998 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70419ec6-1c24-4ea7-ba13-469d5a2ae667 service cinder] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:46.675278 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70419ec6-1c24-4ea7-ba13-469d5a2ae667 service cinder] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:46.675548 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70419ec6-1c24-4ea7-ba13-469d5a2ae667 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:46.706695 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-e52cc012-219c-4b4b-b4db-1d88e9e2c686 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:46.709119 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-e52cc012-219c-4b4b-b4db-1d88e9e2c686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:46.720852 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 867/1739] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:46.722042 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cc012-219c-4b4b-b4db-1d88e9e2c686 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:46.738466 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cc012-219c-4b4b-b4db-1d88e9e2c686 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:46.743295 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1926f-e181-4fdf-a789-d54a9f2fd190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:46.744056 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1926f-e181-4fdf-a789-d54a9f2fd190 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:46.744334 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1926f-e181-4fdf-a789-d54a9f2fd190 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:46.744605 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1926f-e181-4fdf-a789-d54a9f2fd190 admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:46.745417 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc1926f-e181-4fdf-a789-d54a9f2fd190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:46.749241 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc1926f-e181-4fdf-a789-d54a9f2fd190 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:46.787933 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70419ec6-1c24-4ea7-ba13-469d5a2ae667 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:46.790328 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70419ec6-1c24-4ea7-ba13-469d5a2ae667 service cinder] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:46.797241 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 868/1740] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:49:46 2022] POST /identity/v3/projects => generated 363 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:46.798637 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4284013-a8c3-48cf-bde7-cd0606bd5ce2 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:46.798922 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4284013-a8c3-48cf-bde7-cd0606bd5ce2 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:46.799191 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4284013-a8c3-48cf-bde7-cd0606bd5ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:46.802078 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:46.811991 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 873/1741] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:46 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:49:46.813426 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5806cb-3316-4daf-89d5-360da6ea928f None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:46.813717 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5806cb-3316-4daf-89d5-360da6ea928f None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:46.813994 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5806cb-3316-4daf-89d5-360da6ea928f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:46.836046 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-a4284013-a8c3-48cf-bde7-cd0606bd5ce2 None None] MFA Rules not processed for user `d6811ba6d5fc41c499fdbe5f93dceb0d`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:46.839051 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-2b5806cb-3316-4daf-89d5-360da6ea928f None None] MFA Rules not processed for user `087c0311906a4987b294729706a08810`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:46.840243 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-2b5806cb-3316-4daf-89d5-360da6ea928f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:46.840466 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-a4284013-a8c3-48cf-bde7-cd0606bd5ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:46.950832 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:46.975480 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 869/1742] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:46.980795 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4284013-a8c3-48cf-bde7-cd0606bd5ce2 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:47.046224 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 874/1743] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 24 04:49:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:47.047245 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5806cb-3316-4daf-89d5-360da6ea928f None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:47.194422 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5806cb-3316-4daf-89d5-360da6ea928f None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:47.207205 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41699f68-02c7-4394-a471-8328421770e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:47.207875 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41699f68-02c7-4394-a471-8328421770e9 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:47.208117 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41699f68-02c7-4394-a471-8328421770e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:47.208370 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41699f68-02c7-4394-a471-8328421770e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:47.209030 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41699f68-02c7-4394-a471-8328421770e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:49:47.209348 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41699f68-02c7-4394-a471-8328421770e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:47.211938 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41699f68-02c7-4394-a471-8328421770e9 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:47.214936 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4284013-a8c3-48cf-bde7-cd0606bd5ce2 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:47.226211 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c2e48-a481-4167-8c1d-4c781738e88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:47.226936 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c2e48-a481-4167-8c1d-4c781738e88f admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:47.227276 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c2e48-a481-4167-8c1d-4c781738e88f admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:47.227552 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c2e48-a481-4167-8c1d-4c781738e88f admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:47.228214 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c2e48-a481-4167-8c1d-4c781738e88f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:47.230077 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c2e48-a481-4167-8c1d-4c781738e88f admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:47.239620 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 875/1744] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:49:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:49:47.243364 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41699f68-02c7-4394-a471-8328421770e9 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:47.258076 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 870/1745] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:47.259705 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efd22c-b81f-45b0-a0c4-a9828ec6b471 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:47.259993 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efd22c-b81f-45b0-a0c4-a9828ec6b471 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:47.260268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efd22c-b81f-45b0-a0c4-a9828ec6b471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:47.269190 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41699f68-02c7-4394-a471-8328421770e9 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:47.299046 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ebe280-46ad-4e35-96ca-e9b75ddf7498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:47.300140 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebe280-46ad-4e35-96ca-e9b75ddf7498 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:47.300430 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebe280-46ad-4e35-96ca-e9b75ddf7498 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:47.300758 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebe280-46ad-4e35-96ca-e9b75ddf7498 admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:47.301389 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ebe280-46ad-4e35-96ca-e9b75ddf7498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:47.303398 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ebe280-46ad-4e35-96ca-e9b75ddf7498 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:47.375441 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 876/1746] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:49:47 2022] POST /identity/v3/users => generated 282 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:47.375441 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ebe280-46ad-4e35-96ca-e9b75ddf7498 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:47.377690 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-f3ebe280-46ad-4e35-96ca-e9b75ddf7498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:47.401536 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ebe280-46ad-4e35-96ca-e9b75ddf7498 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:47.408179 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-43efd22c-b81f-45b0-a0c4-a9828ec6b471 None None] MFA Rules not processed for user `c737c4586910476eafead0dfd4d9bc4c`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:47.409521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-43efd22c-b81f-45b0-a0c4-a9828ec6b471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:47.414874 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c658211-36a4-40d5-9d43-f84cc2786d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:47.416084 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c658211-36a4-40d5-9d43-f84cc2786d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:47.416700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c658211-36a4-40d5-9d43-f84cc2786d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:47.417861 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c658211-36a4-40d5-9d43-f84cc2786d1e admin admin] PATH_INFO: `/v3/users/be269976f5a2474d88f6478cd11464eb` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:47.420082 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c658211-36a4-40d5-9d43-f84cc2786d1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=be269976f5a2474d88f6478cd11464eb)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:47.445206 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c658211-36a4-40d5-9d43-f84cc2786d1e admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:47.543142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-4c658211-36a4-40d5-9d43-f84cc2786d1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be269976f5a2474d88f6478cd11464eb'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:47.544628 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-4c658211-36a4-40d5-9d43-f84cc2786d1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be269976f5a2474d88f6478cd11464eb'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:47.545726 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-4c658211-36a4-40d5-9d43-f84cc2786d1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be269976f5a2474d88f6478cd11464eb'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:47.566468 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 871/1747] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 24 04:49:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:47.568150 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efd22c-b81f-45b0-a0c4-a9828ec6b471 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:47.570189 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-43efd22c-b81f-45b0-a0c4-a9828ec6b471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:47.587880 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-4c658211-36a4-40d5-9d43-f84cc2786d1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be269976f5a2474d88f6478cd11464eb'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:47.605168 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-4c658211-36a4-40d5-9d43-f84cc2786d1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be269976f5a2474d88f6478cd11464eb'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:47.616761 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:47.617791 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efd22c-b81f-45b0-a0c4-a9828ec6b471 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:47.623078 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44c7ce-aec9-4767-8b28-a84396c66bec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:47.623991 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44c7ce-aec9-4767-8b28-a84396c66bec service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:47.624297 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44c7ce-aec9-4767-8b28-a84396c66bec service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:47.624663 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44c7ce-aec9-4767-8b28-a84396c66bec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:47.627351 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-bf44c7ce-aec9-4767-8b28-a84396c66bec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:47.641921 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 877/1748] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:49:47 2022] DELETE /identity/v3/users/be269976f5a2474d88f6478cd11464eb => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:47.641921 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c658211-36a4-40d5-9d43-f84cc2786d1e admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:47.646328 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-4c658211-36a4-40d5-9d43-f84cc2786d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:47.661367 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf44c7ce-aec9-4767-8b28-a84396c66bec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:47.668203 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf44c7ce-aec9-4767-8b28-a84396c66bec service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:47.694460 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 872/1749] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:49:47.695490 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44c7ce-aec9-4767-8b28-a84396c66bec service neutron] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:47.697511 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-bf44c7ce-aec9-4767-8b28-a84396c66bec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:47.751099 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44c7ce-aec9-4767-8b28-a84396c66bec service neutron] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:47.841552 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c658211-36a4-40d5-9d43-f84cc2786d1e admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:47.860697 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1cea7-1bb8-4a2a-9641-d5f349417e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:47.861564 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1cea7-1bb8-4a2a-9641-d5f349417e64 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:47.861853 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1cea7-1bb8-4a2a-9641-d5f349417e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:47.862126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1cea7-1bb8-4a2a-9641-d5f349417e64 admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:47.862874 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1cea7-1bb8-4a2a-9641-d5f349417e64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:47.870486 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1cea7-1bb8-4a2a-9641-d5f349417e64 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:47.881661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:47.899280 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27541de4-999b-41b1-b530-96a7940efc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:47.901003 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27541de4-999b-41b1-b530-96a7940efc9a admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:47.901674 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27541de4-999b-41b1-b530-96a7940efc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:47.903887 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27541de4-999b-41b1-b530-96a7940efc9a admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:47.905847 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27541de4-999b-41b1-b530-96a7940efc9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:47.908966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27541de4-999b-41b1-b530-96a7940efc9a admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:47.927901 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 873/1750] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:47 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:47.928830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27541de4-999b-41b1-b530-96a7940efc9a admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:47.933647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 878/1751] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:49:47 2022] POST /identity/v3/projects => generated 405 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:47.934338 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-27541de4-999b-41b1-b530-96a7940efc9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:47.935071 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae3321-ff3f-4953-8d5a-8be2ff0c1988 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:47.935357 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae3321-ff3f-4953-8d5a-8be2ff0c1988 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:47.935625 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faae3321-ff3f-4953-8d5a-8be2ff0c1988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:47.955184 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27541de4-999b-41b1-b530-96a7940efc9a admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:47.982267 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-faae3321-ff3f-4953-8d5a-8be2ff0c1988 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:47.983744 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-faae3321-ff3f-4953-8d5a-8be2ff0c1988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:48.076977 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef15d60-1057-4dbc-b6ee-869efce01d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:48.077789 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef15d60-1057-4dbc-b6ee-869efce01d77 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:48.078326 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef15d60-1057-4dbc-b6ee-869efce01d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:48.078698 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef15d60-1057-4dbc-b6ee-869efce01d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:48.079583 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef15d60-1057-4dbc-b6ee-869efce01d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:48.081563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef15d60-1057-4dbc-b6ee-869efce01d77 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:48.109252 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 874/1752] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:47 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:48.110220 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef15d60-1057-4dbc-b6ee-869efce01d77 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:48.112481 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-3ef15d60-1057-4dbc-b6ee-869efce01d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:48.152321 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 879/1753] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:48.153541 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae3321-ff3f-4953-8d5a-8be2ff0c1988 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:48.187170 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faae3321-ff3f-4953-8d5a-8be2ff0c1988 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:48.205045 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a5c91-ff98-43d5-9f28-043a13dc954c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:48.205812 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a5c91-ff98-43d5-9f28-043a13dc954c admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:48.206050 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a5c91-ff98-43d5-9f28-043a13dc954c admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:48.206321 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a5c91-ff98-43d5-9f28-043a13dc954c admin admin] PATH_INFO: `/v3/projects/72cce5ddfbfe478ba7048f3aed6cfd55/users/03cc63d4e3564cb8977b1ecc6f8bebdc/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:48.254714 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a5c91-ff98-43d5-9f28-043a13dc954c admin admin] RBAC: Authorizing `identity:create_grant(project_id=72cce5ddfbfe478ba7048f3aed6cfd55, user_id=03cc63d4e3564cb8977b1ecc6f8bebdc, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:48.257459 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a5c91-ff98-43d5-9f28-043a13dc954c admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:48.287928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 880/1754] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:49:48 2022] PUT /identity/v3/projects/72cce5ddfbfe478ba7048f3aed6cfd55/users/03cc63d4e3564cb8977b1ecc6f8bebdc/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:48.300594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a5c91-ff98-43d5-9f28-043a13dc954c admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:48.391147 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef15d60-1057-4dbc-b6ee-869efce01d77 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:48.535609 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:48.547436 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a5c91-ff98-43d5-9f28-043a13dc954c admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:48.562611 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad9e95-8fc1-4f8f-85e7-a3baaddb90d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ebb5105220438693118d734c9fda70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:48.564406 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad9e95-8fc1-4f8f-85e7-a3baaddb90d9 service swift] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:48.565439 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad9e95-8fc1-4f8f-85e7-a3baaddb90d9 service swift] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:48.567495 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad9e95-8fc1-4f8f-85e7-a3baaddb90d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:48.569193 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368e80e-223f-4b7d-b79d-498f81cd053e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:48.570980 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368e80e-223f-4b7d-b79d-498f81cd053e admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:48.571924 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-91ad9e95-8fc1-4f8f-85e7-a3baaddb90d9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:48.572432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368e80e-223f-4b7d-b79d-498f81cd053e admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:48.574182 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368e80e-223f-4b7d-b79d-498f81cd053e admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:48.577212 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368e80e-223f-4b7d-b79d-498f81cd053e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:48.583159 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368e80e-223f-4b7d-b79d-498f81cd053e admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:48.605659 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:48.659972 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 881/1755] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:49:48 2022] POST /identity/v3/users => generated 303 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:48.661378 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368e80e-223f-4b7d-b79d-498f81cd053e admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:48.696826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368e80e-223f-4b7d-b79d-498f81cd053e admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:48.706204 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c8a63-83b7-4475-9e73-3108f354c110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:48.707011 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c8a63-83b7-4475-9e73-3108f354c110 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:48.707393 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c8a63-83b7-4475-9e73-3108f354c110 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:48.707737 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c8a63-83b7-4475-9e73-3108f354c110 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:48.720582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c8a63-83b7-4475-9e73-3108f354c110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:48.728782 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c8a63-83b7-4475-9e73-3108f354c110 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:48.754412 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 882/1756] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:48.755046 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c8a63-83b7-4475-9e73-3108f354c110 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:48.758221 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-546c8a63-83b7-4475-9e73-3108f354c110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:48.781586 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad9e95-8fc1-4f8f-85e7-a3baaddb90d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:48.783247 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad9e95-8fc1-4f8f-85e7-a3baaddb90d9 service swift] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:48.809088 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 875/1757] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 24 04:49:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 699 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:49:48.811310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecb894-0963-413e-9971-16a0325b743d None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:48.811783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecb894-0963-413e-9971-16a0325b743d None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:48.812990 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecb894-0963-413e-9971-16a0325b743d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:48.884937 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-6fecb894-0963-413e-9971-16a0325b743d None None] MFA Rules not processed for user `03cc63d4e3564cb8977b1ecc6f8bebdc`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:48.886294 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-6fecb894-0963-413e-9971-16a0325b743d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:48.935733 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c8a63-83b7-4475-9e73-3108f354c110 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:48.948731 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86338db-101e-4a9f-a78b-02d57410e3ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:48.949876 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86338db-101e-4a9f-a78b-02d57410e3ba service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:48.952918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86338db-101e-4a9f-a78b-02d57410e3ba service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:48.953574 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86338db-101e-4a9f-a78b-02d57410e3ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:48.986187 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86338db-101e-4a9f-a78b-02d57410e3ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:48.989604 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86338db-101e-4a9f-a78b-02d57410e3ba service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:49.015042 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 883/1758] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:49:49.016829 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86338db-101e-4a9f-a78b-02d57410e3ba service neutron] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:49.042068 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86338db-101e-4a9f-a78b-02d57410e3ba service neutron] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:49.048124 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 876/1759] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:49.050415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0c308-cf84-4a27-8980-27f7b721b944 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:49.052475 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0c308-cf84-4a27-8980-27f7b721b944 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:49.052922 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0c308-cf84-4a27-8980-27f7b721b944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:49.053416 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f95be2-9a00-4d4d-902c-5c989925aeda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:49.054107 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f95be2-9a00-4d4d-902c-5c989925aeda admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:49.054476 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f95be2-9a00-4d4d-902c-5c989925aeda admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:49.054841 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f95be2-9a00-4d4d-902c-5c989925aeda admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:49.055588 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f95be2-9a00-4d4d-902c-5c989925aeda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:49.059455 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f95be2-9a00-4d4d-902c-5c989925aeda admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:49.075686 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 884/1760] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:49.077020 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f95be2-9a00-4d4d-902c-5c989925aeda admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:49.104106 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f95be2-9a00-4d4d-902c-5c989925aeda admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:49.112579 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-cfd0c308-cf84-4a27-8980-27f7b721b944 None None] MFA Rules not processed for user `087c0311906a4987b294729706a08810`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:49.114885 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f7938-17b9-4f41-bfaa-71f58a3f7954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:49.115696 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f7938-17b9-4f41-bfaa-71f58a3f7954 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:49.115948 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-cfd0c308-cf84-4a27-8980-27f7b721b944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:49.116136 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f7938-17b9-4f41-bfaa-71f58a3f7954 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:49.116501 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f7938-17b9-4f41-bfaa-71f58a3f7954 admin admin] PATH_INFO: `/v3/projects/f5f140dfaefc4d928a54baedbfb81623/users/af6a4c88394d493686b33d6910876e4f/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:49.142683 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 877/1761] 10.222.0.72 () {58 vars in 1015 bytes} [Wed Aug 24 04:49:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:49.143873 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0c308-cf84-4a27-8980-27f7b721b944 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:49.157236 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f7938-17b9-4f41-bfaa-71f58a3f7954 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5f140dfaefc4d928a54baedbfb81623, user_id=af6a4c88394d493686b33d6910876e4f, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:49.165289 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f7938-17b9-4f41-bfaa-71f58a3f7954 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:49.174048 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0c308-cf84-4a27-8980-27f7b721b944 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:49.190443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f817f4-ad1e-47de-87c4-2319473c2716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:49.194753 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f817f4-ad1e-47de-87c4-2319473c2716 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:49.197267 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 885/1762] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:49:49 2022] PUT /identity/v3/projects/f5f140dfaefc4d928a54baedbfb81623/users/af6a4c88394d493686b33d6910876e4f/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:49.197773 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f817f4-ad1e-47de-87c4-2319473c2716 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:49.198199 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f817f4-ad1e-47de-87c4-2319473c2716 admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:49.199027 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f817f4-ad1e-47de-87c4-2319473c2716 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:49.203545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f817f4-ad1e-47de-87c4-2319473c2716 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:49.204752 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f7938-17b9-4f41-bfaa-71f58a3f7954 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:49.305324 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 878/1763] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:49:49 2022] POST /identity/v3/projects => generated 367 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:49.309587 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f817f4-ad1e-47de-87c4-2319473c2716 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:49.476882 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f7938-17b9-4f41-bfaa-71f58a3f7954 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:49.541276 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f817f4-ad1e-47de-87c4-2319473c2716 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:49.555857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a40ed-f5d9-4161-bee9-6f420812fe85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:49.567260 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a40ed-f5d9-4161-bee9-6f420812fe85 service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:49.567664 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a40ed-f5d9-4161-bee9-6f420812fe85 service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:49.567941 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a40ed-f5d9-4161-bee9-6f420812fe85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:49.588872 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a40ed-f5d9-4161-bee9-6f420812fe85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:49.590379 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a40ed-f5d9-4161-bee9-6f420812fe85 service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:49.636095 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 879/1764] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:49:49.659108 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f7290-d224-4355-8f06-4bad802dffb7 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:49.659221 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f7290-d224-4355-8f06-4bad802dffb7 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:49.659577 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f7290-d224-4355-8f06-4bad802dffb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:49.697783 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:49.720788 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711dbbec-4573-4c3c-a84e-276d82ff810e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:49.721588 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dbbec-4573-4c3c-a84e-276d82ff810e admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:49.721920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dbbec-4573-4c3c-a84e-276d82ff810e admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:49.722194 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dbbec-4573-4c3c-a84e-276d82ff810e admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:49.723929 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711dbbec-4573-4c3c-a84e-276d82ff810e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:49.727608 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711dbbec-4573-4c3c-a84e-276d82ff810e admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:49.734462 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:49.741249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-ff6f7290-d224-4355-8f06-4bad802dffb7 None None] MFA Rules not processed for user `af6a4c88394d493686b33d6910876e4f`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:49.745388 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-ff6f7290-d224-4355-8f06-4bad802dffb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:49.752466 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 886/1765] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 548 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:49.755899 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711dbbec-4573-4c3c-a84e-276d82ff810e admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:49.783724 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711dbbec-4573-4c3c-a84e-276d82ff810e admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:49.800151 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b51e35-e2d3-4cec-ae83-226b9221b286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:49.803767 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b51e35-e2d3-4cec-ae83-226b9221b286 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:49.804092 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b51e35-e2d3-4cec-ae83-226b9221b286 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:49.804373 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b51e35-e2d3-4cec-ae83-226b9221b286 admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:49.805022 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b51e35-e2d3-4cec-ae83-226b9221b286 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:49.818215 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b51e35-e2d3-4cec-ae83-226b9221b286 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:49.901398 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 887/1766] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:49:49 2022] POST /identity/v3/users => generated 290 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:49.910950 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b51e35-e2d3-4cec-ae83-226b9221b286 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:49.961857 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b51e35-e2d3-4cec-ae83-226b9221b286 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:49.986244 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9bea8-9983-43ff-8ea4-f5bf36a28a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:49.993624 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9bea8-9983-43ff-8ea4-f5bf36a28a3e admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:49.994315 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9bea8-9983-43ff-8ea4-f5bf36a28a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:49.998411 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9bea8-9983-43ff-8ea4-f5bf36a28a3e admin admin] PATH_INFO: `/v3/projects/e0680aa9d58045b1a866e6b00d45e746/users/754fd89e0ed640fe80b564abc99c4fba/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:50.039726 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 880/1767] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:50.039726 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f7290-d224-4355-8f06-4bad802dffb7 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:50.068498 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f7290-d224-4355-8f06-4bad802dffb7 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:50.080371 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7f054-cb1d-4649-9aaa-00fe9364c377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:50.081016 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7f054-cb1d-4649-9aaa-00fe9364c377 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:50.081506 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7f054-cb1d-4649-9aaa-00fe9364c377 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:50.081813 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7f054-cb1d-4649-9aaa-00fe9364c377 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:50.082544 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7f054-cb1d-4649-9aaa-00fe9364c377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:50.086572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7f054-cb1d-4649-9aaa-00fe9364c377 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:50.097677 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9bea8-9983-43ff-8ea4-f5bf36a28a3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0680aa9d58045b1a866e6b00d45e746, user_id=754fd89e0ed640fe80b564abc99c4fba, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:50.100627 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9bea8-9983-43ff-8ea4-f5bf36a28a3e admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:50.116797 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 881/1768] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:50.117137 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7f054-cb1d-4649-9aaa-00fe9364c377 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:50.120933 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-6ed7f054-cb1d-4649-9aaa-00fe9364c377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:50.148006 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 888/1769] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:49:49 2022] PUT /identity/v3/projects/e0680aa9d58045b1a866e6b00d45e746/users/754fd89e0ed640fe80b564abc99c4fba/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:50.148866 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9bea8-9983-43ff-8ea4-f5bf36a28a3e admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:50.156911 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7f054-cb1d-4649-9aaa-00fe9364c377 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:50.362222 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85666756-da1a-4a74-b414-a4258572a39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:50.362954 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85666756-da1a-4a74-b414-a4258572a39d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:50.363272 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85666756-da1a-4a74-b414-a4258572a39d admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:50.363584 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85666756-da1a-4a74-b414-a4258572a39d admin admin] PATH_INFO: `/v3/projects/0b96014e6576444da06022077ae59013` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:50.367823 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85666756-da1a-4a74-b414-a4258572a39d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b96014e6576444da06022077ae59013)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:50.369823 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85666756-da1a-4a74-b414-a4258572a39d admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:50.374590 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9bea8-9983-43ff-8ea4-f5bf36a28a3e admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:50.404189 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763c145-eb6f-4e33-af5b-5104d79e8e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:50.405268 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763c145-eb6f-4e33-af5b-5104d79e8e51 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:50.405588 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763c145-eb6f-4e33-af5b-5104d79e8e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:50.405862 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763c145-eb6f-4e33-af5b-5104d79e8e51 admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:50.406505 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763c145-eb6f-4e33-af5b-5104d79e8e51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:50.408470 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763c145-eb6f-4e33-af5b-5104d79e8e51 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:50.546313 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 889/1770] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:49:50 2022] POST /identity/v3/projects => generated 365 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:50.547347 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763c145-eb6f-4e33-af5b-5104d79e8e51 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:50.562662 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-85666756-da1a-4a74-b414-a4258572a39d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b96014e6576444da06022077ae59013', 'request_id': 'req-85666756-da1a-4a74-b414-a4258572a39d'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:50.610147 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-85666756-da1a-4a74-b414-a4258572a39d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b96014e6576444da06022077ae59013', 'request_id': 'req-85666756-da1a-4a74-b414-a4258572a39d'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:50.630899 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-85666756-da1a-4a74-b414-a4258572a39d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b96014e6576444da06022077ae59013', 'request_id': 'req-85666756-da1a-4a74-b414-a4258572a39d'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:50.658379 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-85666756-da1a-4a74-b414-a4258572a39d admin admin] The token cache is being invalidate because project 0b96014e6576444da06022077ae59013 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:49:50.658379 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-85666756-da1a-4a74-b414-a4258572a39d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:50.660720 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-85666756-da1a-4a74-b414-a4258572a39d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:50.668757 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 882/1771] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:49:50 2022] DELETE /identity/v3/projects/0b96014e6576444da06022077ae59013 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:50.670416 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83f586-d22f-442a-b7ae-8f4ca93efe72 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:50.671761 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83f586-d22f-442a-b7ae-8f4ca93efe72 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:50.672049 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83f586-d22f-442a-b7ae-8f4ca93efe72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:50.737273 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-1b83f586-d22f-442a-b7ae-8f4ca93efe72 None None] MFA Rules not processed for user `754fd89e0ed640fe80b564abc99c4fba`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:50.743501 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-1b83f586-d22f-442a-b7ae-8f4ca93efe72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:50.786644 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:50.811938 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763c145-eb6f-4e33-af5b-5104d79e8e51 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:50.836149 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff28f2-fc39-4188-a69f-36515441946f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:50.836891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff28f2-fc39-4188-a69f-36515441946f admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:50.837175 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff28f2-fc39-4188-a69f-36515441946f admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:50.837485 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff28f2-fc39-4188-a69f-36515441946f admin admin] PATH_INFO: `/v3/projects/4379a7b8e15e437885d3143b5ee731ab/users/7de4c7eb997a4d8a907b1bbc8d64d020/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:50.897104 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff28f2-fc39-4188-a69f-36515441946f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4379a7b8e15e437885d3143b5ee731ab, user_id=7de4c7eb997a4d8a907b1bbc8d64d020, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:50.911540 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff28f2-fc39-4188-a69f-36515441946f admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:50.951193 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 883/1772] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:50 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:50.951193 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83f586-d22f-442a-b7ae-8f4ca93efe72 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:50.952171 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-1b83f586-d22f-442a-b7ae-8f4ca93efe72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:50.960471 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 890/1773] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:49:50 2022] PUT /identity/v3/projects/4379a7b8e15e437885d3143b5ee731ab/users/7de4c7eb997a4d8a907b1bbc8d64d020/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:50.962624 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff28f2-fc39-4188-a69f-36515441946f admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:50.967084 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-faff28f2-fc39-4188-a69f-36515441946f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:51.013004 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:51.035900 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83f586-d22f-442a-b7ae-8f4ca93efe72 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:51.162712 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff28f2-fc39-4188-a69f-36515441946f admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:51.168987 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4dab4-4412-4988-a4b4-f174ec57c36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:51.170268 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4dab4-4412-4988-a4b4-f174ec57c36f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:51.170751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4dab4-4412-4988-a4b4-f174ec57c36f admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:51.171032 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4dab4-4412-4988-a4b4-f174ec57c36f admin admin] PATH_INFO: `/v3/users/e3a6064cfd42438ba1eb6bc0b7e9a386` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:51.172210 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a4dab4-4412-4988-a4b4-f174ec57c36f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3a6064cfd42438ba1eb6bc0b7e9a386)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:51.174558 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a4dab4-4412-4988-a4b4-f174ec57c36f admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:51.263623 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011dccd1-8ebb-4861-9dec-cd53289d65b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:51.264678 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dccd1-8ebb-4861-9dec-cd53289d65b4 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:51.264982 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dccd1-8ebb-4861-9dec-cd53289d65b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:51.266373 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dccd1-8ebb-4861-9dec-cd53289d65b4 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:51.268148 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011dccd1-8ebb-4861-9dec-cd53289d65b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:51.270624 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011dccd1-8ebb-4861-9dec-cd53289d65b4 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:51.334720 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-98a4dab4-4412-4988-a4b4-f174ec57c36f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3a6064cfd42438ba1eb6bc0b7e9a386'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:51.337462 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-98a4dab4-4412-4988-a4b4-f174ec57c36f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3a6064cfd42438ba1eb6bc0b7e9a386'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:51.339335 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-98a4dab4-4412-4988-a4b4-f174ec57c36f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3a6064cfd42438ba1eb6bc0b7e9a386'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:51.355003 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 884/1774] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:49:50 2022] POST /identity/v3/users => generated 289 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:51.359756 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011dccd1-8ebb-4861-9dec-cd53289d65b4 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:51.362545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-011dccd1-8ebb-4861-9dec-cd53289d65b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:51.383167 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-98a4dab4-4412-4988-a4b4-f174ec57c36f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3a6064cfd42438ba1eb6bc0b7e9a386'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:51.400693 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011dccd1-8ebb-4861-9dec-cd53289d65b4 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:51.403419 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-98a4dab4-4412-4988-a4b4-f174ec57c36f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3a6064cfd42438ba1eb6bc0b7e9a386'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:51.434145 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d283a-0ebc-4cbe-8c1f-b93b52a86eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:51.437025 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d283a-0ebc-4cbe-8c1f-b93b52a86eba admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:51.438592 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d283a-0ebc-4cbe-8c1f-b93b52a86eba admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:51.443621 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d283a-0ebc-4cbe-8c1f-b93b52a86eba admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:51.447102 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d283a-0ebc-4cbe-8c1f-b93b52a86eba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:51.455514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d283a-0ebc-4cbe-8c1f-b93b52a86eba admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:51.470651 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 891/1775] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:49:50 2022] DELETE /identity/v3/users/e3a6064cfd42438ba1eb6bc0b7e9a386 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:51.472355 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4dab4-4412-4988-a4b4-f174ec57c36f admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:51.478282 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-98a4dab4-4412-4988-a4b4-f174ec57c36f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:51.535592 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 885/1776] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:49:51 2022] POST /identity/v3/projects => generated 405 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:51.537467 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d283a-0ebc-4cbe-8c1f-b93b52a86eba admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:51.541968 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-867d283a-0ebc-4cbe-8c1f-b93b52a86eba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:51.674983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d283a-0ebc-4cbe-8c1f-b93b52a86eba admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:51.681478 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f54fcc-1ef1-4c04-b8ed-7cb12300a8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:51.682111 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f54fcc-1ef1-4c04-b8ed-7cb12300a8bb admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:51.682436 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f54fcc-1ef1-4c04-b8ed-7cb12300a8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:51.682884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f54fcc-1ef1-4c04-b8ed-7cb12300a8bb admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:51.684410 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f54fcc-1ef1-4c04-b8ed-7cb12300a8bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:51.687045 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f54fcc-1ef1-4c04-b8ed-7cb12300a8bb admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:51.704533 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a4dab4-4412-4988-a4b4-f174ec57c36f admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:51.713281 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 886/1777] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:51.715686 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f54fcc-1ef1-4c04-b8ed-7cb12300a8bb admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:51.717684 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405836ca-e1ef-41ab-8324-8960850cd47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:51.720339 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405836ca-e1ef-41ab-8324-8960850cd47c admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:51.720967 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405836ca-e1ef-41ab-8324-8960850cd47c admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:51.721688 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405836ca-e1ef-41ab-8324-8960850cd47c admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:51.723022 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405836ca-e1ef-41ab-8324-8960850cd47c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:51.729830 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405836ca-e1ef-41ab-8324-8960850cd47c admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:51.740955 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f54fcc-1ef1-4c04-b8ed-7cb12300a8bb admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:51.758511 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef698f82-02d8-49e9-b9d4-b4a1a2405d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:51.759148 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef698f82-02d8-49e9-b9d4-b4a1a2405d6e admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:51.759427 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef698f82-02d8-49e9-b9d4-b4a1a2405d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:51.759698 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef698f82-02d8-49e9-b9d4-b4a1a2405d6e admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:51.760337 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef698f82-02d8-49e9-b9d4-b4a1a2405d6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:51.762385 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef698f82-02d8-49e9-b9d4-b4a1a2405d6e admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:51.796177 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 892/1778] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:51.796989 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:51.798841 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405836ca-e1ef-41ab-8324-8960850cd47c admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:51.816942 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 887/1779] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:49:51 2022] POST /identity/v3/users => generated 309 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:51.817982 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef698f82-02d8-49e9-b9d4-b4a1a2405d6e admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:51.826090 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405836ca-e1ef-41ab-8324-8960850cd47c admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:51.856480 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15eb8c3-a822-49ec-a8c2-608ac55c2f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:51.857535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15eb8c3-a822-49ec-a8c2-608ac55c2f43 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:51.858667 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15eb8c3-a822-49ec-a8c2-608ac55c2f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:51.859697 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15eb8c3-a822-49ec-a8c2-608ac55c2f43 admin admin] PATH_INFO: `/v3/projects/00a99a0e19d744058f3f53bcb23f506b/users/2e5b82a0a33c4bf8ac67ff5736b8fab2/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:51.873040 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef698f82-02d8-49e9-b9d4-b4a1a2405d6e admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:51.884910 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15eb8c3-a822-49ec-a8c2-608ac55c2f43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00a99a0e19d744058f3f53bcb23f506b, user_id=2e5b82a0a33c4bf8ac67ff5736b8fab2, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:51.889617 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15eb8c3-a822-49ec-a8c2-608ac55c2f43 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:51.893688 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757c9a1-a3f3-4dcb-9685-244eeb6a523d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:51.894499 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757c9a1-a3f3-4dcb-9685-244eeb6a523d admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:51.896666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757c9a1-a3f3-4dcb-9685-244eeb6a523d admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:51.896971 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757c9a1-a3f3-4dcb-9685-244eeb6a523d admin admin] PATH_INFO: `/v3/projects/4379a7b8e15e437885d3143b5ee731ab/users/7de4c7eb997a4d8a907b1bbc8d64d020/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:51.902617 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757c9a1-a3f3-4dcb-9685-244eeb6a523d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4379a7b8e15e437885d3143b5ee731ab, user_id=7de4c7eb997a4d8a907b1bbc8d64d020, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:51.906374 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757c9a1-a3f3-4dcb-9685-244eeb6a523d admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:51.911709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 893/1780] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:49:51 2022] PUT /identity/v3/projects/00a99a0e19d744058f3f53bcb23f506b/users/2e5b82a0a33c4bf8ac67ff5736b8fab2/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:51.912919 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15eb8c3-a822-49ec-a8c2-608ac55c2f43 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:51.928408 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:51.957385 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 888/1781] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:49:51 2022] PUT /identity/v3/projects/4379a7b8e15e437885d3143b5ee731ab/users/7de4c7eb997a4d8a907b1bbc8d64d020/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:51.957385 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757c9a1-a3f3-4dcb-9685-244eeb6a523d admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:52.120493 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15eb8c3-a822-49ec-a8c2-608ac55c2f43 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:52.157840 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757c9a1-a3f3-4dcb-9685-244eeb6a523d admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:52.187656 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43329992-c77d-4818-a8ee-b206d4793bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:52.193000 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43329992-c77d-4818-a8ee-b206d4793bde admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:52.195698 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43329992-c77d-4818-a8ee-b206d4793bde admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:52.196665 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43329992-c77d-4818-a8ee-b206d4793bde admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:52.199864 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43329992-c77d-4818-a8ee-b206d4793bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:52.203545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43329992-c77d-4818-a8ee-b206d4793bde admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:52.234179 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcca5cb-c5ea-4856-8318-9a112974bef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:52.235131 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcca5cb-c5ea-4856-8318-9a112974bef9 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:52.235484 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcca5cb-c5ea-4856-8318-9a112974bef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:52.235760 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcca5cb-c5ea-4856-8318-9a112974bef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:52.236478 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcca5cb-c5ea-4856-8318-9a112974bef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:52.238344 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcca5cb-c5ea-4856-8318-9a112974bef9 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:52.254513 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 889/1782] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:52.254896 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 894/1783] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:52.256331 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43329992-c77d-4818-a8ee-b206d4793bde admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:52.256526 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ac060-3913-4e85-bb24-77eaa22bfc05 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:52.256789 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ac060-3913-4e85-bb24-77eaa22bfc05 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:52.257188 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ac060-3913-4e85-bb24-77eaa22bfc05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:52.284521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43329992-c77d-4818-a8ee-b206d4793bde admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:52.297856 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-c01ac060-3913-4e85-bb24-77eaa22bfc05 None None] MFA Rules not processed for user `7de4c7eb997a4d8a907b1bbc8d64d020`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:52.299192 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-c01ac060-3913-4e85-bb24-77eaa22bfc05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:52.308715 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69750a6-0b00-4160-8018-49f0ce45162a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:52.321416 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69750a6-0b00-4160-8018-49f0ce45162a admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:52.325899 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69750a6-0b00-4160-8018-49f0ce45162a admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:52.327467 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69750a6-0b00-4160-8018-49f0ce45162a admin admin] PATH_INFO: `/v3/projects/00a99a0e19d744058f3f53bcb23f506b/users/2e5b82a0a33c4bf8ac67ff5736b8fab2/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:52.334425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69750a6-0b00-4160-8018-49f0ce45162a admin admin] RBAC: Authorizing `identity:create_grant(project_id=00a99a0e19d744058f3f53bcb23f506b, user_id=2e5b82a0a33c4bf8ac67ff5736b8fab2, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:52.348347 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69750a6-0b00-4160-8018-49f0ce45162a admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:52.391118 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 890/1784] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:49:52 2022] PUT /identity/v3/projects/00a99a0e19d744058f3f53bcb23f506b/users/2e5b82a0a33c4bf8ac67ff5736b8fab2/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:52.402406 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69750a6-0b00-4160-8018-49f0ce45162a admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:52.418148 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 895/1785] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:52.425550 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dacae-5e2c-442c-b257-f6b90abb2e7a None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:52.425964 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dacae-5e2c-442c-b257-f6b90abb2e7a None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:52.426245 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dacae-5e2c-442c-b257-f6b90abb2e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:52.466602 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-e24dacae-5e2c-442c-b257-f6b90abb2e7a None None] MFA Rules not processed for user `2e5b82a0a33c4bf8ac67ff5736b8fab2`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:52.468296 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-e24dacae-5e2c-442c-b257-f6b90abb2e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:52.496111 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:52.564444 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 896/1786] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:52 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:52.565629 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24dacae-5e2c-442c-b257-f6b90abb2e7a None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:52.567202 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-e24dacae-5e2c-442c-b257-f6b90abb2e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:52.709227 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69750a6-0b00-4160-8018-49f0ce45162a admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:52.721033 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24dacae-5e2c-442c-b257-f6b90abb2e7a None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:52.732350 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684e32e-3497-4546-82b6-bc54b19570f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:52.733871 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684e32e-3497-4546-82b6-bc54b19570f7 service cinder] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:52.734308 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684e32e-3497-4546-82b6-bc54b19570f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:52.742127 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684e32e-3497-4546-82b6-bc54b19570f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:52.747768 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec901a13-d79b-43f2-a7e8-d24e91949cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:52.748467 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec901a13-d79b-43f2-a7e8-d24e91949cc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:52.748749 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec901a13-d79b-43f2-a7e8-d24e91949cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:52.749022 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec901a13-d79b-43f2-a7e8-d24e91949cc8 admin admin] PATH_INFO: `/v3/projects/c08d0123c96646a6b39799cc456e6726/users/d2327ba713544b35836ec1e464d21e89/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:52.795447 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec901a13-d79b-43f2-a7e8-d24e91949cc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c08d0123c96646a6b39799cc456e6726, user_id=d2327ba713544b35836ec1e464d21e89, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:52.803298 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec901a13-d79b-43f2-a7e8-d24e91949cc8 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:52.874831 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 891/1787] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:49:52 2022] PUT /identity/v3/projects/c08d0123c96646a6b39799cc456e6726/users/d2327ba713544b35836ec1e464d21e89/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:52.879429 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec901a13-d79b-43f2-a7e8-d24e91949cc8 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:52.955456 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684e32e-3497-4546-82b6-bc54b19570f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:52.957164 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684e32e-3497-4546-82b6-bc54b19570f7 service cinder] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:52.969974 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 897/1788] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:52 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:49:52.971101 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684e32e-3497-4546-82b6-bc54b19570f7 service cinder] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:52.972796 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-c684e32e-3497-4546-82b6-bc54b19570f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:52.998359 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684e32e-3497-4546-82b6-bc54b19570f7 service cinder] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:53.082456 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:53.099324 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec901a13-d79b-43f2-a7e8-d24e91949cc8 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:53.106984 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa56ddd-2ac7-46ab-9c96-39f4bfdf253f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:53.107753 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa56ddd-2ac7-46ab-9c96-39f4bfdf253f admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:53.108235 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa56ddd-2ac7-46ab-9c96-39f4bfdf253f admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:53.108796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa56ddd-2ac7-46ab-9c96-39f4bfdf253f admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:53.109659 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa56ddd-2ac7-46ab-9c96-39f4bfdf253f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:53.111677 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa56ddd-2ac7-46ab-9c96-39f4bfdf253f admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:53.165791 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 892/1789] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:53.167156 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379782d-77f1-4d52-b8a8-b1e6297f109a None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:53.171624 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379782d-77f1-4d52-b8a8-b1e6297f109a None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:53.172081 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379782d-77f1-4d52-b8a8-b1e6297f109a None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:53.176422 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 893/1790] 10.222.0.49 () {54 vars in 921 bytes} [Wed Aug 24 04:49:53 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:49:53.182839 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379782d-77f1-4d52-b8a8-b1e6297f109a None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:53.224847 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c0601-b61f-4728-af81-ca943be7d61e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:53.225534 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379782d-77f1-4d52-b8a8-b1e6297f109a None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:53.231940 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc79af4-2f38-4d61-8057-3183b6e49de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:53.238851 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc79af4-2f38-4d61-8057-3183b6e49de1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:53.238851 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc79af4-2f38-4d61-8057-3183b6e49de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:53.238851 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc79af4-2f38-4d61-8057-3183b6e49de1 admin admin] PATH_INFO: `/v3/projects/c08d0123c96646a6b39799cc456e6726/users/d2327ba713544b35836ec1e464d21e89/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:53.242091 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc79af4-2f38-4d61-8057-3183b6e49de1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c08d0123c96646a6b39799cc456e6726, user_id=d2327ba713544b35836ec1e464d21e89, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:53.245115 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc79af4-2f38-4d61-8057-3183b6e49de1 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:53.254696 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c0601-b61f-4728-af81-ca943be7d61e service cinder] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:53.255851 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c0601-b61f-4728-af81-ca943be7d61e service cinder] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:53.256573 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c0601-b61f-4728-af81-ca943be7d61e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:53.297418 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 894/1791] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:49:53 2022] PUT /identity/v3/projects/c08d0123c96646a6b39799cc456e6726/users/d2327ba713544b35836ec1e464d21e89/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:53.297418 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240d908-dd46-4bc4-bcc6-92bec4f01ee9 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:53.297418 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240d908-dd46-4bc4-bcc6-92bec4f01ee9 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:53.303454 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240d908-dd46-4bc4-bcc6-92bec4f01ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:53.330024 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:53.372481 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-e240d908-dd46-4bc4-bcc6-92bec4f01ee9 None None] MFA Rules not processed for user `9dc9a3cf381e4a2da36ed82b407a2d94`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:53.373850 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-e240d908-dd46-4bc4-bcc6-92bec4f01ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:53.506007 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c0601-b61f-4728-af81-ca943be7d61e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:53.511712 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c0601-b61f-4728-af81-ca943be7d61e service cinder] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:53.527206 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 898/1792] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:52 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:49:53.528286 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c0601-b61f-4728-af81-ca943be7d61e service cinder] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:53.531694 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-4f2c0601-b61f-4728-af81-ca943be7d61e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:53.551337 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 895/1793] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Aug 24 04:49:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:53.553540 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882798d7-d85b-45a4-b0bf-ad41764f0ed3 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:53.553540 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882798d7-d85b-45a4-b0bf-ad41764f0ed3 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:53.554178 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882798d7-d85b-45a4-b0bf-ad41764f0ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:53.568019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c0601-b61f-4728-af81-ca943be7d61e service cinder] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:53.638048 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-882798d7-d85b-45a4-b0bf-ad41764f0ed3 None None] MFA Rules not processed for user `d2327ba713544b35836ec1e464d21e89`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:53.639362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-882798d7-d85b-45a4-b0bf-ad41764f0ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:53.733626 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df694b2-72e2-4074-9c11-0b8b8ff423fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:53.734362 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df694b2-72e2-4074-9c11-0b8b8ff423fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:53.742430 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df694b2-72e2-4074-9c11-0b8b8ff423fe admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:53.742430 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df694b2-72e2-4074-9c11-0b8b8ff423fe admin admin] PATH_INFO: `/v3/projects/e26f8bb71df74d80ab232b73441eb2a0` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:53.742430 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df694b2-72e2-4074-9c11-0b8b8ff423fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=e26f8bb71df74d80ab232b73441eb2a0)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:53.742855 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 896/1794] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:53 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:53.742855 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f551df-2c11-412b-978c-d7225bae1d7b None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:53.742855 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f551df-2c11-412b-978c-d7225bae1d7b None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:53.742855 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f551df-2c11-412b-978c-d7225bae1d7b None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:53.744146 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 897/1795] 10.222.0.49 () {54 vars in 921 bytes} [Wed Aug 24 04:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:49:53.744857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f551df-2c11-412b-978c-d7225bae1d7b None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:53.746720 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-a9f551df-2c11-412b-978c-d7225bae1d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:53.754839 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df694b2-72e2-4074-9c11-0b8b8ff423fe admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:53.768870 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f551df-2c11-412b-978c-d7225bae1d7b None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:53.780515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caddc7d-2bda-4a40-b25d-1b502d1f8d54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:53.781322 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caddc7d-2bda-4a40-b25d-1b502d1f8d54 service nova] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:53.781861 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caddc7d-2bda-4a40-b25d-1b502d1f8d54 service nova] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:53.782123 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caddc7d-2bda-4a40-b25d-1b502d1f8d54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:53.793151 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caddc7d-2bda-4a40-b25d-1b502d1f8d54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:53.794869 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caddc7d-2bda-4a40-b25d-1b502d1f8d54 service nova] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:53.808823 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 898/1796] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:49:53.810347 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caddc7d-2bda-4a40-b25d-1b502d1f8d54 service nova] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:53.839399 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-4df694b2-72e2-4074-9c11-0b8b8ff423fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e26f8bb71df74d80ab232b73441eb2a0', 'request_id': 'req-4df694b2-72e2-4074-9c11-0b8b8ff423fe'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:53.849848 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-4df694b2-72e2-4074-9c11-0b8b8ff423fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e26f8bb71df74d80ab232b73441eb2a0', 'request_id': 'req-4df694b2-72e2-4074-9c11-0b8b8ff423fe'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:53.860043 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-4df694b2-72e2-4074-9c11-0b8b8ff423fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e26f8bb71df74d80ab232b73441eb2a0', 'request_id': 'req-4df694b2-72e2-4074-9c11-0b8b8ff423fe'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:53.875162 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-4df694b2-72e2-4074-9c11-0b8b8ff423fe admin admin] The token cache is being invalidate because project e26f8bb71df74d80ab232b73441eb2a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:49:53.875517 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-4df694b2-72e2-4074-9c11-0b8b8ff423fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:53.876399 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-4df694b2-72e2-4074-9c11-0b8b8ff423fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:53.881563 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 899/1797] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:49:53 2022] DELETE /identity/v3/projects/e26f8bb71df74d80ab232b73441eb2a0 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:53.883912 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9e2d8-4421-4cba-9109-246c3e19d8f9 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:53.884205 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9e2d8-4421-4cba-9109-246c3e19d8f9 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:53.884479 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9e2d8-4421-4cba-9109-246c3e19d8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:53.887912 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:53.907756 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-88d9e2d8-4421-4cba-9109-246c3e19d8f9 None None] MFA Rules not processed for user `9dc9a3cf381e4a2da36ed82b407a2d94`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:53.908959 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-88d9e2d8-4421-4cba-9109-246c3e19d8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:53.924791 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caddc7d-2bda-4a40-b25d-1b502d1f8d54 service nova] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:53.983199 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:54.019669 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 900/1798] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Aug 24 04:49:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:54.020813 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9e2d8-4421-4cba-9109-246c3e19d8f9 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:54.022788 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-88d9e2d8-4421-4cba-9109-246c3e19d8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:54.030431 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee706a0-ee37-4c55-a6e4-24ac817e0a53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:54.031187 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee706a0-ee37-4c55-a6e4-24ac817e0a53 service cinder] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:54.031528 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee706a0-ee37-4c55-a6e4-24ac817e0a53 service cinder] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:54.031862 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee706a0-ee37-4c55-a6e4-24ac817e0a53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:54.033746 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-2ee706a0-ee37-4c55-a6e4-24ac817e0a53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:54.037978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9e2d8-4421-4cba-9109-246c3e19d8f9 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:54.044796 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736b962e-d37d-4ddc-889d-a0ecb0f7d7f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:54.045772 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b962e-d37d-4ddc-889d-a0ecb0f7d7f7 service cinder] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:54.046268 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b962e-d37d-4ddc-889d-a0ecb0f7d7f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:54.046723 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b962e-d37d-4ddc-889d-a0ecb0f7d7f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:54.049025 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-736b962e-d37d-4ddc-889d-a0ecb0f7d7f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:54.167421 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b962e-d37d-4ddc-889d-a0ecb0f7d7f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:54.171467 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736b962e-d37d-4ddc-889d-a0ecb0f7d7f7 service cinder] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:54.191624 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 901/1799] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:54 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:49:54.193034 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1db292-ffe1-463a-ae72-7e3ec316767c None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:54.193454 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1db292-ffe1-463a-ae72-7e3ec316767c None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:54.193832 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1db292-ffe1-463a-ae72-7e3ec316767c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:54.226400 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-0d1db292-ffe1-463a-ae72-7e3ec316767c None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:54.229656 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-0d1db292-ffe1-463a-ae72-7e3ec316767c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:54.236710 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee706a0-ee37-4c55-a6e4-24ac817e0a53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:54.238826 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee706a0-ee37-4c55-a6e4-24ac817e0a53 service cinder] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:54.261180 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 899/1800] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:49:54.264843 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee706a0-ee37-4c55-a6e4-24ac817e0a53 service cinder] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:54.273140 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-2ee706a0-ee37-4c55-a6e4-24ac817e0a53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:54.346400 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee706a0-ee37-4c55-a6e4-24ac817e0a53 service cinder] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:54.381157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f5673-8d20-4829-88b6-d94986f465c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:54.383892 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f5673-8d20-4829-88b6-d94986f465c8 service nova] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:54.383892 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f5673-8d20-4829-88b6-d94986f465c8 service nova] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:54.384556 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f5673-8d20-4829-88b6-d94986f465c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:54.415735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f5673-8d20-4829-88b6-d94986f465c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:54.423551 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f5673-8d20-4829-88b6-d94986f465c8 service nova] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:54.449899 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 900/1801] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:49:54.459136 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82927377-1350-43dc-b9b3-9ea58df87bc5 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:54.459556 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82927377-1350-43dc-b9b3-9ea58df87bc5 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:54.460196 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82927377-1350-43dc-b9b3-9ea58df87bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:54.460791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 902/1802] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:54.528218 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-82927377-1350-43dc-b9b3-9ea58df87bc5 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:54.529538 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-82927377-1350-43dc-b9b3-9ea58df87bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:54.562582 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 901/1803] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:49:54.574063 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1db292-ffe1-463a-ae72-7e3ec316767c None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:54.593629 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1db292-ffe1-463a-ae72-7e3ec316767c None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:54.618449 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fee12c-9c79-42c6-9a0a-717e54df9f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:54.618449 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fee12c-9c79-42c6-9a0a-717e54df9f50 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:54.618449 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fee12c-9c79-42c6-9a0a-717e54df9f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:54.618449 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fee12c-9c79-42c6-9a0a-717e54df9f50 admin admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:54.627296 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fee12c-9c79-42c6-9a0a-717e54df9f50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:49:54.628477 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fee12c-9c79-42c6-9a0a-717e54df9f50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:54.629451 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fee12c-9c79-42c6-9a0a-717e54df9f50 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:54.685798 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82927377-1350-43dc-b9b3-9ea58df87bc5 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:54.687252 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 903/1804] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:49:54.708711 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82927377-1350-43dc-b9b3-9ea58df87bc5 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:54.727774 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90ab46-5018-4a6d-9877-b38f770bc697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:54.732050 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90ab46-5018-4a6d-9877-b38f770bc697 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:54.732580 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90ab46-5018-4a6d-9877-b38f770bc697 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:54.733755 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90ab46-5018-4a6d-9877-b38f770bc697 admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:54.734609 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b90ab46-5018-4a6d-9877-b38f770bc697 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:54.739555 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b90ab46-5018-4a6d-9877-b38f770bc697 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:54.780970 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fee12c-9c79-42c6-9a0a-717e54df9f50 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:54.782730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-16fee12c-9c79-42c6-9a0a-717e54df9f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:54.810897 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fee12c-9c79-42c6-9a0a-717e54df9f50 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:54.817072 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88867283-8292-4f78-a5c6-ecf5e5e8cd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:54.817757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88867283-8292-4f78-a5c6-ecf5e5e8cd32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:54.818168 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88867283-8292-4f78-a5c6-ecf5e5e8cd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:54.818452 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88867283-8292-4f78-a5c6-ecf5e5e8cd32 admin admin] PATH_INFO: `/v3/users/754fd89e0ed640fe80b564abc99c4fba` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:54.822813 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88867283-8292-4f78-a5c6-ecf5e5e8cd32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=754fd89e0ed640fe80b564abc99c4fba)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:54.824844 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88867283-8292-4f78-a5c6-ecf5e5e8cd32 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:54.949049 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 902/1805] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:49:54 2022] POST /identity/v3/projects => generated 373 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:49:54.952968 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90ab46-5018-4a6d-9877-b38f770bc697 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:54.982122 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-88867283-8292-4f78-a5c6-ecf5e5e8cd32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '754fd89e0ed640fe80b564abc99c4fba'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:54.987310 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-88867283-8292-4f78-a5c6-ecf5e5e8cd32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '754fd89e0ed640fe80b564abc99c4fba'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:54.989100 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-88867283-8292-4f78-a5c6-ecf5e5e8cd32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '754fd89e0ed640fe80b564abc99c4fba'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:55.010428 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:55.023612 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-88867283-8292-4f78-a5c6-ecf5e5e8cd32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '754fd89e0ed640fe80b564abc99c4fba'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:55.041261 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-88867283-8292-4f78-a5c6-ecf5e5e8cd32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '754fd89e0ed640fe80b564abc99c4fba'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:55.078798 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 904/1806] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:49:54 2022] DELETE /identity/v3/users/754fd89e0ed640fe80b564abc99c4fba => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:55.085136 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9964565-c63f-46d7-9e1e-32f6864e3aca None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:55.087547 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9964565-c63f-46d7-9e1e-32f6864e3aca None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:55.089759 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9964565-c63f-46d7-9e1e-32f6864e3aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:55.150654 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-f9964565-c63f-46d7-9e1e-32f6864e3aca None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:55.168709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-f9964565-c63f-46d7-9e1e-32f6864e3aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:55.199021 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90ab46-5018-4a6d-9877-b38f770bc697 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:55.230688 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:55.381748 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288662a-b71e-4515-9ff5-72dd71ea5bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:55.382390 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288662a-b71e-4515-9ff5-72dd71ea5bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:55.382808 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288662a-b71e-4515-9ff5-72dd71ea5bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:55.382955 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288662a-b71e-4515-9ff5-72dd71ea5bd1 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:55.383580 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288662a-b71e-4515-9ff5-72dd71ea5bd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:55.388212 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6288662a-b71e-4515-9ff5-72dd71ea5bd1 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:55.415168 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 905/1807] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:55.463694 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 903/1808] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:49:54 2022] POST /identity/v3/users => generated 287 bytes in 511 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:55.467803 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9964565-c63f-46d7-9e1e-32f6864e3aca None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:55.469452 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-f9964565-c63f-46d7-9e1e-32f6864e3aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:55.499084 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9964565-c63f-46d7-9e1e-32f6864e3aca None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:55.520508 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288662a-b71e-4515-9ff5-72dd71ea5bd1 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:55.522867 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-6288662a-b71e-4515-9ff5-72dd71ea5bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:55.526468 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd354a39-274f-4299-9fbf-f33e839cf428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:55.527104 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd354a39-274f-4299-9fbf-f33e839cf428 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:55.527407 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd354a39-274f-4299-9fbf-f33e839cf428 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:55.527657 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd354a39-274f-4299-9fbf-f33e839cf428 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:55.528332 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd354a39-274f-4299-9fbf-f33e839cf428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:55.542430 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd354a39-274f-4299-9fbf-f33e839cf428 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:55.590356 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 906/1809] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:49:55.591590 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd354a39-274f-4299-9fbf-f33e839cf428 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:55.640495 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd354a39-274f-4299-9fbf-f33e839cf428 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:55.657633 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee65c9-7bfa-41fd-80f5-fa7e2acc3a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:55.658508 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee65c9-7bfa-41fd-80f5-fa7e2acc3a1a admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:55.662802 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee65c9-7bfa-41fd-80f5-fa7e2acc3a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:55.663123 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee65c9-7bfa-41fd-80f5-fa7e2acc3a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:55.663890 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee65c9-7bfa-41fd-80f5-fa7e2acc3a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:55.672297 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee65c9-7bfa-41fd-80f5-fa7e2acc3a1a admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:55.712218 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288662a-b71e-4515-9ff5-72dd71ea5bd1 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:55.731794 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78dc8c7-8564-40b7-a31d-bbb61621b806 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:55.732695 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78dc8c7-8564-40b7-a31d-bbb61621b806 service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:55.733046 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78dc8c7-8564-40b7-a31d-bbb61621b806 service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:55.733570 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78dc8c7-8564-40b7-a31d-bbb61621b806 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:55.744149 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 907/1810] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:55.745409 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee65c9-7bfa-41fd-80f5-fa7e2acc3a1a admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:55.758885 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78dc8c7-8564-40b7-a31d-bbb61621b806 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:55.760406 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78dc8c7-8564-40b7-a31d-bbb61621b806 service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:55.784476 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 904/1811] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:49:55.786133 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee65c9-7bfa-41fd-80f5-fa7e2acc3a1a admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:55.795937 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78dc8c7-8564-40b7-a31d-bbb61621b806 service neutron] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:55.799445 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-c78dc8c7-8564-40b7-a31d-bbb61621b806 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:55.804901 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d04f185-87ed-4cb1-929f-1215bd8e5569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:55.806554 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04f185-87ed-4cb1-929f-1215bd8e5569 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:55.807041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04f185-87ed-4cb1-929f-1215bd8e5569 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:55.807522 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d04f185-87ed-4cb1-929f-1215bd8e5569 admin admin] PATH_INFO: `/v3/projects/d0d39424aef74199960476ab0058c0a9/users/2a2f0128458b4807af771d5ae2ca8694/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:55.834867 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04f185-87ed-4cb1-929f-1215bd8e5569 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0d39424aef74199960476ab0058c0a9, user_id=2a2f0128458b4807af771d5ae2ca8694, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:55.838829 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d04f185-87ed-4cb1-929f-1215bd8e5569 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:55.846098 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78dc8c7-8564-40b7-a31d-bbb61621b806 service neutron] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:55.858565 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6a802-9a90-4d0a-8233-1591d2a197b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:55.859270 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6a802-9a90-4d0a-8233-1591d2a197b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:55.859557 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6a802-9a90-4d0a-8233-1591d2a197b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:55.859837 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6a802-9a90-4d0a-8233-1591d2a197b5 admin admin] PATH_INFO: `/v3/users/af6a4c88394d493686b33d6910876e4f` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:55.865714 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6a802-9a90-4d0a-8233-1591d2a197b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af6a4c88394d493686b33d6910876e4f)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:55.867933 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6a802-9a90-4d0a-8233-1591d2a197b5 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:55.875624 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 908/1812] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:49:55 2022] PUT /identity/v3/projects/d0d39424aef74199960476ab0058c0a9/users/2a2f0128458b4807af771d5ae2ca8694/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:55.879027 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515866ae-f423-4649-9ce6-84e9032b3248 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:55.879383 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515866ae-f423-4649-9ce6-84e9032b3248 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:55.879579 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515866ae-f423-4649-9ce6-84e9032b3248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:55.946158 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-515866ae-f423-4649-9ce6-84e9032b3248 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:55.954120 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-515866ae-f423-4649-9ce6-84e9032b3248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:55.970118 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-60f6a802-9a90-4d0a-8233-1591d2a197b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af6a4c88394d493686b33d6910876e4f'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:55.971000 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-60f6a802-9a90-4d0a-8233-1591d2a197b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af6a4c88394d493686b33d6910876e4f'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:55.971735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-60f6a802-9a90-4d0a-8233-1591d2a197b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af6a4c88394d493686b33d6910876e4f'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:56.023487 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-60f6a802-9a90-4d0a-8233-1591d2a197b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af6a4c88394d493686b33d6910876e4f'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:56.039390 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-60f6a802-9a90-4d0a-8233-1591d2a197b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af6a4c88394d493686b33d6910876e4f'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:56.072195 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 905/1813] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:49:55 2022] DELETE /identity/v3/users/af6a4c88394d493686b33d6910876e4f => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:56.079390 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232dde1-fa33-4eb6-8e15-65fd38d3acae None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:56.079674 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232dde1-fa33-4eb6-8e15-65fd38d3acae None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:56.081698 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232dde1-fa33-4eb6-8e15-65fd38d3acae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:56.129072 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 909/1814] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:56.140359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-1232dde1-fa33-4eb6-8e15-65fd38d3acae None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:56.145459 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-1232dde1-fa33-4eb6-8e15-65fd38d3acae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:56.168975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515866ae-f423-4649-9ce6-84e9032b3248 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:56.175124 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-515866ae-f423-4649-9ce6-84e9032b3248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:56.195759 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:56.282088 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:56.363936 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515866ae-f423-4649-9ce6-84e9032b3248 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:56.395868 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 906/1815] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:49:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:56.432658 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232dde1-fa33-4eb6-8e15-65fd38d3acae None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:56.536511 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51969ae6-17ba-49c7-8168-d758647524fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:56.537523 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51969ae6-17ba-49c7-8168-d758647524fd service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:56.537945 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51969ae6-17ba-49c7-8168-d758647524fd service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:56.539316 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51969ae6-17ba-49c7-8168-d758647524fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:56.569678 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51969ae6-17ba-49c7-8168-d758647524fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:56.572384 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51969ae6-17ba-49c7-8168-d758647524fd service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:56.600934 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 910/1816] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:49:56.614783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232dde1-fa33-4eb6-8e15-65fd38d3acae None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:56.621318 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526ca2e-626b-4380-9bc5-76c23ed096a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:56.621318 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526ca2e-626b-4380-9bc5-76c23ed096a9 service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:56.621318 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526ca2e-626b-4380-9bc5-76c23ed096a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:56.621318 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4526ca2e-626b-4380-9bc5-76c23ed096a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:56.681448 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4526ca2e-626b-4380-9bc5-76c23ed096a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:56.686965 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4526ca2e-626b-4380-9bc5-76c23ed096a9 service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:56.702500 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 907/1817] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:49:57.961644 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51969ae6-17ba-49c7-8168-d758647524fd service neutron] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:57.962359 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-51969ae6-17ba-49c7-8168-d758647524fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:57.992243 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51969ae6-17ba-49c7-8168-d758647524fd service neutron] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:58.013229 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee6429-887a-44d9-ab96-7aaab5e42f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:58.013229 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee6429-887a-44d9-ab96-7aaab5e42f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:58.013229 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee6429-887a-44d9-ab96-7aaab5e42f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:58.013229 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee6429-887a-44d9-ab96-7aaab5e42f31 admin admin] PATH_INFO: `/v3/projects/e0680aa9d58045b1a866e6b00d45e746` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:58.015758 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee6429-887a-44d9-ab96-7aaab5e42f31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0680aa9d58045b1a866e6b00d45e746)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:58.025696 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee6429-887a-44d9-ab96-7aaab5e42f31 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:58.223728 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b2ee6429-887a-44d9-ab96-7aaab5e42f31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0680aa9d58045b1a866e6b00d45e746', 'request_id': 'req-b2ee6429-887a-44d9-ab96-7aaab5e42f31'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:58.245232 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b2ee6429-887a-44d9-ab96-7aaab5e42f31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0680aa9d58045b1a866e6b00d45e746', 'request_id': 'req-b2ee6429-887a-44d9-ab96-7aaab5e42f31'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:58.318755 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b2ee6429-887a-44d9-ab96-7aaab5e42f31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0680aa9d58045b1a866e6b00d45e746', 'request_id': 'req-b2ee6429-887a-44d9-ab96-7aaab5e42f31'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:58.406353 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b2ee6429-887a-44d9-ab96-7aaab5e42f31 admin admin] The token cache is being invalidate because project e0680aa9d58045b1a866e6b00d45e746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:49:58.407849 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b2ee6429-887a-44d9-ab96-7aaab5e42f31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:58.410003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b2ee6429-887a-44d9-ab96-7aaab5e42f31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:58.420353 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 911/1818] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:49:57 2022] DELETE /identity/v3/projects/e0680aa9d58045b1a866e6b00d45e746 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:58.424543 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526ca2e-626b-4380-9bc5-76c23ed096a9 service neutron] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:58.436890 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4526ca2e-626b-4380-9bc5-76c23ed096a9 service neutron] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:58.594758 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e742a-a26b-413a-8492-b2299e89d519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:58.595485 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e742a-a26b-413a-8492-b2299e89d519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:58.595769 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e742a-a26b-413a-8492-b2299e89d519 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:58.596128 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e742a-a26b-413a-8492-b2299e89d519 admin admin] PATH_INFO: `/v3/users/d2327ba713544b35836ec1e464d21e89` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:58.598188 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e742a-a26b-413a-8492-b2299e89d519 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2327ba713544b35836ec1e464d21e89)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:58.600397 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e742a-a26b-413a-8492-b2299e89d519 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:58.728164 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-1a0e742a-a26b-413a-8492-b2299e89d519 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2327ba713544b35836ec1e464d21e89'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:58.729515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-1a0e742a-a26b-413a-8492-b2299e89d519 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2327ba713544b35836ec1e464d21e89'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:58.732151 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-1a0e742a-a26b-413a-8492-b2299e89d519 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2327ba713544b35836ec1e464d21e89'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:58.762201 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:58.764948 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-1a0e742a-a26b-413a-8492-b2299e89d519 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2327ba713544b35836ec1e464d21e89'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:58.785373 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-1a0e742a-a26b-413a-8492-b2299e89d519 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2327ba713544b35836ec1e464d21e89'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:58.841249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 908/1819] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:49:58 2022] DELETE /identity/v3/users/d2327ba713544b35836ec1e464d21e89 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:59.615459 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee6429-887a-44d9-ab96-7aaab5e42f31 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:59.618465 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-b2ee6429-887a-44d9-ab96-7aaab5e42f31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:59.651252 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee6429-887a-44d9-ab96-7aaab5e42f31 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:59.750361 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e1855-6c36-4d95-ac4b-391468c5226d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:59.751495 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e1855-6c36-4d95-ac4b-391468c5226d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:59.751495 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e1855-6c36-4d95-ac4b-391468c5226d admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:59.751762 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e1855-6c36-4d95-ac4b-391468c5226d admin admin] PATH_INFO: `/v3/users/03cc63d4e3564cb8977b1ecc6f8bebdc` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:59.753449 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e1855-6c36-4d95-ac4b-391468c5226d admin admin] RBAC: Authorizing `identity:delete_user(user_id=03cc63d4e3564cb8977b1ecc6f8bebdc)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:59.756582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e1855-6c36-4d95-ac4b-391468c5226d admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:59.784529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:59.863316 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e742a-a26b-413a-8492-b2299e89d519 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:59.865363 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-1a0e742a-a26b-413a-8492-b2299e89d519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:59.898790 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e742a-a26b-413a-8492-b2299e89d519 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:59.906838 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-055e1855-6c36-4d95-ac4b-391468c5226d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03cc63d4e3564cb8977b1ecc6f8bebdc'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:59.910870 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-055e1855-6c36-4d95-ac4b-391468c5226d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03cc63d4e3564cb8977b1ecc6f8bebdc'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:59.912042 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7251d7-423c-4767-b855-713ec64124b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:59.912539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-055e1855-6c36-4d95-ac4b-391468c5226d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03cc63d4e3564cb8977b1ecc6f8bebdc'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:59.914798 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7251d7-423c-4767-b855-713ec64124b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:59.915322 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7251d7-423c-4767-b855-713ec64124b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:59.915873 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7251d7-423c-4767-b855-713ec64124b9 admin admin] PATH_INFO: `/v3/projects/f5f140dfaefc4d928a54baedbfb81623` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:59.925267 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7251d7-423c-4767-b855-713ec64124b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5f140dfaefc4d928a54baedbfb81623)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:59.931122 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7251d7-423c-4767-b855-713ec64124b9 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:59.955834 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-055e1855-6c36-4d95-ac4b-391468c5226d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03cc63d4e3564cb8977b1ecc6f8bebdc'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:59.973841 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-055e1855-6c36-4d95-ac4b-391468c5226d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03cc63d4e3564cb8977b1ecc6f8bebdc'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:00.002942 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 912/1820] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:49:59 2022] DELETE /identity/v3/users/03cc63d4e3564cb8977b1ecc6f8bebdc => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:00.008286 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c28b9-5c27-4764-abb6-ecbe68ecfbc6 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:00.008646 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c28b9-5c27-4764-abb6-ecbe68ecfbc6 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:00.008826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c28b9-5c27-4764-abb6-ecbe68ecfbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:00.034916 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-7f7251d7-423c-4767-b855-713ec64124b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5f140dfaefc4d928a54baedbfb81623', 'request_id': 'req-7f7251d7-423c-4767-b855-713ec64124b9'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:00.052886 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-859c28b9-5c27-4764-abb6-ecbe68ecfbc6 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:00.055358 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-7f7251d7-423c-4767-b855-713ec64124b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5f140dfaefc4d928a54baedbfb81623', 'request_id': 'req-7f7251d7-423c-4767-b855-713ec64124b9'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:00.063824 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-859c28b9-5c27-4764-abb6-ecbe68ecfbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:00.066857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-7f7251d7-423c-4767-b855-713ec64124b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5f140dfaefc4d928a54baedbfb81623', 'request_id': 'req-7f7251d7-423c-4767-b855-713ec64124b9'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:00.095758 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-7f7251d7-423c-4767-b855-713ec64124b9 admin admin] The token cache is being invalidate because project f5f140dfaefc4d928a54baedbfb81623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:00.096133 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-7f7251d7-423c-4767-b855-713ec64124b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:00.097861 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-7f7251d7-423c-4767-b855-713ec64124b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:00.100935 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 909/1821] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:49:59 2022] DELETE /identity/v3/projects/f5f140dfaefc4d928a54baedbfb81623 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:00.109190 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7251d7-423c-4767-b855-713ec64124b9 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:00.112327 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-7f7251d7-423c-4767-b855-713ec64124b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:00.222404 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 913/1822] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:00.254856 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7251d7-423c-4767-b855-713ec64124b9 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:00.264248 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c28b9-5c27-4764-abb6-ecbe68ecfbc6 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:00.266317 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-859c28b9-5c27-4764-abb6-ecbe68ecfbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:00.269704 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3444a1c-d065-435e-9a53-a4bdc6b2acd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:00.270434 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3444a1c-d065-435e-9a53-a4bdc6b2acd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:00.270721 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3444a1c-d065-435e-9a53-a4bdc6b2acd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:00.273298 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3444a1c-d065-435e-9a53-a4bdc6b2acd3 admin admin] PATH_INFO: `/v3/users/2e5b82a0a33c4bf8ac67ff5736b8fab2` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:00.276964 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3444a1c-d065-435e-9a53-a4bdc6b2acd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e5b82a0a33c4bf8ac67ff5736b8fab2)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:00.279044 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3444a1c-d065-435e-9a53-a4bdc6b2acd3 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:00.424356 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c28b9-5c27-4764-abb6-ecbe68ecfbc6 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:00.431419 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72d133-b86d-47a0-91c2-acae39d03017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:00.433528 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72d133-b86d-47a0-91c2-acae39d03017 service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:00.433973 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-e3444a1c-d065-435e-9a53-a4bdc6b2acd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e5b82a0a33c4bf8ac67ff5736b8fab2'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:00.434352 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72d133-b86d-47a0-91c2-acae39d03017 service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:00.435148 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72d133-b86d-47a0-91c2-acae39d03017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:00.435482 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-e3444a1c-d065-435e-9a53-a4bdc6b2acd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e5b82a0a33c4bf8ac67ff5736b8fab2'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:00.437629 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-e3444a1c-d065-435e-9a53-a4bdc6b2acd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e5b82a0a33c4bf8ac67ff5736b8fab2'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:00.450699 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-6a72d133-b86d-47a0-91c2-acae39d03017 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:00.472198 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-e3444a1c-d065-435e-9a53-a4bdc6b2acd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e5b82a0a33c4bf8ac67ff5736b8fab2'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:00.476843 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72d133-b86d-47a0-91c2-acae39d03017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:00.477730 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=81,keystone:INSERT=2,keystone:DELETE=17 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:00.479672 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72d133-b86d-47a0-91c2-acae39d03017 service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:00.491370 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-e3444a1c-d065-435e-9a53-a4bdc6b2acd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e5b82a0a33c4bf8ac67ff5736b8fab2'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:00.501362 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 914/1823] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:00.507358 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 910/1824] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:00 2022] DELETE /identity/v3/users/2e5b82a0a33c4bf8ac67ff5736b8fab2 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:01.380821 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72d133-b86d-47a0-91c2-acae39d03017 service neutron] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:01.382346 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-6a72d133-b86d-47a0-91c2-acae39d03017 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:01.394755 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72d133-b86d-47a0-91c2-acae39d03017 service neutron] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:01.427164 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:01.458741 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e568b2a-2802-458f-a045-77bb82694bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:01.459369 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e568b2a-2802-458f-a045-77bb82694bde admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:01.459669 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e568b2a-2802-458f-a045-77bb82694bde admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:01.460250 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e568b2a-2802-458f-a045-77bb82694bde admin admin] PATH_INFO: `/v3/projects/c08d0123c96646a6b39799cc456e6726` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:01.461375 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e568b2a-2802-458f-a045-77bb82694bde admin admin] RBAC: Authorizing `identity:delete_project(project_id=c08d0123c96646a6b39799cc456e6726)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:01.463500 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e568b2a-2802-458f-a045-77bb82694bde admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:01.524969 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-7e568b2a-2802-458f-a045-77bb82694bde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c08d0123c96646a6b39799cc456e6726', 'request_id': 'req-7e568b2a-2802-458f-a045-77bb82694bde'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:01.532330 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-7e568b2a-2802-458f-a045-77bb82694bde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c08d0123c96646a6b39799cc456e6726', 'request_id': 'req-7e568b2a-2802-458f-a045-77bb82694bde'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:01.543409 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-7e568b2a-2802-458f-a045-77bb82694bde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c08d0123c96646a6b39799cc456e6726', 'request_id': 'req-7e568b2a-2802-458f-a045-77bb82694bde'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:01.561044 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-7e568b2a-2802-458f-a045-77bb82694bde admin admin] The token cache is being invalidate because project c08d0123c96646a6b39799cc456e6726 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:01.561501 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-7e568b2a-2802-458f-a045-77bb82694bde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:01.563202 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-7e568b2a-2802-458f-a045-77bb82694bde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:01.565665 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 915/1825] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:01 2022] DELETE /identity/v3/projects/c08d0123c96646a6b39799cc456e6726 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:01.571867 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a30e56-747c-46d2-bd6b-349756fe6f2f None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:01.572367 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a30e56-747c-46d2-bd6b-349756fe6f2f None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:01.572686 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a30e56-747c-46d2-bd6b-349756fe6f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:01.605930 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-d1a30e56-747c-46d2-bd6b-349756fe6f2f None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:01.608619 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-d1a30e56-747c-46d2-bd6b-349756fe6f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:01.669669 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a39c5-3b3e-413d-ac4d-e56b3991a9f5 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:01.669964 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a39c5-3b3e-413d-ac4d-e56b3991a9f5 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:01.670301 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a39c5-3b3e-413d-ac4d-e56b3991a9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:01.698070 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 911/1826] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:01.705625 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fb142-1bcd-4218-af3a-addef56380be None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:01.705915 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fb142-1bcd-4218-af3a-addef56380be None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:01.706192 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1fb142-1bcd-4218-af3a-addef56380be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:01.729706 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-cb1fb142-1bcd-4218-af3a-addef56380be None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:01.730784 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-3d5a39c5-3b3e-413d-ac4d-e56b3991a9f5 None None] MFA Rules not processed for user `2a2f0128458b4807af771d5ae2ca8694`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:01.731570 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-cb1fb142-1bcd-4218-af3a-addef56380be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:01.732819 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-3d5a39c5-3b3e-413d-ac4d-e56b3991a9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:01.752679 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 912/1827] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:01.753859 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fb142-1bcd-4218-af3a-addef56380be None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:01.788377 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1fb142-1bcd-4218-af3a-addef56380be None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:01.807714 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85aaf05-de84-44ef-98ad-46f883922f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:01.808842 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85aaf05-de84-44ef-98ad-46f883922f68 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:01.809129 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85aaf05-de84-44ef-98ad-46f883922f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:01.809634 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85aaf05-de84-44ef-98ad-46f883922f68 admin admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:01.810441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85aaf05-de84-44ef-98ad-46f883922f68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:01.810780 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85aaf05-de84-44ef-98ad-46f883922f68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:01.812598 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85aaf05-de84-44ef-98ad-46f883922f68 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:01.826915 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 913/1828] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:01.832254 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85aaf05-de84-44ef-98ad-46f883922f68 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:01.835545 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-b85aaf05-de84-44ef-98ad-46f883922f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:01.855785 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85aaf05-de84-44ef-98ad-46f883922f68 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:01.862253 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ed240-5e41-460b-9d93-9ad98f22446e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:01.863045 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ed240-5e41-460b-9d93-9ad98f22446e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:01.864016 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ed240-5e41-460b-9d93-9ad98f22446e admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:01.864400 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ed240-5e41-460b-9d93-9ad98f22446e admin admin] PATH_INFO: `/v3/projects/72cce5ddfbfe478ba7048f3aed6cfd55` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:01.866870 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ed240-5e41-460b-9d93-9ad98f22446e admin admin] RBAC: Authorizing `identity:delete_project(project_id=72cce5ddfbfe478ba7048f3aed6cfd55)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:01.869496 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ed240-5e41-460b-9d93-9ad98f22446e admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:01.939978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 916/1829] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:01.941988 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a39c5-3b3e-413d-ac4d-e56b3991a9f5 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:01.945150 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-3d5a39c5-3b3e-413d-ac4d-e56b3991a9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:01.959898 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-ed9ed240-5e41-460b-9d93-9ad98f22446e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72cce5ddfbfe478ba7048f3aed6cfd55', 'request_id': 'req-ed9ed240-5e41-460b-9d93-9ad98f22446e'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:01.968888 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-ed9ed240-5e41-460b-9d93-9ad98f22446e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72cce5ddfbfe478ba7048f3aed6cfd55', 'request_id': 'req-ed9ed240-5e41-460b-9d93-9ad98f22446e'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:01.979841 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-ed9ed240-5e41-460b-9d93-9ad98f22446e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72cce5ddfbfe478ba7048f3aed6cfd55', 'request_id': 'req-ed9ed240-5e41-460b-9d93-9ad98f22446e'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:01.984343 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a39c5-3b3e-413d-ac4d-e56b3991a9f5 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:01.995814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-ed9ed240-5e41-460b-9d93-9ad98f22446e admin admin] The token cache is being invalidate because project 72cce5ddfbfe478ba7048f3aed6cfd55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:01.996108 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-ed9ed240-5e41-460b-9d93-9ad98f22446e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:01.996980 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-ed9ed240-5e41-460b-9d93-9ad98f22446e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:01.999213 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 914/1830] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:01 2022] DELETE /identity/v3/projects/72cce5ddfbfe478ba7048f3aed6cfd55 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:01.999834 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ed240-5e41-460b-9d93-9ad98f22446e admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:02.001240 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-ed9ed240-5e41-460b-9d93-9ad98f22446e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:02.077520 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:02.087795 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:02.098589 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac34ab-203b-432b-a2c9-b87659a1a732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:02.099569 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac34ab-203b-432b-a2c9-b87659a1a732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.100163 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac34ab-203b-432b-a2c9-b87659a1a732 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.100635 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac34ab-203b-432b-a2c9-b87659a1a732 admin admin] PATH_INFO: `/v3/projects/00a99a0e19d744058f3f53bcb23f506b` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.102065 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac34ab-203b-432b-a2c9-b87659a1a732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00a99a0e19d744058f3f53bcb23f506b)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:02.105049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac34ab-203b-432b-a2c9-b87659a1a732 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:02.111951 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ed240-5e41-460b-9d93-9ad98f22446e admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:02.117687 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4bd549-7c4d-4c58-ad5d-68073f0b9a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:02.118406 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4bd549-7c4d-4c58-ad5d-68073f0b9a54 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.118758 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4bd549-7c4d-4c58-ad5d-68073f0b9a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.119089 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4bd549-7c4d-4c58-ad5d-68073f0b9a54 admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.120139 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4bd549-7c4d-4c58-ad5d-68073f0b9a54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:02.122204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4bd549-7c4d-4c58-ad5d-68073f0b9a54 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:02.174807 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 915/1831] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:01 2022] POST /identity/v3/projects => generated 377 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:02.175419 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4bd549-7c4d-4c58-ad5d-68073f0b9a54 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:02.177174 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-3c4bd549-7c4d-4c58-ad5d-68073f0b9a54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:02.183611 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-05ac34ab-203b-432b-a2c9-b87659a1a732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00a99a0e19d744058f3f53bcb23f506b', 'request_id': 'req-05ac34ab-203b-432b-a2c9-b87659a1a732'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:02.191310 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-05ac34ab-203b-432b-a2c9-b87659a1a732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00a99a0e19d744058f3f53bcb23f506b', 'request_id': 'req-05ac34ab-203b-432b-a2c9-b87659a1a732'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:02.202399 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-05ac34ab-203b-432b-a2c9-b87659a1a732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00a99a0e19d744058f3f53bcb23f506b', 'request_id': 'req-05ac34ab-203b-432b-a2c9-b87659a1a732'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:02.214680 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-05ac34ab-203b-432b-a2c9-b87659a1a732 admin admin] The token cache is being invalidate because project 00a99a0e19d744058f3f53bcb23f506b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:02.215148 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-05ac34ab-203b-432b-a2c9-b87659a1a732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:02.217768 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-05ac34ab-203b-432b-a2c9-b87659a1a732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:02.219682 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 917/1832] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:01 2022] DELETE /identity/v3/projects/00a99a0e19d744058f3f53bcb23f506b => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:02.220620 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac34ab-203b-432b-a2c9-b87659a1a732 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:02.223982 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-05ac34ab-203b-432b-a2c9-b87659a1a732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:02.262178 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4bd549-7c4d-4c58-ad5d-68073f0b9a54 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:02.270043 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f959f893-feca-40f1-9ec4-885eab2699fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:02.270934 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959f893-feca-40f1-9ec4-885eab2699fa admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.271423 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959f893-feca-40f1-9ec4-885eab2699fa admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.271977 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f959f893-feca-40f1-9ec4-885eab2699fa admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.273095 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f959f893-feca-40f1-9ec4-885eab2699fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:02.275916 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f959f893-feca-40f1-9ec4-885eab2699fa admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:02.313548 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 916/1833] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:02 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:02.313548 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f959f893-feca-40f1-9ec4-885eab2699fa admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:02.313548 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-f959f893-feca-40f1-9ec4-885eab2699fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:02.329904 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac34ab-203b-432b-a2c9-b87659a1a732 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:02.393837 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f959f893-feca-40f1-9ec4-885eab2699fa admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:02.399383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89811494-673d-45e0-a378-8bc12aeb1566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:02.400072 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89811494-673d-45e0-a378-8bc12aeb1566 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.400350 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89811494-673d-45e0-a378-8bc12aeb1566 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.401495 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89811494-673d-45e0-a378-8bc12aeb1566 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.401620 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406716bf-7ce5-4d23-9822-c9f4d0c32981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:02.402189 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406716bf-7ce5-4d23-9822-c9f4d0c32981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.402292 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89811494-673d-45e0-a378-8bc12aeb1566 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:02.402469 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406716bf-7ce5-4d23-9822-c9f4d0c32981 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.402742 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406716bf-7ce5-4d23-9822-c9f4d0c32981 admin admin] PATH_INFO: `/v3/users/7de4c7eb997a4d8a907b1bbc8d64d020` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.403888 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406716bf-7ce5-4d23-9822-c9f4d0c32981 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7de4c7eb997a4d8a907b1bbc8d64d020)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:02.404212 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89811494-673d-45e0-a378-8bc12aeb1566 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:02.405868 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406716bf-7ce5-4d23-9822-c9f4d0c32981 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:02.431865 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 917/1834] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:02 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:02.431865 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb231bf-e62c-40e3-a697-d0c5f527e264 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.431865 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb231bf-e62c-40e3-a697-d0c5f527e264 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.431865 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb231bf-e62c-40e3-a697-d0c5f527e264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.451581 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-7cb231bf-e62c-40e3-a697-d0c5f527e264 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:02.452689 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:02.452943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-7cb231bf-e62c-40e3-a697-d0c5f527e264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:02.464352 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 918/1835] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:02.464352 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb231bf-e62c-40e3-a697-d0c5f527e264 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:02.464968 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-7cb231bf-e62c-40e3-a697-d0c5f527e264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:02.477734 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb231bf-e62c-40e3-a697-d0c5f527e264 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:02.479218 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-406716bf-7ce5-4d23-9822-c9f4d0c32981 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7de4c7eb997a4d8a907b1bbc8d64d020'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:02.480152 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-406716bf-7ce5-4d23-9822-c9f4d0c32981 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7de4c7eb997a4d8a907b1bbc8d64d020'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:02.480874 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-406716bf-7ce5-4d23-9822-c9f4d0c32981 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7de4c7eb997a4d8a907b1bbc8d64d020'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:02.482796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ccd35-a109-4899-a75d-bdd767f06e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:02.483417 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ccd35-a109-4899-a75d-bdd767f06e24 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.483696 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ccd35-a109-4899-a75d-bdd767f06e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.483968 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ccd35-a109-4899-a75d-bdd767f06e24 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.484609 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7ccd35-a109-4899-a75d-bdd767f06e24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:02.486788 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7ccd35-a109-4899-a75d-bdd767f06e24 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:02.501161 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-406716bf-7ce5-4d23-9822-c9f4d0c32981 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7de4c7eb997a4d8a907b1bbc8d64d020'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:02.512033 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 919/1836] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:02 2022] POST /identity/v3/users => generated 293 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:02.512812 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-406716bf-7ce5-4d23-9822-c9f4d0c32981 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7de4c7eb997a4d8a907b1bbc8d64d020'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:02.514743 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ccd35-a109-4899-a75d-bdd767f06e24 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:02.518405 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-2f7ccd35-a109-4899-a75d-bdd767f06e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:02.529062 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 918/1837] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:02 2022] DELETE /identity/v3/users/7de4c7eb997a4d8a907b1bbc8d64d020 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:02.530443 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad1d39-83a1-422f-a8b4-7f677b2fb02d None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.530725 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad1d39-83a1-422f-a8b4-7f677b2fb02d None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.533381 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad1d39-83a1-422f-a8b4-7f677b2fb02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.541544 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ccd35-a109-4899-a75d-bdd767f06e24 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:02.553312 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-c9ad1d39-83a1-422f-a8b4-7f677b2fb02d None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:02.554663 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-c9ad1d39-83a1-422f-a8b4-7f677b2fb02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:02.562960 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:02.618610 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9aefb6-c764-49e6-b87b-707b76b32054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:02.619679 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9aefb6-c764-49e6-b87b-707b76b32054 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.620214 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9aefb6-c764-49e6-b87b-707b76b32054 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.620739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9aefb6-c764-49e6-b87b-707b76b32054 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.621703 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9aefb6-c764-49e6-b87b-707b76b32054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:02.624815 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9aefb6-c764-49e6-b87b-707b76b32054 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:02.637312 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 919/1838] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:02.638057 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad1d39-83a1-422f-a8b4-7f677b2fb02d None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:02.639962 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-c9ad1d39-83a1-422f-a8b4-7f677b2fb02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:02.647497 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 920/1839] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:02.648381 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9aefb6-c764-49e6-b87b-707b76b32054 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:02.654630 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad1d39-83a1-422f-a8b4-7f677b2fb02d None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:02.660823 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d29e97-a502-4c9e-bb96-7ae6984500cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:02.661485 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d29e97-a502-4c9e-bb96-7ae6984500cc admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.661763 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d29e97-a502-4c9e-bb96-7ae6984500cc admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.662204 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d29e97-a502-4c9e-bb96-7ae6984500cc admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.662540 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9aefb6-c764-49e6-b87b-707b76b32054 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:02.662867 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d29e97-a502-4c9e-bb96-7ae6984500cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:02.665776 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d29e97-a502-4c9e-bb96-7ae6984500cc admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:02.668784 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431c8fa-09d8-46bc-9911-21dd2edebc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:02.669544 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431c8fa-09d8-46bc-9911-21dd2edebc08 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.670298 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431c8fa-09d8-46bc-9911-21dd2edebc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.670657 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431c8fa-09d8-46bc-9911-21dd2edebc08 admin admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.671625 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431c8fa-09d8-46bc-9911-21dd2edebc08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:02.671964 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431c8fa-09d8-46bc-9911-21dd2edebc08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:02.673814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431c8fa-09d8-46bc-9911-21dd2edebc08 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:02.685985 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 920/1840] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:02.685985 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d29e97-a502-4c9e-bb96-7ae6984500cc admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:02.693803 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 921/1841] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:02.693803 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431c8fa-09d8-46bc-9911-21dd2edebc08 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:02.704207 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d29e97-a502-4c9e-bb96-7ae6984500cc admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:02.708676 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431c8fa-09d8-46bc-9911-21dd2edebc08 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:02.710631 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb41f6-d9bf-4be6-955c-896bca792fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:02.710631 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb41f6-d9bf-4be6-955c-896bca792fff admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.710846 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb41f6-d9bf-4be6-955c-896bca792fff admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.711061 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb41f6-d9bf-4be6-955c-896bca792fff admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.711754 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb41f6-d9bf-4be6-955c-896bca792fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:02.713677 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb41f6-d9bf-4be6-955c-896bca792fff admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:02.714785 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050faa1-dec3-4e1c-ab41-56fa1f4a5c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:02.715653 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050faa1-dec3-4e1c-ab41-56fa1f4a5c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.716060 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050faa1-dec3-4e1c-ab41-56fa1f4a5c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.716401 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050faa1-dec3-4e1c-ab41-56fa1f4a5c4f admin admin] PATH_INFO: `/v3/projects/dcd8377e7d4542fd9c55b771fb3d26b8/users/cab591d907b54cb8b2cbdb13627a242b/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.726408 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 921/1842] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:02.727749 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb41f6-d9bf-4be6-955c-896bca792fff admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:02.737562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050faa1-dec3-4e1c-ab41-56fa1f4a5c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcd8377e7d4542fd9c55b771fb3d26b8, user_id=cab591d907b54cb8b2cbdb13627a242b, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:02.739909 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb41f6-d9bf-4be6-955c-896bca792fff admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:02.740684 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050faa1-dec3-4e1c-ab41-56fa1f4a5c4f admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:02.745658 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0522caa-a376-4c02-b91d-33b7fafd88d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:02.746403 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0522caa-a376-4c02-b91d-33b7fafd88d8 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.746680 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0522caa-a376-4c02-b91d-33b7fafd88d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.746955 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0522caa-a376-4c02-b91d-33b7fafd88d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.750147 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0522caa-a376-4c02-b91d-33b7fafd88d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:02.753171 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0522caa-a376-4c02-b91d-33b7fafd88d8 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:02.759597 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 922/1843] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:02 2022] PUT /identity/v3/projects/dcd8377e7d4542fd9c55b771fb3d26b8/users/cab591d907b54cb8b2cbdb13627a242b/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:02.760414 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050faa1-dec3-4e1c-ab41-56fa1f4a5c4f admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:02.786095 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 922/1844] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:02 2022] POST /identity/v3/projects => generated 357 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:02.787105 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0522caa-a376-4c02-b91d-33b7fafd88d8 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:02.836373 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050faa1-dec3-4e1c-ab41-56fa1f4a5c4f admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:02.858360 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0522caa-a376-4c02-b91d-33b7fafd88d8 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:02.863494 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7d0e9-a30f-4d71-8849-7dcd7cfedc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:02.864209 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7d0e9-a30f-4d71-8849-7dcd7cfedc78 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.864579 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7d0e9-a30f-4d71-8849-7dcd7cfedc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.864929 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7d0e9-a30f-4d71-8849-7dcd7cfedc78 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.865671 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae7d0e9-a30f-4d71-8849-7dcd7cfedc78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:02.867420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae7d0e9-a30f-4d71-8849-7dcd7cfedc78 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:02.878425 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 923/1845] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:02.879260 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7d0e9-a30f-4d71-8849-7dcd7cfedc78 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:02.884543 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:02.893123 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7d0e9-a30f-4d71-8849-7dcd7cfedc78 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:02.899496 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74a2cc-d427-4ab2-b586-e0332a4de820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:02.900239 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74a2cc-d427-4ab2-b586-e0332a4de820 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.900519 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74a2cc-d427-4ab2-b586-e0332a4de820 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.900791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74a2cc-d427-4ab2-b586-e0332a4de820 admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.901453 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74a2cc-d427-4ab2-b586-e0332a4de820 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:02.903369 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74a2cc-d427-4ab2-b586-e0332a4de820 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:02.904126 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f56707-03fa-468b-b126-d2cd028b37c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:02.904853 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f56707-03fa-468b-b126-d2cd028b37c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:02.905188 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f56707-03fa-468b-b126-d2cd028b37c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:02.905505 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f56707-03fa-468b-b126-d2cd028b37c8 admin admin] PATH_INFO: `/v3/projects/74b4bba822bb4e67b1e7dca8fc02cb8c/users/b89f176d7baa44f9b50c10522e63f024/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:02.920809 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f56707-03fa-468b-b126-d2cd028b37c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74b4bba822bb4e67b1e7dca8fc02cb8c, user_id=b89f176d7baa44f9b50c10522e63f024, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:02.923563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f56707-03fa-468b-b126-d2cd028b37c8 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:02.928140 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 924/1846] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:02 2022] POST /identity/v3/users => generated 279 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:02.928140 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74a2cc-d427-4ab2-b586-e0332a4de820 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:02.930184 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-0d74a2cc-d427-4ab2-b586-e0332a4de820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:02.938153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 923/1847] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:02 2022] PUT /identity/v3/projects/74b4bba822bb4e67b1e7dca8fc02cb8c/users/b89f176d7baa44f9b50c10522e63f024/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:02.939017 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f56707-03fa-468b-b126-d2cd028b37c8 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:02.942516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74a2cc-d427-4ab2-b586-e0332a4de820 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:02.955944 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:03.003462 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3fb578-e647-4b86-9b44-4a1c4f842451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:03.004107 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fb578-e647-4b86-9b44-4a1c4f842451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:03.004380 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fb578-e647-4b86-9b44-4a1c4f842451 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:03.004644 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3fb578-e647-4b86-9b44-4a1c4f842451 admin admin] PATH_INFO: `/v3/projects/4379a7b8e15e437885d3143b5ee731ab` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:03.005842 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3fb578-e647-4b86-9b44-4a1c4f842451 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4379a7b8e15e437885d3143b5ee731ab)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:03.007791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3fb578-e647-4b86-9b44-4a1c4f842451 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:03.020563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f56707-03fa-468b-b126-d2cd028b37c8 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:03.025378 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0189ea-1b86-42c7-adf1-44e4dacb2525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:03.026071 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0189ea-1b86-42c7-adf1-44e4dacb2525 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:03.026351 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0189ea-1b86-42c7-adf1-44e4dacb2525 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:03.026622 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0189ea-1b86-42c7-adf1-44e4dacb2525 admin admin] PATH_INFO: `/v3/projects/dcd8377e7d4542fd9c55b771fb3d26b8/users/cab591d907b54cb8b2cbdb13627a242b/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:03.028792 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0189ea-1b86-42c7-adf1-44e4dacb2525 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcd8377e7d4542fd9c55b771fb3d26b8, user_id=cab591d907b54cb8b2cbdb13627a242b, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:03.031877 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0189ea-1b86-42c7-adf1-44e4dacb2525 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:03.043428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 924/1848] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:02 2022] PUT /identity/v3/projects/dcd8377e7d4542fd9c55b771fb3d26b8/users/cab591d907b54cb8b2cbdb13627a242b/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:03.044176 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0189ea-1b86-42c7-adf1-44e4dacb2525 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:03.060790 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-1d3fb578-e647-4b86-9b44-4a1c4f842451 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4379a7b8e15e437885d3143b5ee731ab', 'request_id': 'req-1d3fb578-e647-4b86-9b44-4a1c4f842451'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:03.067576 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-1d3fb578-e647-4b86-9b44-4a1c4f842451 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4379a7b8e15e437885d3143b5ee731ab', 'request_id': 'req-1d3fb578-e647-4b86-9b44-4a1c4f842451'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:03.077273 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-1d3fb578-e647-4b86-9b44-4a1c4f842451 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4379a7b8e15e437885d3143b5ee731ab', 'request_id': 'req-1d3fb578-e647-4b86-9b44-4a1c4f842451'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:03.092283 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-1d3fb578-e647-4b86-9b44-4a1c4f842451 admin admin] The token cache is being invalidate because project 4379a7b8e15e437885d3143b5ee731ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:03.092885 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-1d3fb578-e647-4b86-9b44-4a1c4f842451 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:03.093246 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-1d3fb578-e647-4b86-9b44-4a1c4f842451 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:03.094825 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 925/1849] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:02 2022] DELETE /identity/v3/projects/4379a7b8e15e437885d3143b5ee731ab => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:03.096090 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b170ba-451a-457b-a24f-45e5a8f7ee98 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:03.096377 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b170ba-451a-457b-a24f-45e5a8f7ee98 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:03.096648 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b170ba-451a-457b-a24f-45e5a8f7ee98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:03.115925 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0189ea-1b86-42c7-adf1-44e4dacb2525 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:03.137209 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-c2b170ba-451a-457b-a24f-45e5a8f7ee98 None None] MFA Rules not processed for user `b89f176d7baa44f9b50c10522e63f024`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:03.139682 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-c2b170ba-451a-457b-a24f-45e5a8f7ee98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:03.201948 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4d7e4-d8ad-40b4-b9b3-b03676d2719d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:03.202666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4d7e4-d8ad-40b4-b9b3-b03676d2719d admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:03.202919 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4d7e4-d8ad-40b4-b9b3-b03676d2719d admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:03.203442 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4d7e4-d8ad-40b4-b9b3-b03676d2719d admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:03.204104 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f4d7e4-d8ad-40b4-b9b3-b03676d2719d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:03.207974 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f4d7e4-d8ad-40b4-b9b3-b03676d2719d admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:03.244669 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 925/1850] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:03.246199 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440de19-0ea2-491d-a3af-9e589f5a30b6 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:03.246446 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440de19-0ea2-491d-a3af-9e589f5a30b6 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:03.246728 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440de19-0ea2-491d-a3af-9e589f5a30b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:03.250606 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 926/1851] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:03.252233 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b170ba-451a-457b-a24f-45e5a8f7ee98 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:03.254225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-c2b170ba-451a-457b-a24f-45e5a8f7ee98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:03.283004 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:03.283445 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-9440de19-0ea2-491d-a3af-9e589f5a30b6 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:03.284958 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-9440de19-0ea2-491d-a3af-9e589f5a30b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:03.296704 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 926/1852] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:03.305353 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440de19-0ea2-491d-a3af-9e589f5a30b6 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:03.307371 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-9440de19-0ea2-491d-a3af-9e589f5a30b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:03.312927 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b170ba-451a-457b-a24f-45e5a8f7ee98 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:03.319162 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e40b76-5a4c-4547-8f7d-f1a04dcd7abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:03.320426 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e40b76-5a4c-4547-8f7d-f1a04dcd7abd admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:03.320779 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e40b76-5a4c-4547-8f7d-f1a04dcd7abd admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:03.321052 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e40b76-5a4c-4547-8f7d-f1a04dcd7abd admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:03.321899 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e40b76-5a4c-4547-8f7d-f1a04dcd7abd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:03.324497 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440de19-0ea2-491d-a3af-9e589f5a30b6 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:03.331016 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3a354-53ea-4ecd-a602-3e229cb1af3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:03.332203 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3a354-53ea-4ecd-a602-3e229cb1af3d admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:03.332587 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3a354-53ea-4ecd-a602-3e229cb1af3d admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:03.332960 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3a354-53ea-4ecd-a602-3e229cb1af3d admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:03.333868 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3a354-53ea-4ecd-a602-3e229cb1af3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:03.335506 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e40b76-5a4c-4547-8f7d-f1a04dcd7abd admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:03.336248 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3a354-53ea-4ecd-a602-3e229cb1af3d admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:03.362356 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 927/1853] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:03.363780 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22d040-9de1-48d1-8b2c-cb8da98f99fd None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:03.364066 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22d040-9de1-48d1-8b2c-cb8da98f99fd None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:03.364337 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22d040-9de1-48d1-8b2c-cb8da98f99fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:03.374766 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 927/1854] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:03 2022] POST /identity/v3/projects => generated 375 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:03.376107 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3a354-53ea-4ecd-a602-3e229cb1af3d admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:03.398423 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-fb22d040-9de1-48d1-8b2c-cb8da98f99fd None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:03.399759 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-fb22d040-9de1-48d1-8b2c-cb8da98f99fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:03.409915 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:03.459497 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3a354-53ea-4ecd-a602-3e229cb1af3d admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:03.466690 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7dc08-1d9d-4b5f-8e9e-eb99d217d610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:03.468690 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7dc08-1d9d-4b5f-8e9e-eb99d217d610 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:03.469188 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7dc08-1d9d-4b5f-8e9e-eb99d217d610 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:03.469553 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7dc08-1d9d-4b5f-8e9e-eb99d217d610 admin admin] PATH_INFO: `/v3/projects/b926c5b55ef04a4c9b8eaf37abd1a5ee/users/ed86315487aa47739e660332df287afb/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:03.487151 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 928/1855] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:03.488876 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22d040-9de1-48d1-8b2c-cb8da98f99fd None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:03.495256 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b7dc08-1d9d-4b5f-8e9e-eb99d217d610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b926c5b55ef04a4c9b8eaf37abd1a5ee, user_id=ed86315487aa47739e660332df287afb, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:03.500670 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b7dc08-1d9d-4b5f-8e9e-eb99d217d610 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:03.501909 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22d040-9de1-48d1-8b2c-cb8da98f99fd None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:03.507745 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f6f4a-d91f-46ce-bef1-0ae692ff2ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:03.508534 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f6f4a-d91f-46ce-bef1-0ae692ff2ab5 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:03.509017 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f6f4a-d91f-46ce-bef1-0ae692ff2ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:03.509508 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f6f4a-d91f-46ce-bef1-0ae692ff2ab5 admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:03.510223 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f6f4a-d91f-46ce-bef1-0ae692ff2ab5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:03.512566 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f6f4a-d91f-46ce-bef1-0ae692ff2ab5 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:03.537391 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 928/1856] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:03 2022] PUT /identity/v3/projects/b926c5b55ef04a4c9b8eaf37abd1a5ee/users/ed86315487aa47739e660332df287afb/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:03.537391 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7dc08-1d9d-4b5f-8e9e-eb99d217d610 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:03.568704 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 929/1857] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:03 2022] POST /identity/v3/users => generated 294 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:03.581586 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750330fb-007f-4ab9-937f-e67473439708 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:03.583228 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750330fb-007f-4ab9-937f-e67473439708 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:03.585638 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750330fb-007f-4ab9-937f-e67473439708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:03.619806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7dc08-1d9d-4b5f-8e9e-eb99d217d610 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:03.633628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc3f8a-e4f9-4f4b-950c-71a1d82195de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:03.634269 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc3f8a-e4f9-4f4b-950c-71a1d82195de admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:03.634627 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc3f8a-e4f9-4f4b-950c-71a1d82195de admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:03.635034 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc3f8a-e4f9-4f4b-950c-71a1d82195de admin admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:03.635991 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc3f8a-e4f9-4f4b-950c-71a1d82195de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:03.636371 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc3f8a-e4f9-4f4b-950c-71a1d82195de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:03.638200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc3f8a-e4f9-4f4b-950c-71a1d82195de admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:03.662027 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-750330fb-007f-4ab9-937f-e67473439708 None None] MFA Rules not processed for user `ed86315487aa47739e660332df287afb`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:03.663162 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-750330fb-007f-4ab9-937f-e67473439708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:03.676467 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 929/1858] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:03.676467 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc3f8a-e4f9-4f4b-950c-71a1d82195de admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:03.693959 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc3f8a-e4f9-4f4b-950c-71a1d82195de admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:03.701933 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b4431-7dd4-4ad8-b2d5-0a1586df11ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:03.702563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b4431-7dd4-4ad8-b2d5-0a1586df11ac admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:03.702846 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b4431-7dd4-4ad8-b2d5-0a1586df11ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:03.703121 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b4431-7dd4-4ad8-b2d5-0a1586df11ac admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:03.704294 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b4431-7dd4-4ad8-b2d5-0a1586df11ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:03.706074 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19b4431-7dd4-4ad8-b2d5-0a1586df11ac admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:03.722450 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 930/1859] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:03.725055 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b4431-7dd4-4ad8-b2d5-0a1586df11ac admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:03.747205 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19b4431-7dd4-4ad8-b2d5-0a1586df11ac admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:03.753556 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9db39-e71a-4265-99bf-461c0202335f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:03.754186 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9db39-e71a-4265-99bf-461c0202335f admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:03.754563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9db39-e71a-4265-99bf-461c0202335f admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:03.754866 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9db39-e71a-4265-99bf-461c0202335f admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:03.756012 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9db39-e71a-4265-99bf-461c0202335f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:03.757677 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9db39-e71a-4265-99bf-461c0202335f admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:03.800826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 930/1860] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:03 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:03.808418 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750330fb-007f-4ab9-937f-e67473439708 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:03.816971 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750330fb-007f-4ab9-937f-e67473439708 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:03.827348 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61a585-c501-4615-a0b5-7050e6fea677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:03.828063 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61a585-c501-4615-a0b5-7050e6fea677 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:03.828356 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61a585-c501-4615-a0b5-7050e6fea677 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:03.828599 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be61a585-c501-4615-a0b5-7050e6fea677 admin admin] PATH_INFO: `/v3/projects/fdf73b9481c44abeb77ad55758d03303/users/fcbe0b3a08514c9ab0532850bcdd55e8/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:03.836845 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 931/1861] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:03 2022] POST /identity/v3/projects => generated 407 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:03.837947 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9db39-e71a-4265-99bf-461c0202335f admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:03.888578 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61a585-c501-4615-a0b5-7050e6fea677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdf73b9481c44abeb77ad55758d03303, user_id=fcbe0b3a08514c9ab0532850bcdd55e8, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:03.893319 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be61a585-c501-4615-a0b5-7050e6fea677 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:03.917374 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 931/1862] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:03 2022] PUT /identity/v3/projects/fdf73b9481c44abeb77ad55758d03303/users/fcbe0b3a08514c9ab0532850bcdd55e8/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:03.917374 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61a585-c501-4615-a0b5-7050e6fea677 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:03.968118 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9db39-e71a-4265-99bf-461c0202335f admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:04.007957 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:04.043514 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:04.089775 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be61a585-c501-4615-a0b5-7050e6fea677 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:04.101815 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf68c7d-4580-4d3d-b295-5c08159dd7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:04.103100 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf68c7d-4580-4d3d-b295-5c08159dd7da admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:04.103724 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf68c7d-4580-4d3d-b295-5c08159dd7da admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:04.104015 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf68c7d-4580-4d3d-b295-5c08159dd7da admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:04.105088 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf68c7d-4580-4d3d-b295-5c08159dd7da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:04.111934 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf68c7d-4580-4d3d-b295-5c08159dd7da admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:04.151348 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 932/1863] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:03 2022] POST /identity/v3/users => generated 304 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:04.151348 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf68c7d-4580-4d3d-b295-5c08159dd7da admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:04.167865 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b639e-b313-4025-9c94-9221234b4f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:04.168515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b639e-b313-4025-9c94-9221234b4f66 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:04.168796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b639e-b313-4025-9c94-9221234b4f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:04.169141 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b639e-b313-4025-9c94-9221234b4f66 admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:04.169809 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b639e-b313-4025-9c94-9221234b4f66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:04.171161 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf68c7d-4580-4d3d-b295-5c08159dd7da admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:04.171837 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b639e-b313-4025-9c94-9221234b4f66 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:04.181961 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268c0bc-2bd3-45fa-94c7-cd5fa45e991c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:04.182785 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268c0bc-2bd3-45fa-94c7-cd5fa45e991c admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:04.183175 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268c0bc-2bd3-45fa-94c7-cd5fa45e991c admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:04.183608 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268c0bc-2bd3-45fa-94c7-cd5fa45e991c admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:04.184339 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268c0bc-2bd3-45fa-94c7-cd5fa45e991c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:04.186377 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c268c0bc-2bd3-45fa-94c7-cd5fa45e991c admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:04.205391 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 933/1864] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:04.205391 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268c0bc-2bd3-45fa-94c7-cd5fa45e991c admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:04.219996 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c268c0bc-2bd3-45fa-94c7-cd5fa45e991c admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:04.228515 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da5705-6f86-4893-813b-9038e1f2579e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:04.229874 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da5705-6f86-4893-813b-9038e1f2579e admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:04.230558 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da5705-6f86-4893-813b-9038e1f2579e admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:04.231188 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da5705-6f86-4893-813b-9038e1f2579e admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:04.232073 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da5705-6f86-4893-813b-9038e1f2579e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:04.235281 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da5705-6f86-4893-813b-9038e1f2579e admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:04.237746 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 932/1865] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:03 2022] POST /identity/v3/projects => generated 355 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:04.239298 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b639e-b313-4025-9c94-9221234b4f66 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:04.257739 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 934/1866] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:04.259321 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da5705-6f86-4893-813b-9038e1f2579e admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:04.275113 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da5705-6f86-4893-813b-9038e1f2579e admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:04.351392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b639e-b313-4025-9c94-9221234b4f66 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:04.358150 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571d01a-f27b-4003-a528-2206e4b1d5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:04.359049 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571d01a-f27b-4003-a528-2206e4b1d5b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:04.359451 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571d01a-f27b-4003-a528-2206e4b1d5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:04.359820 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571d01a-f27b-4003-a528-2206e4b1d5b7 admin admin] PATH_INFO: `/v3/projects/fdf73b9481c44abeb77ad55758d03303/users/fcbe0b3a08514c9ab0532850bcdd55e8/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:04.362437 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0ef51-bcce-427a-a75f-8ae7ceab7fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:04.363378 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0ef51-bcce-427a-a75f-8ae7ceab7fd2 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:04.363505 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5571d01a-f27b-4003-a528-2206e4b1d5b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdf73b9481c44abeb77ad55758d03303, user_id=fcbe0b3a08514c9ab0532850bcdd55e8, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:04.364055 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0ef51-bcce-427a-a75f-8ae7ceab7fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:04.364481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0ef51-bcce-427a-a75f-8ae7ceab7fd2 admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:04.365761 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0ef51-bcce-427a-a75f-8ae7ceab7fd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:04.367287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5571d01a-f27b-4003-a528-2206e4b1d5b7 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:04.368322 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0ef51-bcce-427a-a75f-8ae7ceab7fd2 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:04.390302 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 933/1867] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:04 2022] PUT /identity/v3/projects/fdf73b9481c44abeb77ad55758d03303/users/fcbe0b3a08514c9ab0532850bcdd55e8/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:04.391787 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571d01a-f27b-4003-a528-2206e4b1d5b7 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:04.410793 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 935/1868] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:04 2022] POST /identity/v3/users => generated 284 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:04.412531 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8342b3a-f0d8-4684-976e-685ccbbc5a08 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:04.413084 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8342b3a-f0d8-4684-976e-685ccbbc5a08 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:04.413327 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8342b3a-f0d8-4684-976e-685ccbbc5a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:04.448685 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-b8342b3a-f0d8-4684-976e-685ccbbc5a08 None None] MFA Rules not processed for user `fcbe0b3a08514c9ab0532850bcdd55e8`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:04.449963 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-b8342b3a-f0d8-4684-976e-685ccbbc5a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:04.511236 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571d01a-f27b-4003-a528-2206e4b1d5b7 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:04.518310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d67ed-f0a4-4217-96b1-985cf3c96569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:04.519646 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d67ed-f0a4-4217-96b1-985cf3c96569 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:04.520027 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d67ed-f0a4-4217-96b1-985cf3c96569 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:04.520400 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d67ed-f0a4-4217-96b1-985cf3c96569 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:04.522129 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d67ed-f0a4-4217-96b1-985cf3c96569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:04.524593 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d67ed-f0a4-4217-96b1-985cf3c96569 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:04.537589 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 936/1869] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:04.538566 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8342b3a-f0d8-4684-976e-685ccbbc5a08 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:04.557139 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8342b3a-f0d8-4684-976e-685ccbbc5a08 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:04.559461 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 934/1870] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:04.561511 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7082e64-0bda-4656-ac5e-0fb0e8bf2c15 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:04.561892 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7082e64-0bda-4656-ac5e-0fb0e8bf2c15 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:04.562726 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7082e64-0bda-4656-ac5e-0fb0e8bf2c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:04.565855 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e4f7d-3170-4012-b6a7-251aa54dfbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:04.566484 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e4f7d-3170-4012-b6a7-251aa54dfbfa admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:04.566769 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e4f7d-3170-4012-b6a7-251aa54dfbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:04.567042 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e4f7d-3170-4012-b6a7-251aa54dfbfa admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:04.567829 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33e4f7d-3170-4012-b6a7-251aa54dfbfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:04.569621 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33e4f7d-3170-4012-b6a7-251aa54dfbfa admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:04.597814 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 937/1871] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:04.598974 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e4f7d-3170-4012-b6a7-251aa54dfbfa admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:04.602877 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-b7082e64-0bda-4656-ac5e-0fb0e8bf2c15 None None] MFA Rules not processed for user `cab591d907b54cb8b2cbdb13627a242b`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:04.604110 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-b7082e64-0bda-4656-ac5e-0fb0e8bf2c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:04.606341 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-d33e4f7d-3170-4012-b6a7-251aa54dfbfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:04.622287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:04.630915 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:04.699166 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 935/1872] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:04.699166 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7082e64-0bda-4656-ac5e-0fb0e8bf2c15 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:04.703909 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e4f7d-3170-4012-b6a7-251aa54dfbfa admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:04.704314 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7082e64-0bda-4656-ac5e-0fb0e8bf2c15 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:04.708283 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfedd87-5134-493c-8d2a-260d71d4a4f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:04.709110 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfedd87-5134-493c-8d2a-260d71d4a4f0 service cinder] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:04.709516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfedd87-5134-493c-8d2a-260d71d4a4f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:04.710607 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfedd87-5134-493c-8d2a-260d71d4a4f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:04.718767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce9955-34d7-41ee-9162-62ebcc597099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:04.719457 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce9955-34d7-41ee-9162-62ebcc597099 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:04.719742 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce9955-34d7-41ee-9162-62ebcc597099 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:04.720614 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce9955-34d7-41ee-9162-62ebcc597099 admin admin] PATH_INFO: `/v3/projects/8b14e1c303294d24b998d5a9e115e0f8/users/219f9f5a9c8d46ffab9e0a380cf05504/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:04.747219 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce9955-34d7-41ee-9162-62ebcc597099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b14e1c303294d24b998d5a9e115e0f8, user_id=219f9f5a9c8d46ffab9e0a380cf05504, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:04.751707 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce9955-34d7-41ee-9162-62ebcc597099 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:04.785483 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 936/1873] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:04 2022] PUT /identity/v3/projects/8b14e1c303294d24b998d5a9e115e0f8/users/219f9f5a9c8d46ffab9e0a380cf05504/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:04.794376 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce9955-34d7-41ee-9162-62ebcc597099 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:04.838718 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfedd87-5134-493c-8d2a-260d71d4a4f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:04.840357 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfedd87-5134-493c-8d2a-260d71d4a4f0 service cinder] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:04.874844 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 938/1874] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:04.878018 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89bcb5-6981-4b1d-9b00-b46b12912c3c None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:04.878765 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89bcb5-6981-4b1d-9b00-b46b12912c3c None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:04.879480 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89bcb5-6981-4b1d-9b00-b46b12912c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:04.938261 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-0a89bcb5-6981-4b1d-9b00-b46b12912c3c None None] MFA Rules not processed for user `2a2f0128458b4807af771d5ae2ca8694`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:04.939498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-0a89bcb5-6981-4b1d-9b00-b46b12912c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:04.942762 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce9955-34d7-41ee-9162-62ebcc597099 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:04.959527 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6413876-7564-46ce-af17-3ceae184b67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:04.960227 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6413876-7564-46ce-af17-3ceae184b67b admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:04.960512 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6413876-7564-46ce-af17-3ceae184b67b admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:04.960788 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6413876-7564-46ce-af17-3ceae184b67b admin admin] PATH_INFO: `/v3/projects/c416723b275a4cf2a69e935bb4f10526/users/ba687606cbcd4272b9bba6361d913262/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:04.995020 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6413876-7564-46ce-af17-3ceae184b67b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c416723b275a4cf2a69e935bb4f10526, user_id=ba687606cbcd4272b9bba6361d913262, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:04.999978 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6413876-7564-46ce-af17-3ceae184b67b admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:05.024987 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 937/1875] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:04 2022] PUT /identity/v3/projects/c416723b275a4cf2a69e935bb4f10526/users/ba687606cbcd4272b9bba6361d913262/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:05.027514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce70db7-e32b-499c-990e-fdb2b6ecdd31 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:05.027792 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce70db7-e32b-499c-990e-fdb2b6ecdd31 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:05.028070 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce70db7-e32b-499c-990e-fdb2b6ecdd31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:05.043253 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 939/1876] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:05.043253 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89bcb5-6981-4b1d-9b00-b46b12912c3c None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:05.055777 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89bcb5-6981-4b1d-9b00-b46b12912c3c None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:05.080511 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-6ce70db7-e32b-499c-990e-fdb2b6ecdd31 None None] MFA Rules not processed for user `219f9f5a9c8d46ffab9e0a380cf05504`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:05.082709 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-6ce70db7-e32b-499c-990e-fdb2b6ecdd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:05.187163 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:05.189469 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8744c04-3dc6-4824-9970-bb026112af6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:05.190540 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8744c04-3dc6-4824-9970-bb026112af6f admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:05.191293 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8744c04-3dc6-4824-9970-bb026112af6f admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:05.191604 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8744c04-3dc6-4824-9970-bb026112af6f admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:05.192341 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8744c04-3dc6-4824-9970-bb026112af6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:05.194304 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8744c04-3dc6-4824-9970-bb026112af6f admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:05.196887 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 938/1877] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:05 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:05.198192 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce70db7-e32b-499c-990e-fdb2b6ecdd31 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:05.200497 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-6ce70db7-e32b-499c-990e-fdb2b6ecdd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:05.207630 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 940/1878] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:05.210806 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8744c04-3dc6-4824-9970-bb026112af6f admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:05.239169 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8744c04-3dc6-4824-9970-bb026112af6f admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:05.255401 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07265ff4-c3c3-4ac1-beb3-1f90800cc72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:05.256139 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07265ff4-c3c3-4ac1-beb3-1f90800cc72e admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:05.256511 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07265ff4-c3c3-4ac1-beb3-1f90800cc72e admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:05.256906 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07265ff4-c3c3-4ac1-beb3-1f90800cc72e admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:05.257960 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07265ff4-c3c3-4ac1-beb3-1f90800cc72e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:05.267549 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07265ff4-c3c3-4ac1-beb3-1f90800cc72e admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:05.285028 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:05.333149 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 941/1879] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:05 2022] POST /identity/v3/projects => generated 407 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:05.334494 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07265ff4-c3c3-4ac1-beb3-1f90800cc72e admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:05.339930 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce70db7-e32b-499c-990e-fdb2b6ecdd31 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:05.427299 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07265ff4-c3c3-4ac1-beb3-1f90800cc72e admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:05.440105 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4812a-6729-49ac-a999-f0d9b49f5875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:05.440864 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4812a-6729-49ac-a999-f0d9b49f5875 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:05.441153 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4812a-6729-49ac-a999-f0d9b49f5875 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:05.441452 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4812a-6729-49ac-a999-f0d9b49f5875 admin admin] PATH_INFO: `/v3/projects/c416723b275a4cf2a69e935bb4f10526/users/ba687606cbcd4272b9bba6361d913262/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:05.443744 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e4812a-6729-49ac-a999-f0d9b49f5875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c416723b275a4cf2a69e935bb4f10526, user_id=ba687606cbcd4272b9bba6361d913262, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:05.447104 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e4812a-6729-49ac-a999-f0d9b49f5875 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:05.469639 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 942/1880] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:05 2022] PUT /identity/v3/projects/c416723b275a4cf2a69e935bb4f10526/users/ba687606cbcd4272b9bba6361d913262/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:05.470637 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4812a-6729-49ac-a999-f0d9b49f5875 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:05.481864 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e79fe9f-1d5a-43f3-9624-566c5c72dad3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:05.482503 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79fe9f-1d5a-43f3-9624-566c5c72dad3 service nova] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:05.482781 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79fe9f-1d5a-43f3-9624-566c5c72dad3 service nova] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:05.483144 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e79fe9f-1d5a-43f3-9624-566c5c72dad3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:05.485626 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-2e79fe9f-1d5a-43f3-9624-566c5c72dad3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:05.548838 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e79fe9f-1d5a-43f3-9624-566c5c72dad3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:05.550404 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e79fe9f-1d5a-43f3-9624-566c5c72dad3 service nova] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:05.550732 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4812a-6729-49ac-a999-f0d9b49f5875 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:05.556096 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b38d0-9fc6-48d4-b83c-0df6bd9f3b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:05.556902 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b38d0-9fc6-48d4-b83c-0df6bd9f3b8b admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:05.557252 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b38d0-9fc6-48d4-b83c-0df6bd9f3b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:05.557711 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b38d0-9fc6-48d4-b83c-0df6bd9f3b8b admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:05.558383 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27b38d0-9fc6-48d4-b83c-0df6bd9f3b8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:05.560634 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27b38d0-9fc6-48d4-b83c-0df6bd9f3b8b admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:05.560763 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 939/1881] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:05.566781 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b1b88-3751-4523-98c1-20d4b0161843 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:05.567100 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b1b88-3751-4523-98c1-20d4b0161843 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:05.567349 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b1b88-3751-4523-98c1-20d4b0161843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:05.593788 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 943/1882] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:05 2022] POST /identity/v3/users => generated 310 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:05.597717 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b38d0-9fc6-48d4-b83c-0df6bd9f3b8b admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:05.611011 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b38d0-9fc6-48d4-b83c-0df6bd9f3b8b admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:05.612865 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-798b1b88-3751-4523-98c1-20d4b0161843 None None] MFA Rules not processed for user `ba687606cbcd4272b9bba6361d913262`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:05.614627 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-798b1b88-3751-4523-98c1-20d4b0161843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:05.618253 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e353d18-94ca-46dd-9095-18d361492253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:05.618958 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e353d18-94ca-46dd-9095-18d361492253 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:05.619334 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e353d18-94ca-46dd-9095-18d361492253 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:05.619727 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e353d18-94ca-46dd-9095-18d361492253 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:05.620558 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e353d18-94ca-46dd-9095-18d361492253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:05.622467 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e353d18-94ca-46dd-9095-18d361492253 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:05.637511 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 944/1883] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:05.641523 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e353d18-94ca-46dd-9095-18d361492253 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:05.661317 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:05.671797 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e353d18-94ca-46dd-9095-18d361492253 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:05.677264 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ff09a-79fa-40f6-8eea-98430752f77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:05.678742 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ff09a-79fa-40f6-8eea-98430752f77c admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:05.679303 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ff09a-79fa-40f6-8eea-98430752f77c admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:05.679685 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ff09a-79fa-40f6-8eea-98430752f77c admin admin] PATH_INFO: `/v3/projects/09b30e04266a4c6eaab13449923f20bf/users/9004e6b1150140e79341699aec0e9f38/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:05.721486 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 940/1884] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:05 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:05.727043 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ff09a-79fa-40f6-8eea-98430752f77c admin admin] RBAC: Authorizing `identity:create_grant(project_id=09b30e04266a4c6eaab13449923f20bf, user_id=9004e6b1150140e79341699aec0e9f38, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:05.731420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ff09a-79fa-40f6-8eea-98430752f77c admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:05.732576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b1b88-3751-4523-98c1-20d4b0161843 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:05.754016 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 945/1885] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:05 2022] PUT /identity/v3/projects/09b30e04266a4c6eaab13449923f20bf/users/9004e6b1150140e79341699aec0e9f38/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:50:05.758156 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ff09a-79fa-40f6-8eea-98430752f77c admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:05.828047 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:05.883347 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b1b88-3751-4523-98c1-20d4b0161843 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:05.884051 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ff09a-79fa-40f6-8eea-98430752f77c admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:05.896944 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ee4cb-9282-41b6-8e6f-17a8de91846a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:05.898066 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ee4cb-9282-41b6-8e6f-17a8de91846a admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:05.899088 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ee4cb-9282-41b6-8e6f-17a8de91846a admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:05.899373 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ee4cb-9282-41b6-8e6f-17a8de91846a admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:05.901352 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ee4cb-9282-41b6-8e6f-17a8de91846a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:05.917151 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ee4cb-9282-41b6-8e6f-17a8de91846a admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:05.957280 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 946/1886] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:05.965740 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ee4cb-9282-41b6-8e6f-17a8de91846a admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:05.969504 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f9f12-6566-418d-9310-5103cc2361be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:05.970322 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f9f12-6566-418d-9310-5103cc2361be service cinder] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:05.971121 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f9f12-6566-418d-9310-5103cc2361be service cinder] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:05.971410 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f9f12-6566-418d-9310-5103cc2361be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:05.989063 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ee4cb-9282-41b6-8e6f-17a8de91846a admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:06.007955 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781267a3-ac9b-4193-90d3-a16ee1d11a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:06.009011 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781267a3-ac9b-4193-90d3-a16ee1d11a55 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:06.009011 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781267a3-ac9b-4193-90d3-a16ee1d11a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:06.009216 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781267a3-ac9b-4193-90d3-a16ee1d11a55 admin admin] PATH_INFO: `/v3/projects/09b30e04266a4c6eaab13449923f20bf/users/9004e6b1150140e79341699aec0e9f38/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:06.011240 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781267a3-ac9b-4193-90d3-a16ee1d11a55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09b30e04266a4c6eaab13449923f20bf, user_id=9004e6b1150140e79341699aec0e9f38, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:06.014031 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781267a3-ac9b-4193-90d3-a16ee1d11a55 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:06.029137 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 947/1887] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:05 2022] PUT /identity/v3/projects/09b30e04266a4c6eaab13449923f20bf/users/9004e6b1150140e79341699aec0e9f38/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:06.040843 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93f24a-eb52-4407-9e6d-c0689e279b5d None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:06.041166 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93f24a-eb52-4407-9e6d-c0689e279b5d None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:06.041574 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93f24a-eb52-4407-9e6d-c0689e279b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:06.076260 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f9f12-6566-418d-9310-5103cc2361be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:06.078327 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f9f12-6566-418d-9310-5103cc2361be service cinder] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:06.083278 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-ec93f24a-eb52-4407-9e6d-c0689e279b5d None None] MFA Rules not processed for user `9004e6b1150140e79341699aec0e9f38`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:06.084959 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-ec93f24a-eb52-4407-9e6d-c0689e279b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:06.094699 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 941/1888] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:05 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:06.209836 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f9f12-6566-418d-9310-5103cc2361be service cinder] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:06.222734 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f9f12-6566-418d-9310-5103cc2361be service cinder] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:06.255079 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:06.269534 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 948/1889] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:06 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:50:06.284008 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93f24a-eb52-4407-9e6d-c0689e279b5d None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:06.285543 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-ec93f24a-eb52-4407-9e6d-c0689e279b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:06.320147 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0005ef-d5ff-45a4-89d0-78810825a51b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:06.321672 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0005ef-d5ff-45a4-89d0-78810825a51b service cinder] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:06.322191 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0005ef-d5ff-45a4-89d0-78810825a51b service cinder] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:06.322984 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0005ef-d5ff-45a4-89d0-78810825a51b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:06.380050 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec93f24a-eb52-4407-9e6d-c0689e279b5d None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:06.383954 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf5c16-dead-4306-9927-8caebecd14ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:06.384710 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf5c16-dead-4306-9927-8caebecd14ec service cinder] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:06.385082 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf5c16-dead-4306-9927-8caebecd14ec service cinder] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:06.385477 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf5c16-dead-4306-9927-8caebecd14ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:06.406449 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf5c16-dead-4306-9927-8caebecd14ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:06.411156 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf5c16-dead-4306-9927-8caebecd14ec service cinder] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:06.424870 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0005ef-d5ff-45a4-89d0-78810825a51b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:06.427190 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0005ef-d5ff-45a4-89d0-78810825a51b service cinder] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:06.432693 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 949/1890] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:06 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:50:06.462370 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 942/1891] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:06 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:50:07.009705 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf5c16-dead-4306-9927-8caebecd14ec service cinder] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:07.021146 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf5c16-dead-4306-9927-8caebecd14ec service cinder] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:07.035870 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39476b25-96c8-4373-8b72-37dc177fe02e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:07.036835 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39476b25-96c8-4373-8b72-37dc177fe02e service cinder] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:07.037189 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39476b25-96c8-4373-8b72-37dc177fe02e service cinder] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:07.037498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39476b25-96c8-4373-8b72-37dc177fe02e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:07.093521 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:07.114554 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39476b25-96c8-4373-8b72-37dc177fe02e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:07.116323 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39476b25-96c8-4373-8b72-37dc177fe02e service cinder] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:07.141259 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 950/1892] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:07 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:07.166344 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775f03c-9aa6-4bea-bed8-965a14e60d8f None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:07.166813 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775f03c-9aa6-4bea-bed8-965a14e60d8f None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:07.166889 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c775f03c-9aa6-4bea-bed8-965a14e60d8f None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:07.168820 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 943/1893] 10.222.0.49 () {54 vars in 921 bytes} [Wed Aug 24 04:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:50:07.190145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fcd42-9f40-4c1a-998b-830913a637b5 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:07.190145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fcd42-9f40-4c1a-998b-830913a637b5 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:07.190145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5fcd42-9f40-4c1a-998b-830913a637b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:07.234352 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-ec5fcd42-9f40-4c1a-998b-830913a637b5 None None] MFA Rules not processed for user `9dc9a3cf381e4a2da36ed82b407a2d94`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:07.235254 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-ec5fcd42-9f40-4c1a-998b-830913a637b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:07.383276 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 951/1894] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Aug 24 04:50:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:50:07.400086 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775f03c-9aa6-4bea-bed8-965a14e60d8f None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:07.422271 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c775f03c-9aa6-4bea-bed8-965a14e60d8f None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:07.428649 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817273a2-3bc1-4d62-92fb-1cf867ea4d8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:07.429921 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817273a2-3bc1-4d62-92fb-1cf867ea4d8f service nova] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:07.430226 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fcd42-9f40-4c1a-998b-830913a637b5 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:07.430369 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817273a2-3bc1-4d62-92fb-1cf867ea4d8f service nova] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:07.430645 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817273a2-3bc1-4d62-92fb-1cf867ea4d8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:07.442110 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5fcd42-9f40-4c1a-998b-830913a637b5 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:07.447423 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f470b38-9f57-4c3f-b939-eefb29aaa8b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:07.448114 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f470b38-9f57-4c3f-b939-eefb29aaa8b3 service cinder] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:07.448391 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f470b38-9f57-4c3f-b939-eefb29aaa8b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:07.448652 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f470b38-9f57-4c3f-b939-eefb29aaa8b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:07.451028 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817273a2-3bc1-4d62-92fb-1cf867ea4d8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:07.453308 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817273a2-3bc1-4d62-92fb-1cf867ea4d8f service nova] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:07.471816 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 944/1895] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:07.539302 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f470b38-9f57-4c3f-b939-eefb29aaa8b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:07.541009 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f470b38-9f57-4c3f-b939-eefb29aaa8b3 service cinder] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:07.558635 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 952/1896] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:50:08.380795 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817273a2-3bc1-4d62-92fb-1cf867ea4d8f service nova] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:08.382577 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-817273a2-3bc1-4d62-92fb-1cf867ea4d8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:08.477109 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817273a2-3bc1-4d62-92fb-1cf867ea4d8f service nova] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:08.482340 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dce112-7b7e-47ce-ba8e-7d09c497279a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:08.483001 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dce112-7b7e-47ce-ba8e-7d09c497279a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:08.483570 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dce112-7b7e-47ce-ba8e-7d09c497279a admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:08.483914 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dce112-7b7e-47ce-ba8e-7d09c497279a admin admin] PATH_INFO: `/v3/users/0bdb7acbe00c4c0fa98e14a668918863` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:08.485141 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dce112-7b7e-47ce-ba8e-7d09c497279a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bdb7acbe00c4c0fa98e14a668918863)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:08.488631 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dce112-7b7e-47ce-ba8e-7d09c497279a admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:08.566332 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-e3dce112-7b7e-47ce-ba8e-7d09c497279a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bdb7acbe00c4c0fa98e14a668918863'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:08.567188 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-e3dce112-7b7e-47ce-ba8e-7d09c497279a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bdb7acbe00c4c0fa98e14a668918863'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:08.567924 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-e3dce112-7b7e-47ce-ba8e-7d09c497279a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bdb7acbe00c4c0fa98e14a668918863'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:08.583001 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-e3dce112-7b7e-47ce-ba8e-7d09c497279a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bdb7acbe00c4c0fa98e14a668918863'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:08.588222 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:08.597063 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-e3dce112-7b7e-47ce-ba8e-7d09c497279a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bdb7acbe00c4c0fa98e14a668918863'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:08.629728 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 945/1897] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:08 2022] DELETE /identity/v3/users/0bdb7acbe00c4c0fa98e14a668918863 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:08.634529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc3566-81fb-4dc8-865d-4f13ee91928f None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:08.635025 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc3566-81fb-4dc8-865d-4f13ee91928f None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:08.635116 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc3566-81fb-4dc8-865d-4f13ee91928f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:08.668611 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-8ffc3566-81fb-4dc8-865d-4f13ee91928f None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:08.669931 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-8ffc3566-81fb-4dc8-865d-4f13ee91928f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:08.751616 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 953/1898] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:08.764800 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dce112-7b7e-47ce-ba8e-7d09c497279a admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:08.766836 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-e3dce112-7b7e-47ce-ba8e-7d09c497279a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:08.837298 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dce112-7b7e-47ce-ba8e-7d09c497279a admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:08.841216 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a26130-5d7e-43e5-9bcb-35e5f59d109f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:08.841856 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a26130-5d7e-43e5-9bcb-35e5f59d109f service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:08.842130 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a26130-5d7e-43e5-9bcb-35e5f59d109f service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:08.842395 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a26130-5d7e-43e5-9bcb-35e5f59d109f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:08.851623 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a26130-5d7e-43e5-9bcb-35e5f59d109f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:08.853018 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a26130-5d7e-43e5-9bcb-35e5f59d109f service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:08.862743 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 946/1899] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:09.463230 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc3566-81fb-4dc8-865d-4f13ee91928f None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:09.465981 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-8ffc3566-81fb-4dc8-865d-4f13ee91928f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:09.484935 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc3566-81fb-4dc8-865d-4f13ee91928f None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:09.490937 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e92126-2664-4cb0-a87d-8f4b1ab8cafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:09.492046 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e92126-2664-4cb0-a87d-8f4b1ab8cafe admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:09.492489 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e92126-2664-4cb0-a87d-8f4b1ab8cafe admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:09.492844 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e92126-2664-4cb0-a87d-8f4b1ab8cafe admin admin] PATH_INFO: `/v3/projects/69fcca9c08f945079051cd44a90982d6` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:09.494220 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e92126-2664-4cb0-a87d-8f4b1ab8cafe admin admin] RBAC: Authorizing `identity:delete_project(project_id=69fcca9c08f945079051cd44a90982d6)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:09.496725 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e92126-2664-4cb0-a87d-8f4b1ab8cafe admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:09.504958 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:09.574816 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-72e92126-2664-4cb0-a87d-8f4b1ab8cafe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69fcca9c08f945079051cd44a90982d6', 'request_id': 'req-72e92126-2664-4cb0-a87d-8f4b1ab8cafe'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:09.584075 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-72e92126-2664-4cb0-a87d-8f4b1ab8cafe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69fcca9c08f945079051cd44a90982d6', 'request_id': 'req-72e92126-2664-4cb0-a87d-8f4b1ab8cafe'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:09.597307 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-72e92126-2664-4cb0-a87d-8f4b1ab8cafe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69fcca9c08f945079051cd44a90982d6', 'request_id': 'req-72e92126-2664-4cb0-a87d-8f4b1ab8cafe'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:09.615644 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-72e92126-2664-4cb0-a87d-8f4b1ab8cafe admin admin] The token cache is being invalidate because project 69fcca9c08f945079051cd44a90982d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:09.616183 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-72e92126-2664-4cb0-a87d-8f4b1ab8cafe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:09.616962 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-72e92126-2664-4cb0-a87d-8f4b1ab8cafe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:09.623000 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 954/1900] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:09 2022] DELETE /identity/v3/projects/69fcca9c08f945079051cd44a90982d6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:09.624365 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a26130-5d7e-43e5-9bcb-35e5f59d109f service neutron] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:09.634965 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a26130-5d7e-43e5-9bcb-35e5f59d109f service neutron] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:09.737378 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e2b68-2999-49da-8934-ba4670d4da20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:09.738036 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e2b68-2999-49da-8934-ba4670d4da20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:09.738476 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e2b68-2999-49da-8934-ba4670d4da20 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:09.738884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e2b68-2999-49da-8934-ba4670d4da20 admin admin] PATH_INFO: `/v3/users/9d09c031e086416f986b9ecda61baf36` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:09.740608 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e2b68-2999-49da-8934-ba4670d4da20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d09c031e086416f986b9ecda61baf36)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:09.742684 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e2b68-2999-49da-8934-ba4670d4da20 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:09.805740 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-7d1e2b68-2999-49da-8934-ba4670d4da20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d09c031e086416f986b9ecda61baf36'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:09.806485 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-7d1e2b68-2999-49da-8934-ba4670d4da20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d09c031e086416f986b9ecda61baf36'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:09.807003 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-7d1e2b68-2999-49da-8934-ba4670d4da20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d09c031e086416f986b9ecda61baf36'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:09.822193 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-7d1e2b68-2999-49da-8934-ba4670d4da20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d09c031e086416f986b9ecda61baf36'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:09.852911 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-7d1e2b68-2999-49da-8934-ba4670d4da20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d09c031e086416f986b9ecda61baf36'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:09.867975 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 947/1901] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:09 2022] DELETE /identity/v3/users/9d09c031e086416f986b9ecda61baf36 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:10.683794 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e92126-2664-4cb0-a87d-8f4b1ab8cafe admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:10.685453 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-72e92126-2664-4cb0-a87d-8f4b1ab8cafe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:10.716551 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e92126-2664-4cb0-a87d-8f4b1ab8cafe admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:10.798071 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e90ae-bb25-4e75-9821-3f9712aef13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:10.798734 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e90ae-bb25-4e75-9821-3f9712aef13f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:10.799017 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e90ae-bb25-4e75-9821-3f9712aef13f admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:10.799291 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e90ae-bb25-4e75-9821-3f9712aef13f admin admin] PATH_INFO: `/v3/projects/075d37cda17242dfbf47128fa3edf2b7` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:10.804086 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e90ae-bb25-4e75-9821-3f9712aef13f admin admin] RBAC: Authorizing `identity:delete_project(project_id=075d37cda17242dfbf47128fa3edf2b7)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:10.806123 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5e90ae-bb25-4e75-9821-3f9712aef13f admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:10.908018 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-bd5e90ae-bb25-4e75-9821-3f9712aef13f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '075d37cda17242dfbf47128fa3edf2b7', 'request_id': 'req-bd5e90ae-bb25-4e75-9821-3f9712aef13f'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:10.917954 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-bd5e90ae-bb25-4e75-9821-3f9712aef13f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '075d37cda17242dfbf47128fa3edf2b7', 'request_id': 'req-bd5e90ae-bb25-4e75-9821-3f9712aef13f'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:10.935743 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-bd5e90ae-bb25-4e75-9821-3f9712aef13f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '075d37cda17242dfbf47128fa3edf2b7', 'request_id': 'req-bd5e90ae-bb25-4e75-9821-3f9712aef13f'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:10.956610 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-bd5e90ae-bb25-4e75-9821-3f9712aef13f admin admin] The token cache is being invalidate because project 075d37cda17242dfbf47128fa3edf2b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:10.957081 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-bd5e90ae-bb25-4e75-9821-3f9712aef13f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:10.960056 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-bd5e90ae-bb25-4e75-9821-3f9712aef13f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:10.962634 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 955/1902] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:10 2022] DELETE /identity/v3/projects/075d37cda17242dfbf47128fa3edf2b7 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:10.967571 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d08183-712a-4681-91e7-791f61cdcc50 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:10.968122 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d08183-712a-4681-91e7-791f61cdcc50 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:10.968220 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d08183-712a-4681-91e7-791f61cdcc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:11.028553 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-d6d08183-712a-4681-91e7-791f61cdcc50 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:11.030505 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-d6d08183-712a-4681-91e7-791f61cdcc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:11.043253 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:11.197983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 948/1903] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:11.206018 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e76b5d-a4fc-46c8-b4dd-4ac6ac3f8133 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:11.206524 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e76b5d-a4fc-46c8-b4dd-4ac6ac3f8133 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:11.206985 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e76b5d-a4fc-46c8-b4dd-4ac6ac3f8133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:11.286023 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-a4e76b5d-a4fc-46c8-b4dd-4ac6ac3f8133 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:11.292270 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-a4e76b5d-a4fc-46c8-b4dd-4ac6ac3f8133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:11.322887 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 956/1904] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:11.324920 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d08183-712a-4681-91e7-791f61cdcc50 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:11.336305 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d08183-712a-4681-91e7-791f61cdcc50 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:11.345515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac04a1-39c3-4473-a2fc-987d2956ee64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:11.346151 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac04a1-39c3-4473-a2fc-987d2956ee64 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:11.346429 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac04a1-39c3-4473-a2fc-987d2956ee64 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:11.346701 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac04a1-39c3-4473-a2fc-987d2956ee64 admin admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:11.347355 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac04a1-39c3-4473-a2fc-987d2956ee64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:11.347662 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac04a1-39c3-4473-a2fc-987d2956ee64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:11.349382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac04a1-39c3-4473-a2fc-987d2956ee64 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:11.365980 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 949/1905] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:11.367364 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e76b5d-a4fc-46c8-b4dd-4ac6ac3f8133 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:11.379281 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e76b5d-a4fc-46c8-b4dd-4ac6ac3f8133 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:11.384385 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec06c24-3bf2-4490-b0ac-1e95bbe5f861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:11.385061 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec06c24-3bf2-4490-b0ac-1e95bbe5f861 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:11.385355 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec06c24-3bf2-4490-b0ac-1e95bbe5f861 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:11.385640 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec06c24-3bf2-4490-b0ac-1e95bbe5f861 admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:11.386280 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec06c24-3bf2-4490-b0ac-1e95bbe5f861 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:11.388269 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec06c24-3bf2-4490-b0ac-1e95bbe5f861 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:11.407246 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:11.423467 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 957/1906] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:11 2022] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:11.427803 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac04a1-39c3-4473-a2fc-987d2956ee64 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:11.438686 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac04a1-39c3-4473-a2fc-987d2956ee64 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:11.503011 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a77c2e-2016-402b-a296-73b315f8f31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:11.503617 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a77c2e-2016-402b-a296-73b315f8f31a admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:11.503901 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a77c2e-2016-402b-a296-73b315f8f31a admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:11.504177 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a77c2e-2016-402b-a296-73b315f8f31a admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:11.504808 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a77c2e-2016-402b-a296-73b315f8f31a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:11.506779 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a77c2e-2016-402b-a296-73b315f8f31a admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:11.529611 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 950/1907] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:11 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:11.535976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec06c24-3bf2-4490-b0ac-1e95bbe5f861 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:11.546703 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec06c24-3bf2-4490-b0ac-1e95bbe5f861 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:11.551874 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1beb16a-b221-42da-8848-79f95f79933d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:11.552547 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1beb16a-b221-42da-8848-79f95f79933d admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:11.552830 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1beb16a-b221-42da-8848-79f95f79933d admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:11.553105 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1beb16a-b221-42da-8848-79f95f79933d admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:11.553917 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1beb16a-b221-42da-8848-79f95f79933d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:11.555529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1beb16a-b221-42da-8848-79f95f79933d admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:11.567270 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 958/1908] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:11.571666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a77c2e-2016-402b-a296-73b315f8f31a admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:11.582195 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a77c2e-2016-402b-a296-73b315f8f31a admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:11.586928 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbfdbe0-38e0-4ca7-8896-4ecdd10af23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:11.587567 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfdbe0-38e0-4ca7-8896-4ecdd10af23a admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:11.587872 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfdbe0-38e0-4ca7-8896-4ecdd10af23a admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:11.588147 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfdbe0-38e0-4ca7-8896-4ecdd10af23a admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:11.588797 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbfdbe0-38e0-4ca7-8896-4ecdd10af23a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:11.590483 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbfdbe0-38e0-4ca7-8896-4ecdd10af23a admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:11.605892 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 951/1909] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:50:11.607182 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1beb16a-b221-42da-8848-79f95f79933d admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:11.619315 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1beb16a-b221-42da-8848-79f95f79933d admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:11.626276 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435b202-d432-42f6-973d-2e594b61a53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:11.626997 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435b202-d432-42f6-973d-2e594b61a53c admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:11.627286 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435b202-d432-42f6-973d-2e594b61a53c admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:11.627587 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435b202-d432-42f6-973d-2e594b61a53c admin admin] PATH_INFO: `/v3/projects/406de2b822bb4e858ae910d4f3b66cfb/users/3d3c85501a6345f98fc04e4e5e29718d/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:11.652045 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7435b202-d432-42f6-973d-2e594b61a53c admin admin] RBAC: Authorizing `identity:create_grant(project_id=406de2b822bb4e858ae910d4f3b66cfb, user_id=3d3c85501a6345f98fc04e4e5e29718d, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:11.654794 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7435b202-d432-42f6-973d-2e594b61a53c admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:11.677394 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 959/1910] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:11 2022] PUT /identity/v3/projects/406de2b822bb4e858ae910d4f3b66cfb/users/3d3c85501a6345f98fc04e4e5e29718d/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:11.689874 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3fa68-daab-4d69-aa00-aca12c9a86b1 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:11.690149 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3fa68-daab-4d69-aa00-aca12c9a86b1 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:11.690721 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c3fa68-daab-4d69-aa00-aca12c9a86b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:11.749274 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-94c3fa68-daab-4d69-aa00-aca12c9a86b1 None None] MFA Rules not processed for user `3d3c85501a6345f98fc04e4e5e29718d`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:11.750929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-94c3fa68-daab-4d69-aa00-aca12c9a86b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:11.821699 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 952/1911] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:11.826166 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435b202-d432-42f6-973d-2e594b61a53c admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:11.903458 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435b202-d432-42f6-973d-2e594b61a53c admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:11.909203 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a0ebb-6894-4ed4-b0d5-f4f1df3bc332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:11.910020 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a0ebb-6894-4ed4-b0d5-f4f1df3bc332 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:11.910434 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a0ebb-6894-4ed4-b0d5-f4f1df3bc332 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:11.910828 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a0ebb-6894-4ed4-b0d5-f4f1df3bc332 admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:11.911801 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a0ebb-6894-4ed4-b0d5-f4f1df3bc332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:11.913891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a0ebb-6894-4ed4-b0d5-f4f1df3bc332 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:11.956199 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 960/1912] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:11 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:11.960473 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3fa68-daab-4d69-aa00-aca12c9a86b1 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:11.967495 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:11.972321 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c3fa68-daab-4d69-aa00-aca12c9a86b1 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:12.041396 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe8f2e-475d-4a81-ae63-fa873dc580f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:12.042119 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe8f2e-475d-4a81-ae63-fa873dc580f6 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:12.042471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe8f2e-475d-4a81-ae63-fa873dc580f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:12.042814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe8f2e-475d-4a81-ae63-fa873dc580f6 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:12.043661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe8f2e-475d-4a81-ae63-fa873dc580f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:12.045607 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe8f2e-475d-4a81-ae63-fa873dc580f6 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:12.069598 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 953/1913] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:11 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:12.074015 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a0ebb-6894-4ed4-b0d5-f4f1df3bc332 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:12.086277 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a0ebb-6894-4ed4-b0d5-f4f1df3bc332 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:12.093577 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8cfa50-4b8b-48df-bcbc-4662aeb542d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:12.094375 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8cfa50-4b8b-48df-bcbc-4662aeb542d1 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:12.094648 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8cfa50-4b8b-48df-bcbc-4662aeb542d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:12.094942 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8cfa50-4b8b-48df-bcbc-4662aeb542d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:12.095602 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8cfa50-4b8b-48df-bcbc-4662aeb542d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:12.097718 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8cfa50-4b8b-48df-bcbc-4662aeb542d1 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:12.113203 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 961/1914] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:12.114060 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe8f2e-475d-4a81-ae63-fa873dc580f6 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:12.126122 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe8f2e-475d-4a81-ae63-fa873dc580f6 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:12.132973 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eef4d4-d20f-44e2-a9dc-ea6da0237892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:12.132973 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eef4d4-d20f-44e2-a9dc-ea6da0237892 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:12.133486 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eef4d4-d20f-44e2-a9dc-ea6da0237892 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:12.133893 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eef4d4-d20f-44e2-a9dc-ea6da0237892 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:12.134653 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eef4d4-d20f-44e2-a9dc-ea6da0237892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:12.136621 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eef4d4-d20f-44e2-a9dc-ea6da0237892 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:12.149709 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 954/1915] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:12.154015 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8cfa50-4b8b-48df-bcbc-4662aeb542d1 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:12.173570 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8cfa50-4b8b-48df-bcbc-4662aeb542d1 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:12.184715 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696db17-2a09-4f3f-b308-9ad186f2716f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:12.185416 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696db17-2a09-4f3f-b308-9ad186f2716f admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:12.185696 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696db17-2a09-4f3f-b308-9ad186f2716f admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:12.185966 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6696db17-2a09-4f3f-b308-9ad186f2716f admin admin] PATH_INFO: `/v3/projects/574497caa84b48e38a034bc22de7a767/users/3b42a72425f242d2b7a7a0929b66f530/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:12.202087 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6696db17-2a09-4f3f-b308-9ad186f2716f admin admin] RBAC: Authorizing `identity:create_grant(project_id=574497caa84b48e38a034bc22de7a767, user_id=3b42a72425f242d2b7a7a0929b66f530, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:12.206155 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6696db17-2a09-4f3f-b308-9ad186f2716f admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:12.232009 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 962/1916] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:12 2022] PUT /identity/v3/projects/574497caa84b48e38a034bc22de7a767/users/3b42a72425f242d2b7a7a0929b66f530/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:12.244066 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efe617-eede-430c-921a-c05154a933f9 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:12.244352 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efe617-eede-430c-921a-c05154a933f9 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:12.244622 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efe617-eede-430c-921a-c05154a933f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:12.288220 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-48efe617-eede-430c-921a-c05154a933f9 None None] MFA Rules not processed for user `3b42a72425f242d2b7a7a0929b66f530`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:12.289695 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-48efe617-eede-430c-921a-c05154a933f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:12.399856 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 955/1917] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:12.404086 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696db17-2a09-4f3f-b308-9ad186f2716f admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:12.573653 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6696db17-2a09-4f3f-b308-9ad186f2716f admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:12.589932 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd9a8c-0a77-4ddb-a44c-4e8ed7f14078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:12.590491 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd9a8c-0a77-4ddb-a44c-4e8ed7f14078 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:12.590770 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd9a8c-0a77-4ddb-a44c-4e8ed7f14078 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:12.591045 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd9a8c-0a77-4ddb-a44c-4e8ed7f14078 admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:12.591724 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd9a8c-0a77-4ddb-a44c-4e8ed7f14078 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:12.594172 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd9a8c-0a77-4ddb-a44c-4e8ed7f14078 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:12.638093 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:12.663349 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 963/1918] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:12 2022] POST /identity/v3/projects => generated 385 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:50:12.666034 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48efe617-eede-430c-921a-c05154a933f9 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:12.682172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48efe617-eede-430c-921a-c05154a933f9 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:12.797855 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644377a-42cb-40e8-9cfc-128c372dca14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:12.798532 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644377a-42cb-40e8-9cfc-128c372dca14 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:12.798868 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644377a-42cb-40e8-9cfc-128c372dca14 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:12.799124 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644377a-42cb-40e8-9cfc-128c372dca14 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:12.799811 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644377a-42cb-40e8-9cfc-128c372dca14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:12.801855 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644377a-42cb-40e8-9cfc-128c372dca14 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:12.838490 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 956/1919] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:12 2022] POST /identity/v3/users => generated 299 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:12.842549 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd9a8c-0a77-4ddb-a44c-4e8ed7f14078 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:12.865267 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd9a8c-0a77-4ddb-a44c-4e8ed7f14078 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:12.871405 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde54a4-4116-47dc-b525-95550355ec74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:12.872314 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde54a4-4116-47dc-b525-95550355ec74 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:12.872800 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde54a4-4116-47dc-b525-95550355ec74 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:12.873241 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde54a4-4116-47dc-b525-95550355ec74 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:12.874754 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde54a4-4116-47dc-b525-95550355ec74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:12.876817 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde54a4-4116-47dc-b525-95550355ec74 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:12.888499 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 964/1920] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:12.893484 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644377a-42cb-40e8-9cfc-128c372dca14 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:12.898844 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:12.905366 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644377a-42cb-40e8-9cfc-128c372dca14 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:12.911790 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528a146-918d-4857-a7be-7e4f2bb04139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:12.912874 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528a146-918d-4857-a7be-7e4f2bb04139 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:12.914472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528a146-918d-4857-a7be-7e4f2bb04139 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:12.914886 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f528a146-918d-4857-a7be-7e4f2bb04139 admin admin] PATH_INFO: `/v3/projects/aef0b1c17a19465681651ef17044f064/users/dcd50a07a0464ff9b19b708e2025630f/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:12.932070 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f528a146-918d-4857-a7be-7e4f2bb04139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aef0b1c17a19465681651ef17044f064, user_id=dcd50a07a0464ff9b19b708e2025630f, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:12.934915 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f528a146-918d-4857-a7be-7e4f2bb04139 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:12.953234 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 957/1921] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:12 2022] PUT /identity/v3/projects/aef0b1c17a19465681651ef17044f064/users/dcd50a07a0464ff9b19b708e2025630f/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:50:12.956990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde54a4-4116-47dc-b525-95550355ec74 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:12.970023 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde54a4-4116-47dc-b525-95550355ec74 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:13.038279 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb540b-20b6-4c60-a02c-450970a631af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:13.039039 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb540b-20b6-4c60-a02c-450970a631af admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:13.039363 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb540b-20b6-4c60-a02c-450970a631af admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:13.039645 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb540b-20b6-4c60-a02c-450970a631af admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:13.040296 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb540b-20b6-4c60-a02c-450970a631af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:13.041955 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb540b-20b6-4c60-a02c-450970a631af admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:13.052856 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 965/1922] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:13.056987 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528a146-918d-4857-a7be-7e4f2bb04139 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:13.068999 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f528a146-918d-4857-a7be-7e4f2bb04139 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:13.074498 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60abe3-e70d-4c2d-8592-cfd6f77c79fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:13.075557 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60abe3-e70d-4c2d-8592-cfd6f77c79fc admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:13.075907 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60abe3-e70d-4c2d-8592-cfd6f77c79fc admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:13.076304 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60abe3-e70d-4c2d-8592-cfd6f77c79fc admin admin] PATH_INFO: `/v3/projects/aef0b1c17a19465681651ef17044f064/users/dcd50a07a0464ff9b19b708e2025630f/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:13.078550 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60abe3-e70d-4c2d-8592-cfd6f77c79fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=aef0b1c17a19465681651ef17044f064, user_id=dcd50a07a0464ff9b19b708e2025630f, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:13.081342 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f60abe3-e70d-4c2d-8592-cfd6f77c79fc admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:13.093435 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 958/1923] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:13 2022] PUT /identity/v3/projects/aef0b1c17a19465681651ef17044f064/users/dcd50a07a0464ff9b19b708e2025630f/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:50:13.103796 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18107473-2ad2-4707-acd3-defad4cf62e5 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:13.104083 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18107473-2ad2-4707-acd3-defad4cf62e5 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:13.104751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18107473-2ad2-4707-acd3-defad4cf62e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:13.141179 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-18107473-2ad2-4707-acd3-defad4cf62e5 None None] MFA Rules not processed for user `dcd50a07a0464ff9b19b708e2025630f`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:13.142423 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-18107473-2ad2-4707-acd3-defad4cf62e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:13.219458 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 966/1924] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:13 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:13.232169 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60abe3-e70d-4c2d-8592-cfd6f77c79fc admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:13.234131 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-7f60abe3-e70d-4c2d-8592-cfd6f77c79fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:13.303820 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60abe3-e70d-4c2d-8592-cfd6f77c79fc admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:13.307504 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ee008-107c-4c33-9526-84adffacc21b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:13.308095 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ee008-107c-4c33-9526-84adffacc21b service cinder] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:13.308375 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ee008-107c-4c33-9526-84adffacc21b service cinder] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:13.308668 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ee008-107c-4c33-9526-84adffacc21b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:13.318494 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ee008-107c-4c33-9526-84adffacc21b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:13.319953 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ee008-107c-4c33-9526-84adffacc21b service cinder] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:13.333144 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 959/1925] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:13 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:13.549978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18107473-2ad2-4707-acd3-defad4cf62e5 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:13.552118 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-18107473-2ad2-4707-acd3-defad4cf62e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:13.626567 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18107473-2ad2-4707-acd3-defad4cf62e5 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:13.632467 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72215e4-9ab5-49ae-a26d-23c7b392bd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:13.633276 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72215e4-9ab5-49ae-a26d-23c7b392bd2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:13.633660 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72215e4-9ab5-49ae-a26d-23c7b392bd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:13.633916 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72215e4-9ab5-49ae-a26d-23c7b392bd2a admin admin] PATH_INFO: `/v3/users/219f9f5a9c8d46ffab9e0a380cf05504` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:13.635164 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72215e4-9ab5-49ae-a26d-23c7b392bd2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=219f9f5a9c8d46ffab9e0a380cf05504)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:13.637476 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72215e4-9ab5-49ae-a26d-23c7b392bd2a admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:13.645792 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:13.709277 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b72215e4-9ab5-49ae-a26d-23c7b392bd2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '219f9f5a9c8d46ffab9e0a380cf05504'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:13.710214 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b72215e4-9ab5-49ae-a26d-23c7b392bd2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '219f9f5a9c8d46ffab9e0a380cf05504'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:13.711486 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b72215e4-9ab5-49ae-a26d-23c7b392bd2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '219f9f5a9c8d46ffab9e0a380cf05504'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:13.745318 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b72215e4-9ab5-49ae-a26d-23c7b392bd2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '219f9f5a9c8d46ffab9e0a380cf05504'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:13.761913 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b72215e4-9ab5-49ae-a26d-23c7b392bd2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '219f9f5a9c8d46ffab9e0a380cf05504'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:13.787360 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 967/1926] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:13 2022] DELETE /identity/v3/users/219f9f5a9c8d46ffab9e0a380cf05504 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:13.789105 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ef184-ddc3-492c-abe3-3eb2dd55f563 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:13.789419 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ef184-ddc3-492c-abe3-3eb2dd55f563 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:13.789693 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8ef184-ddc3-492c-abe3-3eb2dd55f563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:13.813532 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-5e8ef184-ddc3-492c-abe3-3eb2dd55f563 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:13.814753 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-5e8ef184-ddc3-492c-abe3-3eb2dd55f563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:13.928091 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 960/1927] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:50:13.938512 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72215e4-9ab5-49ae-a26d-23c7b392bd2a admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:13.940472 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-b72215e4-9ab5-49ae-a26d-23c7b392bd2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:14.070234 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72215e4-9ab5-49ae-a26d-23c7b392bd2a admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:14.074206 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26217629-a1f0-4148-b9c4-ccc14686e4d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:14.075246 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26217629-a1f0-4148-b9c4-ccc14686e4d3 service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:14.075246 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26217629-a1f0-4148-b9c4-ccc14686e4d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:14.075451 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26217629-a1f0-4148-b9c4-ccc14686e4d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:14.086475 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26217629-a1f0-4148-b9c4-ccc14686e4d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:14.087988 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26217629-a1f0-4148-b9c4-ccc14686e4d3 service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:14.099450 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 968/1928] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:14.486845 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ef184-ddc3-492c-abe3-3eb2dd55f563 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:14.488354 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-5e8ef184-ddc3-492c-abe3-3eb2dd55f563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:14.525377 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26217629-a1f0-4148-b9c4-ccc14686e4d3 service neutron] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:14.526664 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-26217629-a1f0-4148-b9c4-ccc14686e4d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:14.543167 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26217629-a1f0-4148-b9c4-ccc14686e4d3 service neutron] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:14.549820 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152490c1-3bab-48aa-9ec9-3469324853e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:14.550615 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152490c1-3bab-48aa-9ec9-3469324853e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:14.550982 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152490c1-3bab-48aa-9ec9-3469324853e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:14.551268 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152490c1-3bab-48aa-9ec9-3469324853e3 admin admin] PATH_INFO: `/v3/projects/8b14e1c303294d24b998d5a9e115e0f8` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:14.552743 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152490c1-3bab-48aa-9ec9-3469324853e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b14e1c303294d24b998d5a9e115e0f8)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:14.555654 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152490c1-3bab-48aa-9ec9-3469324853e3 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:14.651094 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8ef184-ddc3-492c-abe3-3eb2dd55f563 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:14.659077 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-152490c1-3bab-48aa-9ec9-3469324853e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b14e1c303294d24b998d5a9e115e0f8', 'request_id': 'req-152490c1-3bab-48aa-9ec9-3469324853e3'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:14.668378 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-152490c1-3bab-48aa-9ec9-3469324853e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b14e1c303294d24b998d5a9e115e0f8', 'request_id': 'req-152490c1-3bab-48aa-9ec9-3469324853e3'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:14.686425 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-152490c1-3bab-48aa-9ec9-3469324853e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b14e1c303294d24b998d5a9e115e0f8', 'request_id': 'req-152490c1-3bab-48aa-9ec9-3469324853e3'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:14.692479 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:14.705448 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-152490c1-3bab-48aa-9ec9-3469324853e3 admin admin] The token cache is being invalidate because project 8b14e1c303294d24b998d5a9e115e0f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:14.706073 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-152490c1-3bab-48aa-9ec9-3469324853e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:14.707248 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-152490c1-3bab-48aa-9ec9-3469324853e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:14.714116 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 969/1929] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:14 2022] DELETE /identity/v3/projects/8b14e1c303294d24b998d5a9e115e0f8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:14.717019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152490c1-3bab-48aa-9ec9-3469324853e3 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:14.718839 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-152490c1-3bab-48aa-9ec9-3469324853e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:14.736166 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5438a572-b6bd-418c-9357-105409069216 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:14.736996 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438a572-b6bd-418c-9357-105409069216 service cinder] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:14.737218 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438a572-b6bd-418c-9357-105409069216 service cinder] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:14.737536 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5438a572-b6bd-418c-9357-105409069216 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:14.739530 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-5438a572-b6bd-418c-9357-105409069216 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:14.740002 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:14.814900 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152490c1-3bab-48aa-9ec9-3469324853e3 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:14.820570 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28cb405-bfdb-46e7-9c84-ddc7e9177236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:14.821855 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cb405-bfdb-46e7-9c84-ddc7e9177236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:14.822246 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cb405-bfdb-46e7-9c84-ddc7e9177236 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:14.822417 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cb405-bfdb-46e7-9c84-ddc7e9177236 admin admin] PATH_INFO: `/v3/users/9004e6b1150140e79341699aec0e9f38` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:14.824631 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28cb405-bfdb-46e7-9c84-ddc7e9177236 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9004e6b1150140e79341699aec0e9f38)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:14.827592 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28cb405-bfdb-46e7-9c84-ddc7e9177236 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:14.843161 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5438a572-b6bd-418c-9357-105409069216 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:14.845004 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5438a572-b6bd-418c-9357-105409069216 service cinder] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:14.865424 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 961/1930] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:14 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:14.890663 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-f28cb405-bfdb-46e7-9c84-ddc7e9177236 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9004e6b1150140e79341699aec0e9f38'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:14.891434 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-f28cb405-bfdb-46e7-9c84-ddc7e9177236 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9004e6b1150140e79341699aec0e9f38'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:14.892113 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-f28cb405-bfdb-46e7-9c84-ddc7e9177236 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9004e6b1150140e79341699aec0e9f38'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:14.904093 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-f28cb405-bfdb-46e7-9c84-ddc7e9177236 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9004e6b1150140e79341699aec0e9f38'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:14.913258 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-f28cb405-bfdb-46e7-9c84-ddc7e9177236 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9004e6b1150140e79341699aec0e9f38'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:14.927038 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 970/1931] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:14 2022] DELETE /identity/v3/users/9004e6b1150140e79341699aec0e9f38 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:50:15.289052 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5438a572-b6bd-418c-9357-105409069216 service cinder] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:15.300665 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5438a572-b6bd-418c-9357-105409069216 service cinder] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:15.358930 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf9358-9a07-4b99-9d91-dd2e3e229e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:15.359538 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf9358-9a07-4b99-9d91-dd2e3e229e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:15.359849 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf9358-9a07-4b99-9d91-dd2e3e229e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:15.360124 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf9358-9a07-4b99-9d91-dd2e3e229e07 admin admin] PATH_INFO: `/v3/projects/09b30e04266a4c6eaab13449923f20bf` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:15.361285 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf9358-9a07-4b99-9d91-dd2e3e229e07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09b30e04266a4c6eaab13449923f20bf)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:15.363234 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf9358-9a07-4b99-9d91-dd2e3e229e07 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:15.411327 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-93cf9358-9a07-4b99-9d91-dd2e3e229e07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09b30e04266a4c6eaab13449923f20bf', 'request_id': 'req-93cf9358-9a07-4b99-9d91-dd2e3e229e07'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:15.420226 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-93cf9358-9a07-4b99-9d91-dd2e3e229e07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09b30e04266a4c6eaab13449923f20bf', 'request_id': 'req-93cf9358-9a07-4b99-9d91-dd2e3e229e07'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:15.427163 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-93cf9358-9a07-4b99-9d91-dd2e3e229e07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09b30e04266a4c6eaab13449923f20bf', 'request_id': 'req-93cf9358-9a07-4b99-9d91-dd2e3e229e07'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:15.439457 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-93cf9358-9a07-4b99-9d91-dd2e3e229e07 admin admin] The token cache is being invalidate because project 09b30e04266a4c6eaab13449923f20bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:15.439716 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-93cf9358-9a07-4b99-9d91-dd2e3e229e07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:15.440385 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-93cf9358-9a07-4b99-9d91-dd2e3e229e07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:15.441942 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 962/1932] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:15 2022] DELETE /identity/v3/projects/09b30e04266a4c6eaab13449923f20bf => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:15.447083 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04a41d-30ba-4677-8c31-cb74b2e20614 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:15.447601 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04a41d-30ba-4677-8c31-cb74b2e20614 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:15.447601 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04a41d-30ba-4677-8c31-cb74b2e20614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:15.467493 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-ff04a41d-30ba-4677-8c31-cb74b2e20614 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:15.468585 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-ff04a41d-30ba-4677-8c31-cb74b2e20614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:15.551780 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 971/1933] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:15.555100 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ff462-b178-438a-ac19-bbe5511bce2c None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:15.555571 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ff462-b178-438a-ac19-bbe5511bce2c None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:15.555759 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ff462-b178-438a-ac19-bbe5511bce2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:15.575819 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-ab0ff462-b178-438a-ac19-bbe5511bce2c None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:15.577150 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-ab0ff462-b178-438a-ac19-bbe5511bce2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:15.585825 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 963/1934] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:15.589720 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04a41d-30ba-4677-8c31-cb74b2e20614 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:15.603428 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04a41d-30ba-4677-8c31-cb74b2e20614 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:15.608487 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bceb3-bfe7-41f1-8b7d-84366adbfc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:15.609158 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bceb3-bfe7-41f1-8b7d-84366adbfc90 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:15.609479 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bceb3-bfe7-41f1-8b7d-84366adbfc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:15.609755 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bceb3-bfe7-41f1-8b7d-84366adbfc90 admin admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:15.610412 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84bceb3-bfe7-41f1-8b7d-84366adbfc90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:15.610713 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84bceb3-bfe7-41f1-8b7d-84366adbfc90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:15.612334 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84bceb3-bfe7-41f1-8b7d-84366adbfc90 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:15.627424 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 972/1935] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:15.632472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ff462-b178-438a-ac19-bbe5511bce2c None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:15.637915 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:15.644515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ff462-b178-438a-ac19-bbe5511bce2c None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:15.650638 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fb420-d3e6-4b53-9e1c-8622d1b92abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:15.651326 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fb420-d3e6-4b53-9e1c-8622d1b92abc admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:15.651604 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fb420-d3e6-4b53-9e1c-8622d1b92abc admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:15.651875 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fb420-d3e6-4b53-9e1c-8622d1b92abc admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:15.652508 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68fb420-d3e6-4b53-9e1c-8622d1b92abc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:15.654991 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68fb420-d3e6-4b53-9e1c-8622d1b92abc admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:15.689456 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 964/1936] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:15 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:15.691620 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bceb3-bfe7-41f1-8b7d-84366adbfc90 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:15.703476 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bceb3-bfe7-41f1-8b7d-84366adbfc90 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:15.723090 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:15.775143 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce93363-9fee-4297-9239-65433fab53d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:15.775777 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce93363-9fee-4297-9239-65433fab53d4 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:15.776059 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce93363-9fee-4297-9239-65433fab53d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:15.776334 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce93363-9fee-4297-9239-65433fab53d4 admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:15.776979 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce93363-9fee-4297-9239-65433fab53d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:15.779751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce93363-9fee-4297-9239-65433fab53d4 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:15.804787 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 973/1937] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:15 2022] POST /identity/v3/users => generated 283 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:15.809389 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fb420-d3e6-4b53-9e1c-8622d1b92abc admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:15.824113 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fb420-d3e6-4b53-9e1c-8622d1b92abc admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:15.829654 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19277c5-82d6-4e40-a2f7-be8e4e1f67d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:15.830280 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19277c5-82d6-4e40-a2f7-be8e4e1f67d1 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:15.830541 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19277c5-82d6-4e40-a2f7-be8e4e1f67d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:15.831102 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19277c5-82d6-4e40-a2f7-be8e4e1f67d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:15.831920 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19277c5-82d6-4e40-a2f7-be8e4e1f67d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:15.833805 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19277c5-82d6-4e40-a2f7-be8e4e1f67d1 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:15.846175 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 965/1938] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:15.850748 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce93363-9fee-4297-9239-65433fab53d4 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:15.864388 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce93363-9fee-4297-9239-65433fab53d4 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:15.870153 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5833de8-1df1-4de8-acc8-f0abfe77b6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:15.870766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5833de8-1df1-4de8-acc8-f0abfe77b6c5 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:15.871050 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5833de8-1df1-4de8-acc8-f0abfe77b6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:15.871362 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5833de8-1df1-4de8-acc8-f0abfe77b6c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:15.872173 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5833de8-1df1-4de8-acc8-f0abfe77b6c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:15.873763 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5833de8-1df1-4de8-acc8-f0abfe77b6c5 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:15.885712 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 974/1939] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:50:15.890114 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19277c5-82d6-4e40-a2f7-be8e4e1f67d1 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:15.901737 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19277c5-82d6-4e40-a2f7-be8e4e1f67d1 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:15.909361 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc787db0-654e-458a-b10c-11a7a1e77517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:15.910962 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc787db0-654e-458a-b10c-11a7a1e77517 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:15.911243 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc787db0-654e-458a-b10c-11a7a1e77517 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:15.911834 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc787db0-654e-458a-b10c-11a7a1e77517 admin admin] PATH_INFO: `/v3/projects/df6f6be5681449a1b51975886ebf4748/users/174e031b076d4b5ea5fc51ab06c282ec/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:15.929529 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc787db0-654e-458a-b10c-11a7a1e77517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df6f6be5681449a1b51975886ebf4748, user_id=174e031b076d4b5ea5fc51ab06c282ec, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:15.932490 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc787db0-654e-458a-b10c-11a7a1e77517 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:15.959599 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 966/1940] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:15 2022] PUT /identity/v3/projects/df6f6be5681449a1b51975886ebf4748/users/174e031b076d4b5ea5fc51ab06c282ec/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:50:15.972794 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d53d83-a941-4a90-a651-f7af55967878 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:15.973152 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d53d83-a941-4a90-a651-f7af55967878 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:15.973524 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d53d83-a941-4a90-a651-f7af55967878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:16.014586 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-59d53d83-a941-4a90-a651-f7af55967878 None None] MFA Rules not processed for user `174e031b076d4b5ea5fc51ab06c282ec`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:16.016030 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-59d53d83-a941-4a90-a651-f7af55967878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:16.165766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 975/1941] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:16.170370 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc787db0-654e-458a-b10c-11a7a1e77517 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:16.263490 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc787db0-654e-458a-b10c-11a7a1e77517 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:16.268980 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0151de7-00e6-41e7-815b-719aa84a6bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:16.269798 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0151de7-00e6-41e7-815b-719aa84a6bca admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:16.270082 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0151de7-00e6-41e7-815b-719aa84a6bca admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:16.270382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0151de7-00e6-41e7-815b-719aa84a6bca admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:16.271038 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0151de7-00e6-41e7-815b-719aa84a6bca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:16.273034 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0151de7-00e6-41e7-815b-719aa84a6bca admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:16.302829 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 967/1942] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:16 2022] POST /identity/v3/projects => generated 367 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:16.308966 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d53d83-a941-4a90-a651-f7af55967878 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:16.324612 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d53d83-a941-4a90-a651-f7af55967878 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:16.402833 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66be45-1e45-47c4-8a94-01406c9a9d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:16.403461 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66be45-1e45-47c4-8a94-01406c9a9d68 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:16.403741 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66be45-1e45-47c4-8a94-01406c9a9d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:16.404021 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66be45-1e45-47c4-8a94-01406c9a9d68 admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:16.404872 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66be45-1e45-47c4-8a94-01406c9a9d68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:16.407363 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66be45-1e45-47c4-8a94-01406c9a9d68 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:16.433425 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 976/1943] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:16 2022] POST /identity/v3/users => generated 290 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:16.437776 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0151de7-00e6-41e7-815b-719aa84a6bca admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:16.449633 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0151de7-00e6-41e7-815b-719aa84a6bca admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:16.455993 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a4dc3-cff5-42a7-9587-2cb8b4fda8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:16.456873 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a4dc3-cff5-42a7-9587-2cb8b4fda8cf admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:16.457255 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a4dc3-cff5-42a7-9587-2cb8b4fda8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:16.458321 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a4dc3-cff5-42a7-9587-2cb8b4fda8cf admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:16.459312 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a4dc3-cff5-42a7-9587-2cb8b4fda8cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:16.463294 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a4dc3-cff5-42a7-9587-2cb8b4fda8cf admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:16.476248 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 968/1944] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:16.480537 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66be45-1e45-47c4-8a94-01406c9a9d68 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:16.491629 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66be45-1e45-47c4-8a94-01406c9a9d68 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:16.496623 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c5d69-c167-44ed-92e2-157de6e94bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:16.497388 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c5d69-c167-44ed-92e2-157de6e94bb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:16.497388 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c5d69-c167-44ed-92e2-157de6e94bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:16.497675 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c5d69-c167-44ed-92e2-157de6e94bb2 admin admin] PATH_INFO: `/v3/projects/4595de2ba514433699f628045b6263f9/users/fb3e990e8de744c3b8c278367abd6c92/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:16.512612 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:16.517678 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51c5d69-c167-44ed-92e2-157de6e94bb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4595de2ba514433699f628045b6263f9, user_id=fb3e990e8de744c3b8c278367abd6c92, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:16.520837 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51c5d69-c167-44ed-92e2-157de6e94bb2 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:16.536497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 977/1945] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:16 2022] PUT /identity/v3/projects/4595de2ba514433699f628045b6263f9/users/fb3e990e8de744c3b8c278367abd6c92/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:16.540458 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a4dc3-cff5-42a7-9587-2cb8b4fda8cf admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:16.556988 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a4dc3-cff5-42a7-9587-2cb8b4fda8cf admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:16.624876 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e8976-ba33-4917-a55f-ed65b96747d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:16.625847 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e8976-ba33-4917-a55f-ed65b96747d8 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:16.627074 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e8976-ba33-4917-a55f-ed65b96747d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:16.627514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e8976-ba33-4917-a55f-ed65b96747d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:16.628331 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e8976-ba33-4917-a55f-ed65b96747d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:16.630565 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e8976-ba33-4917-a55f-ed65b96747d8 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:16.647267 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 969/1946] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:16 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:16.648894 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c5d69-c167-44ed-92e2-157de6e94bb2 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:16.659441 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c5d69-c167-44ed-92e2-157de6e94bb2 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:16.664214 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30b014-3437-44fa-a0b3-b44f298264fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:16.664986 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30b014-3437-44fa-a0b3-b44f298264fb admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:16.665324 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30b014-3437-44fa-a0b3-b44f298264fb admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:16.665684 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30b014-3437-44fa-a0b3-b44f298264fb admin admin] PATH_INFO: `/v3/projects/4595de2ba514433699f628045b6263f9/users/fb3e990e8de744c3b8c278367abd6c92/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:16.667665 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30b014-3437-44fa-a0b3-b44f298264fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4595de2ba514433699f628045b6263f9, user_id=fb3e990e8de744c3b8c278367abd6c92, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:16.670428 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30b014-3437-44fa-a0b3-b44f298264fb admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:16.689194 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 978/1947] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:16 2022] PUT /identity/v3/projects/4595de2ba514433699f628045b6263f9/users/fb3e990e8de744c3b8c278367abd6c92/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:16.694399 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c251494-62ce-442b-9cf0-384a6ba4d684 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:16.694729 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c251494-62ce-442b-9cf0-384a6ba4d684 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:16.695000 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c251494-62ce-442b-9cf0-384a6ba4d684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:16.730429 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-6c251494-62ce-442b-9cf0-384a6ba4d684 None None] MFA Rules not processed for user `fb3e990e8de744c3b8c278367abd6c92`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:16.731760 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-6c251494-62ce-442b-9cf0-384a6ba4d684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:16.737464 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:16.835216 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 970/1948] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:16 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:16.849607 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30b014-3437-44fa-a0b3-b44f298264fb admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:16.851634 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-2c30b014-3437-44fa-a0b3-b44f298264fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:16.930971 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30b014-3437-44fa-a0b3-b44f298264fb admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:16.940401 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c9fbd-cdb2-4d55-ab85-cd23c62580c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:16.941128 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c9fbd-cdb2-4d55-ab85-cd23c62580c4 service cinder] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:16.941427 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c9fbd-cdb2-4d55-ab85-cd23c62580c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:16.941774 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c9fbd-cdb2-4d55-ab85-cd23c62580c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:16.957140 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c9fbd-cdb2-4d55-ab85-cd23c62580c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:16.959191 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c9fbd-cdb2-4d55-ab85-cd23c62580c4 service cinder] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:16.971020 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 979/1949] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:16 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:17.076672 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c251494-62ce-442b-9cf0-384a6ba4d684 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:17.087844 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c251494-62ce-442b-9cf0-384a6ba4d684 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:17.091456 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e7968-251a-4ad9-8830-fdd5fa4322e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:17.092098 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e7968-251a-4ad9-8830-fdd5fa4322e1 service cinder] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:17.092364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e7968-251a-4ad9-8830-fdd5fa4322e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:17.092629 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e7968-251a-4ad9-8830-fdd5fa4322e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:17.157503 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e7968-251a-4ad9-8830-fdd5fa4322e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:17.159073 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e7968-251a-4ad9-8830-fdd5fa4322e1 service cinder] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:17.169226 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 971/1950] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:19.296285 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c9fbd-cdb2-4d55-ab85-cd23c62580c4 service cinder] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:19.305198 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c9fbd-cdb2-4d55-ab85-cd23c62580c4 service cinder] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:19.320938 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328c963-08c5-4c50-a66b-6378904c6823 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:19.321629 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328c963-08c5-4c50-a66b-6378904c6823 service cinder] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:19.322007 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328c963-08c5-4c50-a66b-6378904c6823 service cinder] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:19.322289 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328c963-08c5-4c50-a66b-6378904c6823 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:19.324323 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-b328c963-08c5-4c50-a66b-6378904c6823 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:19.470287 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328c963-08c5-4c50-a66b-6378904c6823 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:19.471790 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328c963-08c5-4c50-a66b-6378904c6823 service cinder] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:19.482581 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 980/1951] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:22.252384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e7968-251a-4ad9-8830-fdd5fa4322e1 service cinder] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:22.254055 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-097e7968-251a-4ad9-8830-fdd5fa4322e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:22.328882 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e7968-251a-4ad9-8830-fdd5fa4322e1 service cinder] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:22.334297 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e898cc-9789-43cb-865b-fb57e5276db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:22.335439 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e898cc-9789-43cb-865b-fb57e5276db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:22.335725 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e898cc-9789-43cb-865b-fb57e5276db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:22.336000 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e898cc-9789-43cb-865b-fb57e5276db9 admin admin] PATH_INFO: `/v3/users/ed86315487aa47739e660332df287afb` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:22.338322 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e898cc-9789-43cb-865b-fb57e5276db9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed86315487aa47739e660332df287afb)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:22.340313 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e898cc-9789-43cb-865b-fb57e5276db9 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:22.383410 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328c963-08c5-4c50-a66b-6378904c6823 service cinder] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:22.385101 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-b328c963-08c5-4c50-a66b-6378904c6823 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:22.397296 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:22.399273 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328c963-08c5-4c50-a66b-6378904c6823 service cinder] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:22.404184 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14145e-cedc-4ff9-acbe-49716826e0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:22.404870 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14145e-cedc-4ff9-acbe-49716826e0f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:22.405324 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14145e-cedc-4ff9-acbe-49716826e0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:22.405783 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14145e-cedc-4ff9-acbe-49716826e0f2 admin admin] PATH_INFO: `/v3/users/3d3c85501a6345f98fc04e4e5e29718d` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:22.407179 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-91e898cc-9789-43cb-865b-fb57e5276db9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed86315487aa47739e660332df287afb'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:22.407303 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14145e-cedc-4ff9-acbe-49716826e0f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d3c85501a6345f98fc04e4e5e29718d)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:22.407853 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-91e898cc-9789-43cb-865b-fb57e5276db9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed86315487aa47739e660332df287afb'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:22.408534 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-91e898cc-9789-43cb-865b-fb57e5276db9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed86315487aa47739e660332df287afb'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:22.409186 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14145e-cedc-4ff9-acbe-49716826e0f2 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:22.424976 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-91e898cc-9789-43cb-865b-fb57e5276db9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed86315487aa47739e660332df287afb'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:22.434079 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-91e898cc-9789-43cb-865b-fb57e5276db9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed86315487aa47739e660332df287afb'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:22.453398 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 972/1952] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:22 2022] DELETE /identity/v3/users/ed86315487aa47739e660332df287afb => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:22.456865 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77fa09-aa41-4daa-8c44-e96323968d78 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:22.457146 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77fa09-aa41-4daa-8c44-e96323968d78 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:22.457512 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c77fa09-aa41-4daa-8c44-e96323968d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:22.462479 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-ef14145e-cedc-4ff9-acbe-49716826e0f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d3c85501a6345f98fc04e4e5e29718d'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:22.463225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-ef14145e-cedc-4ff9-acbe-49716826e0f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d3c85501a6345f98fc04e4e5e29718d'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:22.463923 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-ef14145e-cedc-4ff9-acbe-49716826e0f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d3c85501a6345f98fc04e4e5e29718d'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:22.476426 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-ef14145e-cedc-4ff9-acbe-49716826e0f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d3c85501a6345f98fc04e4e5e29718d'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:22.478695 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-4c77fa09-aa41-4daa-8c44-e96323968d78 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:22.479885 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-4c77fa09-aa41-4daa-8c44-e96323968d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:22.486247 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-ef14145e-cedc-4ff9-acbe-49716826e0f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d3c85501a6345f98fc04e4e5e29718d'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:22.488516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:22.504562 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 981/1953] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:22 2022] DELETE /identity/v3/users/3d3c85501a6345f98fc04e4e5e29718d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:50:22.506191 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3973cf2-700e-49e8-94d4-18b0a30c76ff None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:22.506480 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3973cf2-700e-49e8-94d4-18b0a30c76ff None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:22.506760 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3973cf2-700e-49e8-94d4-18b0a30c76ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:22.525386 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-f3973cf2-700e-49e8-94d4-18b0a30c76ff None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:22.526618 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-f3973cf2-700e-49e8-94d4-18b0a30c76ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:22.551380 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 973/1954] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:50:22.561311 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77fa09-aa41-4daa-8c44-e96323968d78 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:22.562824 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-4c77fa09-aa41-4daa-8c44-e96323968d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:22.586858 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 982/1955] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:50:22.596346 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3973cf2-700e-49e8-94d4-18b0a30c76ff None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:22.598100 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-f3973cf2-700e-49e8-94d4-18b0a30c76ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:22.626835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c77fa09-aa41-4daa-8c44-e96323968d78 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:22.678977 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3973cf2-700e-49e8-94d4-18b0a30c76ff None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:22.680288 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b523ed6-0fd2-4064-882d-fc90e0464a18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:22.680957 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b523ed6-0fd2-4064-882d-fc90e0464a18 service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:22.681242 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b523ed6-0fd2-4064-882d-fc90e0464a18 service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:22.681562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b523ed6-0fd2-4064-882d-fc90e0464a18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:22.697529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1d9d0-94c3-4188-85a8-1d8289ddaf08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:22.698717 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1d9d0-94c3-4188-85a8-1d8289ddaf08 service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:22.699084 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1d9d0-94c3-4188-85a8-1d8289ddaf08 service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:22.699437 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1d9d0-94c3-4188-85a8-1d8289ddaf08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:22.704690 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b523ed6-0fd2-4064-882d-fc90e0464a18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:22.706658 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b523ed6-0fd2-4064-882d-fc90e0464a18 service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:22.716463 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1d9d0-94c3-4188-85a8-1d8289ddaf08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:22.717942 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1d9d0-94c3-4188-85a8-1d8289ddaf08 service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:22.721062 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 974/1956] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:50:22.734545 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 983/1957] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:50:22.823181 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b523ed6-0fd2-4064-882d-fc90e0464a18 service neutron] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:22.824714 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-4b523ed6-0fd2-4064-882d-fc90e0464a18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:22.838973 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b523ed6-0fd2-4064-882d-fc90e0464a18 service neutron] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:22.843838 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c331059-3643-4af0-a349-f8e7bf0fbd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:22.844535 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c331059-3643-4af0-a349-f8e7bf0fbd01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:22.844923 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c331059-3643-4af0-a349-f8e7bf0fbd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:22.845309 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c331059-3643-4af0-a349-f8e7bf0fbd01 admin admin] PATH_INFO: `/v3/users/174e031b076d4b5ea5fc51ab06c282ec` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:22.846677 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c331059-3643-4af0-a349-f8e7bf0fbd01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=174e031b076d4b5ea5fc51ab06c282ec)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:22.848841 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c331059-3643-4af0-a349-f8e7bf0fbd01 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:22.862597 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:22.903269 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1d9d0-94c3-4188-85a8-1d8289ddaf08 service neutron] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:22.905274 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-a5c1d9d0-94c3-4188-85a8-1d8289ddaf08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:22.913317 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-4c331059-3643-4af0-a349-f8e7bf0fbd01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '174e031b076d4b5ea5fc51ab06c282ec'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:22.914095 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-4c331059-3643-4af0-a349-f8e7bf0fbd01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '174e031b076d4b5ea5fc51ab06c282ec'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:22.914827 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-4c331059-3643-4af0-a349-f8e7bf0fbd01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '174e031b076d4b5ea5fc51ab06c282ec'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:22.928417 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1d9d0-94c3-4188-85a8-1d8289ddaf08 service neutron] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:22.930345 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-4c331059-3643-4af0-a349-f8e7bf0fbd01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '174e031b076d4b5ea5fc51ab06c282ec'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:22.935874 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60fe8d6-552e-4945-83ec-38ef2fd30236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:22.937174 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fe8d6-552e-4945-83ec-38ef2fd30236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:22.937689 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fe8d6-552e-4945-83ec-38ef2fd30236 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:22.938100 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fe8d6-552e-4945-83ec-38ef2fd30236 admin admin] PATH_INFO: `/v3/users/b89f176d7baa44f9b50c10522e63f024` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:22.939584 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-4c331059-3643-4af0-a349-f8e7bf0fbd01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '174e031b076d4b5ea5fc51ab06c282ec'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:22.940106 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60fe8d6-552e-4945-83ec-38ef2fd30236 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b89f176d7baa44f9b50c10522e63f024)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:22.943430 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60fe8d6-552e-4945-83ec-38ef2fd30236 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:22.956346 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 975/1958] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:22 2022] DELETE /identity/v3/users/174e031b076d4b5ea5fc51ab06c282ec => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:50:22.961099 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba0479-f600-415d-be65-d42926740b95 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:22.961713 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba0479-f600-415d-be65-d42926740b95 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:22.961852 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba0479-f600-415d-be65-d42926740b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:23.015291 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-e5ba0479-f600-415d-be65-d42926740b95 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:23.018522 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-e5ba0479-f600-415d-be65-d42926740b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:23.042220 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-e60fe8d6-552e-4945-83ec-38ef2fd30236 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b89f176d7baa44f9b50c10522e63f024'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:23.043239 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-e60fe8d6-552e-4945-83ec-38ef2fd30236 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b89f176d7baa44f9b50c10522e63f024'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:23.044332 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-e60fe8d6-552e-4945-83ec-38ef2fd30236 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b89f176d7baa44f9b50c10522e63f024'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:23.093629 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-e60fe8d6-552e-4945-83ec-38ef2fd30236 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b89f176d7baa44f9b50c10522e63f024'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:23.102976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-e60fe8d6-552e-4945-83ec-38ef2fd30236 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b89f176d7baa44f9b50c10522e63f024'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:23.129385 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 984/1959] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:22 2022] DELETE /identity/v3/users/b89f176d7baa44f9b50c10522e63f024 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:23.130575 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 976/1960] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:50:23.132424 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecb05c-473d-4911-aeb3-6f14b8269746 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:23.132933 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecb05c-473d-4911-aeb3-6f14b8269746 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:23.133664 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecb05c-473d-4911-aeb3-6f14b8269746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:23.150277 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:23.160350 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-89ecb05c-473d-4911-aeb3-6f14b8269746 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:23.162626 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-89ecb05c-473d-4911-aeb3-6f14b8269746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:23.166927 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba0479-f600-415d-be65-d42926740b95 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:23.169100 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-e5ba0479-f600-415d-be65-d42926740b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:23.271685 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba0479-f600-415d-be65-d42926740b95 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:23.323403 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 985/1961] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:50:23.324658 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ecb05c-473d-4911-aeb3-6f14b8269746 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:23.326224 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-89ecb05c-473d-4911-aeb3-6f14b8269746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:23.342114 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ecb05c-473d-4911-aeb3-6f14b8269746 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:23.354878 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:23.360047 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bce46-4b9d-4038-b8f1-e3fae2acc4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:23.360910 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bce46-4b9d-4038-b8f1-e3fae2acc4ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:23.361503 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bce46-4b9d-4038-b8f1-e3fae2acc4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:23.361901 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97bce46-4b9d-4038-b8f1-e3fae2acc4ce admin admin] PATH_INFO: `/v3/projects/406de2b822bb4e858ae910d4f3b66cfb` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:23.363300 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97bce46-4b9d-4038-b8f1-e3fae2acc4ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=406de2b822bb4e858ae910d4f3b66cfb)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:23.365524 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97bce46-4b9d-4038-b8f1-e3fae2acc4ce admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:23.368323 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d713d7-f09b-46c1-ae72-103605319f0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:23.369276 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d713d7-f09b-46c1-ae72-103605319f0d service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:23.369701 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d713d7-f09b-46c1-ae72-103605319f0d service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:23.370092 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d713d7-f09b-46c1-ae72-103605319f0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:23.391465 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d713d7-f09b-46c1-ae72-103605319f0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:23.394067 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d713d7-f09b-46c1-ae72-103605319f0d service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:23.412062 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 977/1962] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:23.413577 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d713d7-f09b-46c1-ae72-103605319f0d service neutron] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:23.415239 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-29d713d7-f09b-46c1-ae72-103605319f0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:23.428513 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d713d7-f09b-46c1-ae72-103605319f0d service neutron] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:23.443684 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-c97bce46-4b9d-4038-b8f1-e3fae2acc4ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '406de2b822bb4e858ae910d4f3b66cfb', 'request_id': 'req-c97bce46-4b9d-4038-b8f1-e3fae2acc4ce'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:23.462950 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-c97bce46-4b9d-4038-b8f1-e3fae2acc4ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '406de2b822bb4e858ae910d4f3b66cfb', 'request_id': 'req-c97bce46-4b9d-4038-b8f1-e3fae2acc4ce'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:23.476732 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-c97bce46-4b9d-4038-b8f1-e3fae2acc4ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '406de2b822bb4e858ae910d4f3b66cfb', 'request_id': 'req-c97bce46-4b9d-4038-b8f1-e3fae2acc4ce'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:23.492698 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-c97bce46-4b9d-4038-b8f1-e3fae2acc4ce admin admin] The token cache is being invalidate because project 406de2b822bb4e858ae910d4f3b66cfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:23.492996 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-c97bce46-4b9d-4038-b8f1-e3fae2acc4ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:23.493785 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-c97bce46-4b9d-4038-b8f1-e3fae2acc4ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:23.496129 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 986/1963] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:23 2022] DELETE /identity/v3/projects/406de2b822bb4e858ae910d4f3b66cfb => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:23.500436 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bce46-4b9d-4038-b8f1-e3fae2acc4ce admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:23.502020 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-c97bce46-4b9d-4038-b8f1-e3fae2acc4ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:23.506425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1a350-2ad9-4e1d-b1c4-c20c39fbe3d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:23.509421 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1a350-2ad9-4e1d-b1c4-c20c39fbe3d2 service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:23.509803 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1a350-2ad9-4e1d-b1c4-c20c39fbe3d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:23.510173 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1a350-2ad9-4e1d-b1c4-c20c39fbe3d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:23.512602 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-89d1a350-2ad9-4e1d-b1c4-c20c39fbe3d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:23.609998 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97bce46-4b9d-4038-b8f1-e3fae2acc4ce admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:23.616721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e73f27-3a07-4b0c-80d7-90d8bbc1e60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:23.617665 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e73f27-3a07-4b0c-80d7-90d8bbc1e60e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:23.618013 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e73f27-3a07-4b0c-80d7-90d8bbc1e60e admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:23.618411 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e73f27-3a07-4b0c-80d7-90d8bbc1e60e admin admin] PATH_INFO: `/v3/users/3b42a72425f242d2b7a7a0929b66f530` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:23.619837 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e73f27-3a07-4b0c-80d7-90d8bbc1e60e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b42a72425f242d2b7a7a0929b66f530)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:23.622204 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e73f27-3a07-4b0c-80d7-90d8bbc1e60e admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:23.625972 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1a350-2ad9-4e1d-b1c4-c20c39fbe3d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:23.629101 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1a350-2ad9-4e1d-b1c4-c20c39fbe3d2 service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:23.646159 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 978/1964] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:23.647407 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1a350-2ad9-4e1d-b1c4-c20c39fbe3d2 service neutron] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:23.649368 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-89d1a350-2ad9-4e1d-b1c4-c20c39fbe3d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:23.667862 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1a350-2ad9-4e1d-b1c4-c20c39fbe3d2 service neutron] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:23.672509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:23.674479 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63affcc1-c00a-449b-a3d5-24719f219608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:23.675458 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63affcc1-c00a-449b-a3d5-24719f219608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:23.676103 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63affcc1-c00a-449b-a3d5-24719f219608 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:23.676440 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63affcc1-c00a-449b-a3d5-24719f219608 admin admin] PATH_INFO: `/v3/projects/b926c5b55ef04a4c9b8eaf37abd1a5ee` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:23.678263 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63affcc1-c00a-449b-a3d5-24719f219608 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b926c5b55ef04a4c9b8eaf37abd1a5ee)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:23.680798 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63affcc1-c00a-449b-a3d5-24719f219608 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:23.698995 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-58e73f27-3a07-4b0c-80d7-90d8bbc1e60e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b42a72425f242d2b7a7a0929b66f530'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:23.699772 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-58e73f27-3a07-4b0c-80d7-90d8bbc1e60e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b42a72425f242d2b7a7a0929b66f530'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:23.700734 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-58e73f27-3a07-4b0c-80d7-90d8bbc1e60e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b42a72425f242d2b7a7a0929b66f530'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:23.719580 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-58e73f27-3a07-4b0c-80d7-90d8bbc1e60e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b42a72425f242d2b7a7a0929b66f530'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:23.731166 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-58e73f27-3a07-4b0c-80d7-90d8bbc1e60e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b42a72425f242d2b7a7a0929b66f530'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:23.754465 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-63affcc1-c00a-449b-a3d5-24719f219608 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b926c5b55ef04a4c9b8eaf37abd1a5ee', 'request_id': 'req-63affcc1-c00a-449b-a3d5-24719f219608'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:23.759435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 987/1965] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:23 2022] DELETE /identity/v3/users/3b42a72425f242d2b7a7a0929b66f530 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:50:23.767270 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-63affcc1-c00a-449b-a3d5-24719f219608 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b926c5b55ef04a4c9b8eaf37abd1a5ee', 'request_id': 'req-63affcc1-c00a-449b-a3d5-24719f219608'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:23.775998 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-63affcc1-c00a-449b-a3d5-24719f219608 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b926c5b55ef04a4c9b8eaf37abd1a5ee', 'request_id': 'req-63affcc1-c00a-449b-a3d5-24719f219608'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:23.790155 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-63affcc1-c00a-449b-a3d5-24719f219608 admin admin] The token cache is being invalidate because project b926c5b55ef04a4c9b8eaf37abd1a5ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:23.790458 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-63affcc1-c00a-449b-a3d5-24719f219608 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:23.791256 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-63affcc1-c00a-449b-a3d5-24719f219608 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:23.792804 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 979/1966] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:23 2022] DELETE /identity/v3/projects/b926c5b55ef04a4c9b8eaf37abd1a5ee => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:23.796854 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e73f27-3a07-4b0c-80d7-90d8bbc1e60e admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:23.798513 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-58e73f27-3a07-4b0c-80d7-90d8bbc1e60e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:23.919717 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e73f27-3a07-4b0c-80d7-90d8bbc1e60e admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:23.925664 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c7734-9a14-4400-aa8f-3e5a85a073a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:23.926326 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c7734-9a14-4400-aa8f-3e5a85a073a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:23.926609 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c7734-9a14-4400-aa8f-3e5a85a073a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:23.926885 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c7734-9a14-4400-aa8f-3e5a85a073a8 admin admin] PATH_INFO: `/v3/users/ba687606cbcd4272b9bba6361d913262` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:23.928232 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c7734-9a14-4400-aa8f-3e5a85a073a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba687606cbcd4272b9bba6361d913262)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:23.930072 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c7734-9a14-4400-aa8f-3e5a85a073a8 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:24.001590 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-aa0c7734-9a14-4400-aa8f-3e5a85a073a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba687606cbcd4272b9bba6361d913262'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:24.002589 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-aa0c7734-9a14-4400-aa8f-3e5a85a073a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba687606cbcd4272b9bba6361d913262'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:24.003243 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-aa0c7734-9a14-4400-aa8f-3e5a85a073a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba687606cbcd4272b9bba6361d913262'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:24.019945 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-aa0c7734-9a14-4400-aa8f-3e5a85a073a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba687606cbcd4272b9bba6361d913262'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:24.032951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-aa0c7734-9a14-4400-aa8f-3e5a85a073a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba687606cbcd4272b9bba6361d913262'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:24.050125 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 988/1967] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:23 2022] DELETE /identity/v3/users/ba687606cbcd4272b9bba6361d913262 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:24.234341 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63affcc1-c00a-449b-a3d5-24719f219608 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:24.235890 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-63affcc1-c00a-449b-a3d5-24719f219608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:24.275591 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:24.327857 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c7734-9a14-4400-aa8f-3e5a85a073a8 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:24.329873 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-aa0c7734-9a14-4400-aa8f-3e5a85a073a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:24.344508 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63affcc1-c00a-449b-a3d5-24719f219608 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:24.396315 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:24.447453 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c7734-9a14-4400-aa8f-3e5a85a073a8 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:24.452764 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d6003-314e-4ca7-95ff-4457d0f66e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:24.453473 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d6003-314e-4ca7-95ff-4457d0f66e23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:24.453755 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d6003-314e-4ca7-95ff-4457d0f66e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:24.454028 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d6003-314e-4ca7-95ff-4457d0f66e23 admin admin] PATH_INFO: `/v3/projects/df6f6be5681449a1b51975886ebf4748` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:24.455192 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d6003-314e-4ca7-95ff-4457d0f66e23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df6f6be5681449a1b51975886ebf4748)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:24.457469 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d6003-314e-4ca7-95ff-4457d0f66e23 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:24.462967 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6884218c-d794-43e5-a943-5cb78fa24d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:24.465561 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884218c-d794-43e5-a943-5cb78fa24d69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:24.466143 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884218c-d794-43e5-a943-5cb78fa24d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:24.491220 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884218c-d794-43e5-a943-5cb78fa24d69 admin admin] PATH_INFO: `/v3/projects/74b4bba822bb4e67b1e7dca8fc02cb8c` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:24.493130 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6884218c-d794-43e5-a943-5cb78fa24d69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74b4bba822bb4e67b1e7dca8fc02cb8c)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:24.499518 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6884218c-d794-43e5-a943-5cb78fa24d69 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:24.519374 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-3c9d6003-314e-4ca7-95ff-4457d0f66e23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df6f6be5681449a1b51975886ebf4748', 'request_id': 'req-3c9d6003-314e-4ca7-95ff-4457d0f66e23'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:24.529756 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-3c9d6003-314e-4ca7-95ff-4457d0f66e23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df6f6be5681449a1b51975886ebf4748', 'request_id': 'req-3c9d6003-314e-4ca7-95ff-4457d0f66e23'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:24.541840 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-3c9d6003-314e-4ca7-95ff-4457d0f66e23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df6f6be5681449a1b51975886ebf4748', 'request_id': 'req-3c9d6003-314e-4ca7-95ff-4457d0f66e23'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:24.569356 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-3c9d6003-314e-4ca7-95ff-4457d0f66e23 admin admin] The token cache is being invalidate because project df6f6be5681449a1b51975886ebf4748 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:24.569356 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-3c9d6003-314e-4ca7-95ff-4457d0f66e23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:24.571080 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-3c9d6003-314e-4ca7-95ff-4457d0f66e23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:24.574734 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 989/1968] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:24 2022] DELETE /identity/v3/projects/df6f6be5681449a1b51975886ebf4748 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:24.579481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d6003-314e-4ca7-95ff-4457d0f66e23 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:24.583579 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-3c9d6003-314e-4ca7-95ff-4457d0f66e23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:24.592955 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-6884218c-d794-43e5-a943-5cb78fa24d69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74b4bba822bb4e67b1e7dca8fc02cb8c', 'request_id': 'req-6884218c-d794-43e5-a943-5cb78fa24d69'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:24.623395 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-6884218c-d794-43e5-a943-5cb78fa24d69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74b4bba822bb4e67b1e7dca8fc02cb8c', 'request_id': 'req-6884218c-d794-43e5-a943-5cb78fa24d69'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:24.635981 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-6884218c-d794-43e5-a943-5cb78fa24d69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74b4bba822bb4e67b1e7dca8fc02cb8c', 'request_id': 'req-6884218c-d794-43e5-a943-5cb78fa24d69'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:24.662961 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-6884218c-d794-43e5-a943-5cb78fa24d69 admin admin] The token cache is being invalidate because project 74b4bba822bb4e67b1e7dca8fc02cb8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:24.663321 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-6884218c-d794-43e5-a943-5cb78fa24d69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:24.665478 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-6884218c-d794-43e5-a943-5cb78fa24d69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:24.671387 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 980/1969] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:24 2022] DELETE /identity/v3/projects/74b4bba822bb4e67b1e7dca8fc02cb8c => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:24.675234 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6884218c-d794-43e5-a943-5cb78fa24d69 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:24.676722 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-6884218c-d794-43e5-a943-5cb78fa24d69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:24.705361 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d6003-314e-4ca7-95ff-4457d0f66e23 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:24.817580 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c8010-8b20-4456-a910-5a1c505e047d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:24.818239 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c8010-8b20-4456-a910-5a1c505e047d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:24.818695 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c8010-8b20-4456-a910-5a1c505e047d admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:24.818981 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c8010-8b20-4456-a910-5a1c505e047d admin admin] PATH_INFO: `/v3/users/fb3e990e8de744c3b8c278367abd6c92` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:24.822538 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c8010-8b20-4456-a910-5a1c505e047d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb3e990e8de744c3b8c278367abd6c92)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:24.825323 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c8010-8b20-4456-a910-5a1c505e047d admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:24.832568 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:24.874813 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6884218c-d794-43e5-a943-5cb78fa24d69 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:24.888094 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c1de3-8c07-4c2a-a9c8-4669f7323a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:24.888757 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c1de3-8c07-4c2a-a9c8-4669f7323a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:24.889048 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c1de3-8c07-4c2a-a9c8-4669f7323a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:24.889307 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c1de3-8c07-4c2a-a9c8-4669f7323a5f admin admin] PATH_INFO: `/v3/users/fcbe0b3a08514c9ab0532850bcdd55e8` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:24.892273 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c1de3-8c07-4c2a-a9c8-4669f7323a5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcbe0b3a08514c9ab0532850bcdd55e8)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:24.892483 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c1de3-8c07-4c2a-a9c8-4669f7323a5f admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:24.909551 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-ef0c8010-8b20-4456-a910-5a1c505e047d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb3e990e8de744c3b8c278367abd6c92'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:24.910316 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-ef0c8010-8b20-4456-a910-5a1c505e047d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb3e990e8de744c3b8c278367abd6c92'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:24.910948 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-ef0c8010-8b20-4456-a910-5a1c505e047d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb3e990e8de744c3b8c278367abd6c92'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:24.914733 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:24.930293 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-ef0c8010-8b20-4456-a910-5a1c505e047d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb3e990e8de744c3b8c278367abd6c92'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:24.942541 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-ef0c8010-8b20-4456-a910-5a1c505e047d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb3e990e8de744c3b8c278367abd6c92'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:24.975991 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 990/1970] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:24 2022] DELETE /identity/v3/users/fb3e990e8de744c3b8c278367abd6c92 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:24.976850 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c8010-8b20-4456-a910-5a1c505e047d admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:24.982926 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-ef0c8010-8b20-4456-a910-5a1c505e047d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:24.998214 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-9d2c1de3-8c07-4c2a-a9c8-4669f7323a5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcbe0b3a08514c9ab0532850bcdd55e8'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:25.001185 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-9d2c1de3-8c07-4c2a-a9c8-4669f7323a5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcbe0b3a08514c9ab0532850bcdd55e8'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:25.002798 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-9d2c1de3-8c07-4c2a-a9c8-4669f7323a5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcbe0b3a08514c9ab0532850bcdd55e8'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:25.035632 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-9d2c1de3-8c07-4c2a-a9c8-4669f7323a5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcbe0b3a08514c9ab0532850bcdd55e8'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:25.051378 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-9d2c1de3-8c07-4c2a-a9c8-4669f7323a5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcbe0b3a08514c9ab0532850bcdd55e8'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:25.069047 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c8010-8b20-4456-a910-5a1c505e047d admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:25.074309 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6fa38f-4900-41fd-8033-a1f6569b3327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:25.074954 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6fa38f-4900-41fd-8033-a1f6569b3327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:25.075297 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6fa38f-4900-41fd-8033-a1f6569b3327 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:25.075687 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6fa38f-4900-41fd-8033-a1f6569b3327 admin admin] PATH_INFO: `/v3/projects/574497caa84b48e38a034bc22de7a767` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:25.079445 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 981/1971] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:24 2022] DELETE /identity/v3/users/fcbe0b3a08514c9ab0532850bcdd55e8 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:25.080460 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c1de3-8c07-4c2a-a9c8-4669f7323a5f admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:25.082396 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-9d2c1de3-8c07-4c2a-a9c8-4669f7323a5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:25.088018 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6fa38f-4900-41fd-8033-a1f6569b3327 admin admin] RBAC: Authorizing `identity:delete_project(project_id=574497caa84b48e38a034bc22de7a767)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:25.090033 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6fa38f-4900-41fd-8033-a1f6569b3327 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:25.204578 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-7a6fa38f-4900-41fd-8033-a1f6569b3327 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '574497caa84b48e38a034bc22de7a767', 'request_id': 'req-7a6fa38f-4900-41fd-8033-a1f6569b3327'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:25.213560 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c1de3-8c07-4c2a-a9c8-4669f7323a5f admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:25.218958 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-7a6fa38f-4900-41fd-8033-a1f6569b3327 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '574497caa84b48e38a034bc22de7a767', 'request_id': 'req-7a6fa38f-4900-41fd-8033-a1f6569b3327'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:25.236855 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-7a6fa38f-4900-41fd-8033-a1f6569b3327 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '574497caa84b48e38a034bc22de7a767', 'request_id': 'req-7a6fa38f-4900-41fd-8033-a1f6569b3327'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:25.250836 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-7a6fa38f-4900-41fd-8033-a1f6569b3327 admin admin] The token cache is being invalidate because project 574497caa84b48e38a034bc22de7a767 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:25.251314 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-7a6fa38f-4900-41fd-8033-a1f6569b3327 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:25.252251 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-7a6fa38f-4900-41fd-8033-a1f6569b3327 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:25.254434 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 991/1972] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:24 2022] DELETE /identity/v3/projects/574497caa84b48e38a034bc22de7a767 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:25.258499 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6fa38f-4900-41fd-8033-a1f6569b3327 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:25.260734 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-7a6fa38f-4900-41fd-8033-a1f6569b3327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:25.295060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:25.348850 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd2d183-74d2-46a3-b821-f05612191de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:25.349672 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2d183-74d2-46a3-b821-f05612191de7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:25.349953 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2d183-74d2-46a3-b821-f05612191de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:25.350362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2d183-74d2-46a3-b821-f05612191de7 admin admin] PATH_INFO: `/v3/projects/c416723b275a4cf2a69e935bb4f10526` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:25.352109 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2d183-74d2-46a3-b821-f05612191de7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c416723b275a4cf2a69e935bb4f10526)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:25.355906 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd2d183-74d2-46a3-b821-f05612191de7 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:25.393248 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6fa38f-4900-41fd-8033-a1f6569b3327 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:25.405317 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e163257-d86b-4e57-9225-98a68407e199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:25.406200 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e163257-d86b-4e57-9225-98a68407e199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:25.407211 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e163257-d86b-4e57-9225-98a68407e199 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:25.407633 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e163257-d86b-4e57-9225-98a68407e199 admin admin] PATH_INFO: `/v3/users/dcd50a07a0464ff9b19b708e2025630f` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:25.409416 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e163257-d86b-4e57-9225-98a68407e199 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcd50a07a0464ff9b19b708e2025630f)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:25.413179 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:25.416932 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e163257-d86b-4e57-9225-98a68407e199 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:25.436852 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-4fd2d183-74d2-46a3-b821-f05612191de7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c416723b275a4cf2a69e935bb4f10526', 'request_id': 'req-4fd2d183-74d2-46a3-b821-f05612191de7'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:25.451043 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-4fd2d183-74d2-46a3-b821-f05612191de7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c416723b275a4cf2a69e935bb4f10526', 'request_id': 'req-4fd2d183-74d2-46a3-b821-f05612191de7'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:25.461864 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-4fd2d183-74d2-46a3-b821-f05612191de7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c416723b275a4cf2a69e935bb4f10526', 'request_id': 'req-4fd2d183-74d2-46a3-b821-f05612191de7'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:25.473763 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-4fd2d183-74d2-46a3-b821-f05612191de7 admin admin] The token cache is being invalidate because project c416723b275a4cf2a69e935bb4f10526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:25.474058 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-4fd2d183-74d2-46a3-b821-f05612191de7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:25.474746 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-4fd2d183-74d2-46a3-b821-f05612191de7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:25.476863 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 982/1973] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:25 2022] DELETE /identity/v3/projects/c416723b275a4cf2a69e935bb4f10526 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:25.482437 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c52ac-b90e-4303-9936-730f6315d01f None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:25.482726 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c52ac-b90e-4303-9936-730f6315d01f None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:25.483118 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c52ac-b90e-4303-9936-730f6315d01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:25.485952 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-5e163257-d86b-4e57-9225-98a68407e199 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcd50a07a0464ff9b19b708e2025630f'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:25.487231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-5e163257-d86b-4e57-9225-98a68407e199 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcd50a07a0464ff9b19b708e2025630f'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:25.488085 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-5e163257-d86b-4e57-9225-98a68407e199 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcd50a07a0464ff9b19b708e2025630f'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:25.506980 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-5e163257-d86b-4e57-9225-98a68407e199 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcd50a07a0464ff9b19b708e2025630f'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:25.508657 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-5a5c52ac-b90e-4303-9936-730f6315d01f None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:25.510075 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-5a5c52ac-b90e-4303-9936-730f6315d01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:25.517833 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-5e163257-d86b-4e57-9225-98a68407e199 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcd50a07a0464ff9b19b708e2025630f'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:25.537845 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 992/1974] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:25 2022] DELETE /identity/v3/users/dcd50a07a0464ff9b19b708e2025630f => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:25.566276 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e163257-d86b-4e57-9225-98a68407e199 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:25.568690 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-5e163257-d86b-4e57-9225-98a68407e199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:25.603626 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 983/1975] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:25.604828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c52ac-b90e-4303-9936-730f6315d01f None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:25.607307 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-5a5c52ac-b90e-4303-9936-730f6315d01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:25.626400 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c52ac-b90e-4303-9936-730f6315d01f None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:25.681989 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e163257-d86b-4e57-9225-98a68407e199 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:25.689138 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365361d-11a8-410c-8b0c-0e92e18dfe1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:25.689937 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365361d-11a8-410c-8b0c-0e92e18dfe1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:25.690273 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365361d-11a8-410c-8b0c-0e92e18dfe1b admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:25.690492 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365361d-11a8-410c-8b0c-0e92e18dfe1b admin admin] PATH_INFO: `/v3/projects/4595de2ba514433699f628045b6263f9` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:25.691685 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3365361d-11a8-410c-8b0c-0e92e18dfe1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4595de2ba514433699f628045b6263f9)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:25.693908 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3365361d-11a8-410c-8b0c-0e92e18dfe1b admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:25.695091 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919ea68-c91c-4365-8c46-e9eb5dea93e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:25.696662 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919ea68-c91c-4365-8c46-e9eb5dea93e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:25.696971 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919ea68-c91c-4365-8c46-e9eb5dea93e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:25.697235 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919ea68-c91c-4365-8c46-e9eb5dea93e0 admin admin] PATH_INFO: `/v3/projects/fdf73b9481c44abeb77ad55758d03303` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:25.698801 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0919ea68-c91c-4365-8c46-e9eb5dea93e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdf73b9481c44abeb77ad55758d03303)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:25.700719 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0919ea68-c91c-4365-8c46-e9eb5dea93e0 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:25.743525 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:25.755559 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-3365361d-11a8-410c-8b0c-0e92e18dfe1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4595de2ba514433699f628045b6263f9', 'request_id': 'req-3365361d-11a8-410c-8b0c-0e92e18dfe1b'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:25.764634 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-3365361d-11a8-410c-8b0c-0e92e18dfe1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4595de2ba514433699f628045b6263f9', 'request_id': 'req-3365361d-11a8-410c-8b0c-0e92e18dfe1b'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:25.775705 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-3365361d-11a8-410c-8b0c-0e92e18dfe1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4595de2ba514433699f628045b6263f9', 'request_id': 'req-3365361d-11a8-410c-8b0c-0e92e18dfe1b'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:25.779856 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-0919ea68-c91c-4365-8c46-e9eb5dea93e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdf73b9481c44abeb77ad55758d03303', 'request_id': 'req-0919ea68-c91c-4365-8c46-e9eb5dea93e0'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:25.789437 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-0919ea68-c91c-4365-8c46-e9eb5dea93e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdf73b9481c44abeb77ad55758d03303', 'request_id': 'req-0919ea68-c91c-4365-8c46-e9eb5dea93e0'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:25.791208 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-3365361d-11a8-410c-8b0c-0e92e18dfe1b admin admin] The token cache is being invalidate because project 4595de2ba514433699f628045b6263f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:25.791695 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-3365361d-11a8-410c-8b0c-0e92e18dfe1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:25.792387 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-3365361d-11a8-410c-8b0c-0e92e18dfe1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:25.792697 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:25.794248 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 993/1976] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:25 2022] DELETE /identity/v3/projects/4595de2ba514433699f628045b6263f9 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:25.795720 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e392273-8f2e-4fd6-919c-86927de46f58 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:25.796057 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e392273-8f2e-4fd6-919c-86927de46f58 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:25.796339 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e392273-8f2e-4fd6-919c-86927de46f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:25.799378 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-0919ea68-c91c-4365-8c46-e9eb5dea93e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdf73b9481c44abeb77ad55758d03303', 'request_id': 'req-0919ea68-c91c-4365-8c46-e9eb5dea93e0'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:25.815404 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-0919ea68-c91c-4365-8c46-e9eb5dea93e0 admin admin] The token cache is being invalidate because project fdf73b9481c44abeb77ad55758d03303 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:25.815774 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-0919ea68-c91c-4365-8c46-e9eb5dea93e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:25.816505 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-0919ea68-c91c-4365-8c46-e9eb5dea93e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:25.818529 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 984/1977] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:25 2022] DELETE /identity/v3/projects/fdf73b9481c44abeb77ad55758d03303 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:25.819973 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6eb73-5646-4c70-88ef-c23fefd153bf None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:25.820697 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6eb73-5646-4c70-88ef-c23fefd153bf None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:25.821045 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6eb73-5646-4c70-88ef-c23fefd153bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:25.821849 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-0e392273-8f2e-4fd6-919c-86927de46f58 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:25.823190 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-0e392273-8f2e-4fd6-919c-86927de46f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:25.843098 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-4ee6eb73-5646-4c70-88ef-c23fefd153bf None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:25.844405 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-4ee6eb73-5646-4c70-88ef-c23fefd153bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:25.909481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 994/1978] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:25.910865 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a626c-6570-4929-a1be-a46e7c910392 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:25.911109 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a626c-6570-4929-a1be-a46e7c910392 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:25.911402 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a626c-6570-4929-a1be-a46e7c910392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:25.941055 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-759a626c-6570-4929-a1be-a46e7c910392 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:25.942504 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-759a626c-6570-4929-a1be-a46e7c910392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:25.952053 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 985/1979] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:25.952053 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6eb73-5646-4c70-88ef-c23fefd153bf None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:25.954801 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-4ee6eb73-5646-4c70-88ef-c23fefd153bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:25.958476 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 995/1980] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:25.959500 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a626c-6570-4929-a1be-a46e7c910392 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:25.969279 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6eb73-5646-4c70-88ef-c23fefd153bf None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:25.970932 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a626c-6570-4929-a1be-a46e7c910392 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:25.975590 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c442a2f-548a-402a-825f-c282b6a1662f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:25.976202 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c442a2f-548a-402a-825f-c282b6a1662f admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:25.976481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c442a2f-548a-402a-825f-c282b6a1662f admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:25.976751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c442a2f-548a-402a-825f-c282b6a1662f admin admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:25.977435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c442a2f-548a-402a-825f-c282b6a1662f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:25.977737 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c442a2f-548a-402a-825f-c282b6a1662f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:25.978513 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a1630-04ca-4c26-b7bf-9e03ecfbc8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:25.979308 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a1630-04ca-4c26-b7bf-9e03ecfbc8b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:25.979453 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c442a2f-548a-402a-825f-c282b6a1662f admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:25.979767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a1630-04ca-4c26-b7bf-9e03ecfbc8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:25.980345 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a1630-04ca-4c26-b7bf-9e03ecfbc8b8 admin admin] PATH_INFO: `/v3/projects/aef0b1c17a19465681651ef17044f064` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:25.981757 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a1630-04ca-4c26-b7bf-9e03ecfbc8b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aef0b1c17a19465681651ef17044f064)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:25.983915 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a1630-04ca-4c26-b7bf-9e03ecfbc8b8 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:25.992574 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 996/1981] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:25.997287 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1056a2-465a-4445-807e-d58dc2e56982 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:25.997624 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1056a2-465a-4445-807e-d58dc2e56982 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:25.997902 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1056a2-465a-4445-807e-d58dc2e56982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:26.023045 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-4b1056a2-465a-4445-807e-d58dc2e56982 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:26.025006 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-4b1056a2-465a-4445-807e-d58dc2e56982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:26.045844 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-4d9a1630-04ca-4c26-b7bf-9e03ecfbc8b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aef0b1c17a19465681651ef17044f064', 'request_id': 'req-4d9a1630-04ca-4c26-b7bf-9e03ecfbc8b8'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:26.058419 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-4d9a1630-04ca-4c26-b7bf-9e03ecfbc8b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aef0b1c17a19465681651ef17044f064', 'request_id': 'req-4d9a1630-04ca-4c26-b7bf-9e03ecfbc8b8'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:26.067102 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-4d9a1630-04ca-4c26-b7bf-9e03ecfbc8b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aef0b1c17a19465681651ef17044f064', 'request_id': 'req-4d9a1630-04ca-4c26-b7bf-9e03ecfbc8b8'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:26.088407 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-4d9a1630-04ca-4c26-b7bf-9e03ecfbc8b8 admin admin] The token cache is being invalidate because project aef0b1c17a19465681651ef17044f064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:26.088671 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-4d9a1630-04ca-4c26-b7bf-9e03ecfbc8b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:26.089433 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-4d9a1630-04ca-4c26-b7bf-9e03ecfbc8b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:26.091260 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 986/1982] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:25 2022] DELETE /identity/v3/projects/aef0b1c17a19465681651ef17044f064 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:26.092526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fafc17-b2fb-4316-80f9-31389b4930fd None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:26.092924 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fafc17-b2fb-4316-80f9-31389b4930fd None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:26.093063 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fafc17-b2fb-4316-80f9-31389b4930fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:26.114351 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-b6fafc17-b2fb-4316-80f9-31389b4930fd None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:26.115726 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-b6fafc17-b2fb-4316-80f9-31389b4930fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:26.130344 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 997/1983] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:26.131776 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1056a2-465a-4445-807e-d58dc2e56982 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:26.145601 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-4b1056a2-465a-4445-807e-d58dc2e56982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:26.150388 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1056a2-465a-4445-807e-d58dc2e56982 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:26.155422 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f040af-54a4-46e8-8e07-0fbcb58bcab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:26.156109 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f040af-54a4-46e8-8e07-0fbcb58bcab4 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:26.156490 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f040af-54a4-46e8-8e07-0fbcb58bcab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:26.156960 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f040af-54a4-46e8-8e07-0fbcb58bcab4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:26.157838 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f040af-54a4-46e8-8e07-0fbcb58bcab4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:26.159636 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f040af-54a4-46e8-8e07-0fbcb58bcab4 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:26.194626 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 987/1984] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:26.199029 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2e853-6470-4861-9997-cbf7d2c69c43 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:26.199329 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2e853-6470-4861-9997-cbf7d2c69c43 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:26.199612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2e853-6470-4861-9997-cbf7d2c69c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:26.203831 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 998/1985] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:26 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:26.203831 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f040af-54a4-46e8-8e07-0fbcb58bcab4 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:26.219752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-d7e2e853-6470-4861-9997-cbf7d2c69c43 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:26.220981 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-d7e2e853-6470-4861-9997-cbf7d2c69c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:26.228790 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:26.239101 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:26.292142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f040af-54a4-46e8-8e07-0fbcb58bcab4 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:26.298208 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc784167-af98-480d-a5b4-79031aac7411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:26.300693 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc784167-af98-480d-a5b4-79031aac7411 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:26.301200 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc784167-af98-480d-a5b4-79031aac7411 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:26.301657 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc784167-af98-480d-a5b4-79031aac7411 admin admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:26.302327 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc784167-af98-480d-a5b4-79031aac7411 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:26.302637 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc784167-af98-480d-a5b4-79031aac7411 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:26.304240 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc784167-af98-480d-a5b4-79031aac7411 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:26.314454 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 988/1986] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:26.318537 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 999/1987] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:26.319717 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc784167-af98-480d-a5b4-79031aac7411 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:26.330457 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc784167-af98-480d-a5b4-79031aac7411 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:26.331483 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2e853-6470-4861-9997-cbf7d2c69c43 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:26.335754 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ebdb0-127b-403d-b954-8e36ab86ae12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:26.336564 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ebdb0-127b-403d-b954-8e36ab86ae12 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:26.337170 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ebdb0-127b-403d-b954-8e36ab86ae12 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:26.337582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ebdb0-127b-403d-b954-8e36ab86ae12 admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:26.338284 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ebdb0-127b-403d-b954-8e36ab86ae12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:26.340655 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ebdb0-127b-403d-b954-8e36ab86ae12 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:26.348632 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2e853-6470-4861-9997-cbf7d2c69c43 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:26.354684 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3bce8-4957-44e6-882b-bed8983bb8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:26.355435 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3bce8-4957-44e6-882b-bed8983bb8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:26.355575 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3bce8-4957-44e6-882b-bed8983bb8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:26.355891 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f3bce8-4957-44e6-882b-bed8983bb8e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:26.356508 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3bce8-4957-44e6-882b-bed8983bb8e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:26.356815 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3bce8-4957-44e6-882b-bed8983bb8e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:26.358528 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f3bce8-4957-44e6-882b-bed8983bb8e6 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:26.365891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1000/1988] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:26 2022] POST /identity/v3/users => generated 293 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:26.367746 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf223208-82a2-41b0-aa57-23be7e281a7e None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:26.368040 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf223208-82a2-41b0-aa57-23be7e281a7e None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:26.368309 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf223208-82a2-41b0-aa57-23be7e281a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:26.371708 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 989/1989] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:26.372679 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3bce8-4957-44e6-882b-bed8983bb8e6 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:26.384495 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f3bce8-4957-44e6-882b-bed8983bb8e6 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:26.391732 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37a7f7-ed13-41b7-b65f-280400afbe4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:26.392455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37a7f7-ed13-41b7-b65f-280400afbe4c admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:26.392610 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-cf223208-82a2-41b0-aa57-23be7e281a7e None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:26.392775 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37a7f7-ed13-41b7-b65f-280400afbe4c admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:26.393084 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f37a7f7-ed13-41b7-b65f-280400afbe4c admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:26.393796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f37a7f7-ed13-41b7-b65f-280400afbe4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:26.393972 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-cf223208-82a2-41b0-aa57-23be7e281a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:26.396431 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f37a7f7-ed13-41b7-b65f-280400afbe4c admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:26.409392 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1001/1990] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:26.411188 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf223208-82a2-41b0-aa57-23be7e281a7e None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:26.424718 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf223208-82a2-41b0-aa57-23be7e281a7e None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:26.431471 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1cd1c-7b01-4526-9595-8abd4320019b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:26.432064 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1cd1c-7b01-4526-9595-8abd4320019b admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:26.432343 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1cd1c-7b01-4526-9595-8abd4320019b admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:26.432637 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1cd1c-7b01-4526-9595-8abd4320019b admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:26.433290 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad1cd1c-7b01-4526-9595-8abd4320019b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:26.433495 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 990/1991] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:26 2022] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:26.434335 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37a7f7-ed13-41b7-b65f-280400afbe4c admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:26.434970 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad1cd1c-7b01-4526-9595-8abd4320019b admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:26.448874 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1002/1992] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:26.448874 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1cd1c-7b01-4526-9595-8abd4320019b admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:26.457355 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1cd1c-7b01-4526-9595-8abd4320019b admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:26.508173 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f37a7f7-ed13-41b7-b65f-280400afbe4c admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:26.513006 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c945e-ef6b-43c0-b633-a89b8246c833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:26.513741 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c945e-ef6b-43c0-b633-a89b8246c833 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:26.514033 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c945e-ef6b-43c0-b633-a89b8246c833 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:26.514305 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c945e-ef6b-43c0-b633-a89b8246c833 admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:26.514939 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c945e-ef6b-43c0-b633-a89b8246c833 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:26.516937 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c945e-ef6b-43c0-b633-a89b8246c833 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:26.524730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe7044-1747-4fd2-9921-f7b8bf99f2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:26.525366 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe7044-1747-4fd2-9921-f7b8bf99f2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:26.525651 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe7044-1747-4fd2-9921-f7b8bf99f2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:26.525921 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe7044-1747-4fd2-9921-f7b8bf99f2e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:26.526570 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe7044-1747-4fd2-9921-f7b8bf99f2e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:26.526875 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe7044-1747-4fd2-9921-f7b8bf99f2e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:26.528469 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe7044-1747-4fd2-9921-f7b8bf99f2e7 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:26.541378 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1003/1993] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:26.542491 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe7044-1747-4fd2-9921-f7b8bf99f2e7 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:26.553310 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe7044-1747-4fd2-9921-f7b8bf99f2e7 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:26.555714 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 991/1994] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:26 2022] POST /identity/v3/projects => generated 381 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:26.557018 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c945e-ef6b-43c0-b633-a89b8246c833 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:26.618018 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef70a4-e7ca-42ad-bad3-325347ca8fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:26.618781 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef70a4-e7ca-42ad-bad3-325347ca8fd6 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:26.619095 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef70a4-e7ca-42ad-bad3-325347ca8fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:26.619374 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef70a4-e7ca-42ad-bad3-325347ca8fd6 admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:26.620623 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef70a4-e7ca-42ad-bad3-325347ca8fd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:26.622766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef70a4-e7ca-42ad-bad3-325347ca8fd6 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:26.623864 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c945e-ef6b-43c0-b633-a89b8246c833 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:26.632853 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929fd282-e473-468d-920a-7215364f351d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:26.634172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fd282-e473-468d-920a-7215364f351d admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:26.634685 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fd282-e473-468d-920a-7215364f351d admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:26.635582 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fd282-e473-468d-920a-7215364f351d admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:26.636751 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929fd282-e473-468d-920a-7215364f351d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:26.638833 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929fd282-e473-468d-920a-7215364f351d admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:26.641580 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:26.649152 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1004/1995] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:26 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:26.653217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef70a4-e7ca-42ad-bad3-325347ca8fd6 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:26.655275 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 992/1996] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:26.656256 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929fd282-e473-468d-920a-7215364f351d admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:26.665480 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef70a4-e7ca-42ad-bad3-325347ca8fd6 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:26.667074 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929fd282-e473-468d-920a-7215364f351d admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:26.680777 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5d0cd-a287-4272-af7a-34c92e34939b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:26.681417 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5d0cd-a287-4272-af7a-34c92e34939b admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:26.681683 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5d0cd-a287-4272-af7a-34c92e34939b admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:26.681947 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5d0cd-a287-4272-af7a-34c92e34939b admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:26.682602 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f5d0cd-a287-4272-af7a-34c92e34939b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:26.684566 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b361b9-87d9-4e94-9f05-aa7a6bc0c4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:26.684694 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f5d0cd-a287-4272-af7a-34c92e34939b admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:26.685204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b361b9-87d9-4e94-9f05-aa7a6bc0c4cb admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:26.685524 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b361b9-87d9-4e94-9f05-aa7a6bc0c4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:26.685802 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b361b9-87d9-4e94-9f05-aa7a6bc0c4cb admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:26.686434 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b361b9-87d9-4e94-9f05-aa7a6bc0c4cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:26.688665 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b361b9-87d9-4e94-9f05-aa7a6bc0c4cb admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:26.689849 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:26.714631 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 993/1997] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:26 2022] POST /identity/v3/users => generated 291 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:26.715578 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b361b9-87d9-4e94-9f05-aa7a6bc0c4cb admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:26.724726 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1005/1998] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:26 2022] POST /identity/v3/projects => generated 379 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:26.725975 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5d0cd-a287-4272-af7a-34c92e34939b admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:26.730705 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b361b9-87d9-4e94-9f05-aa7a6bc0c4cb admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:26.803466 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ae8ed-e43c-4477-bd70-21e0f99fc469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:26.804083 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ae8ed-e43c-4477-bd70-21e0f99fc469 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:26.804365 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ae8ed-e43c-4477-bd70-21e0f99fc469 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:26.804641 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ae8ed-e43c-4477-bd70-21e0f99fc469 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:26.805287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ae8ed-e43c-4477-bd70-21e0f99fc469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:26.806109 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5d0cd-a287-4272-af7a-34c92e34939b admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:26.806987 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ae8ed-e43c-4477-bd70-21e0f99fc469 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:26.811006 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec08054-17c5-4500-b022-cb2b8d8cee7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:26.811773 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec08054-17c5-4500-b022-cb2b8d8cee7b admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:26.812398 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec08054-17c5-4500-b022-cb2b8d8cee7b admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:26.812398 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec08054-17c5-4500-b022-cb2b8d8cee7b admin admin] PATH_INFO: `/v3/projects/90ba41470b6e4bc79c01a684360d65cc/users/9f9814f08966489fa1dd96fc90e082a3/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:26.817076 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 994/1999] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:26.817919 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ae8ed-e43c-4477-bd70-21e0f99fc469 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:26.827613 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ae8ed-e43c-4477-bd70-21e0f99fc469 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:26.831819 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec08054-17c5-4500-b022-cb2b8d8cee7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=90ba41470b6e4bc79c01a684360d65cc, user_id=9f9814f08966489fa1dd96fc90e082a3, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:26.832673 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe1499-be4d-4fbd-9244-75f60c60483b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:26.833268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe1499-be4d-4fbd-9244-75f60c60483b admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:26.833570 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe1499-be4d-4fbd-9244-75f60c60483b admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:26.833840 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe1499-be4d-4fbd-9244-75f60c60483b admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:26.834480 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe1499-be4d-4fbd-9244-75f60c60483b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:26.834610 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec08054-17c5-4500-b022-cb2b8d8cee7b admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:26.836042 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe1499-be4d-4fbd-9244-75f60c60483b admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:26.848885 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1006/2000] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:26 2022] PUT /identity/v3/projects/90ba41470b6e4bc79c01a684360d65cc/users/9f9814f08966489fa1dd96fc90e082a3/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:26.852127 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 995/2001] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:26.852242 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec08054-17c5-4500-b022-cb2b8d8cee7b admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:26.852360 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe1499-be4d-4fbd-9244-75f60c60483b admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:26.852360 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-75fe1499-be4d-4fbd-9244-75f60c60483b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:26.914825 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe1499-be4d-4fbd-9244-75f60c60483b admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:26.917564 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec08054-17c5-4500-b022-cb2b8d8cee7b admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:26.922273 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682ba10-4b17-469b-b17c-60f2fdf7fbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:26.922875 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682ba10-4b17-469b-b17c-60f2fdf7fbac admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:26.923156 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682ba10-4b17-469b-b17c-60f2fdf7fbac admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:26.923431 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682ba10-4b17-469b-b17c-60f2fdf7fbac admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:26.924056 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f682ba10-4b17-469b-b17c-60f2fdf7fbac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:26.926079 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f682ba10-4b17-469b-b17c-60f2fdf7fbac admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:26.947687 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1007/2002] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:26 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:26.948540 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682ba10-4b17-469b-b17c-60f2fdf7fbac admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:26.959310 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682ba10-4b17-469b-b17c-60f2fdf7fbac admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:26.964859 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8affdae3-b8d5-4c56-afaa-f5ac526aaff1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:26.965423 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5d20a-6f45-47e9-9db9-021d5fc2f347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:26.965630 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8affdae3-b8d5-4c56-afaa-f5ac526aaff1 service cinder] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:26.965943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8affdae3-b8d5-4c56-afaa-f5ac526aaff1 service cinder] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:26.966043 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5d20a-6f45-47e9-9db9-021d5fc2f347 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:26.966216 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8affdae3-b8d5-4c56-afaa-f5ac526aaff1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:26.966323 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5d20a-6f45-47e9-9db9-021d5fc2f347 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:26.966550 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5d20a-6f45-47e9-9db9-021d5fc2f347 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:26.967188 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd5d20a-6f45-47e9-9db9-021d5fc2f347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:26.968013 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-8affdae3-b8d5-4c56-afaa-f5ac526aaff1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:26.968801 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd5d20a-6f45-47e9-9db9-021d5fc2f347 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:26.979385 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1008/2003] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:26.980182 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5d20a-6f45-47e9-9db9-021d5fc2f347 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:26.991900 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5d20a-6f45-47e9-9db9-021d5fc2f347 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:26.996503 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914ec31e-d922-41b3-8a30-4802862eb631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:26.997079 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ec31e-d922-41b3-8a30-4802862eb631 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:26.997379 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ec31e-d922-41b3-8a30-4802862eb631 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:26.997659 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914ec31e-d922-41b3-8a30-4802862eb631 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:26.998283 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ec31e-d922-41b3-8a30-4802862eb631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:26.999849 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914ec31e-d922-41b3-8a30-4802862eb631 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:27.001710 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:27.011339 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1009/2004] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:27.012583 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663602b5-90f4-4c6b-80b5-0dd94f059fc8 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:27.012832 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663602b5-90f4-4c6b-80b5-0dd94f059fc8 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:27.013208 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663602b5-90f4-4c6b-80b5-0dd94f059fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:27.033296 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8affdae3-b8d5-4c56-afaa-f5ac526aaff1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:27.034792 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8affdae3-b8d5-4c56-afaa-f5ac526aaff1 service cinder] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:27.040502 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-663602b5-90f4-4c6b-80b5-0dd94f059fc8 None None] MFA Rules not processed for user `9f9814f08966489fa1dd96fc90e082a3`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:27.041728 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-663602b5-90f4-4c6b-80b5-0dd94f059fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:27.044617 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 996/2005] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:27.045245 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8affdae3-b8d5-4c56-afaa-f5ac526aaff1 service cinder] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:27.055296 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8affdae3-b8d5-4c56-afaa-f5ac526aaff1 service cinder] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:27.062287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09173012-66a3-4d7a-9f0a-031dea9e6a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:27.063370 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09173012-66a3-4d7a-9f0a-031dea9e6a91 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:27.063620 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09173012-66a3-4d7a-9f0a-031dea9e6a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:27.063954 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09173012-66a3-4d7a-9f0a-031dea9e6a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:27.064755 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09173012-66a3-4d7a-9f0a-031dea9e6a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:27.066273 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09173012-66a3-4d7a-9f0a-031dea9e6a91 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:27.069603 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:27.082649 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 997/2006] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:27.084981 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09173012-66a3-4d7a-9f0a-031dea9e6a91 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:27.099811 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09173012-66a3-4d7a-9f0a-031dea9e6a91 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:27.107920 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3db1e-3790-4e80-ae08-f683827244ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:27.108817 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3db1e-3790-4e80-ae08-f683827244ba admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:27.109362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3db1e-3790-4e80-ae08-f683827244ba admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:27.109698 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3db1e-3790-4e80-ae08-f683827244ba admin admin] PATH_INFO: `/v3/projects/b087342d39fe4a868d015f9f8f64a99a/users/4b747f134bc542d5a9b7ef697c1adf22/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:27.124135 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1010/2007] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:27.125629 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663602b5-90f4-4c6b-80b5-0dd94f059fc8 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:27.140695 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3db1e-3790-4e80-ae08-f683827244ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=b087342d39fe4a868d015f9f8f64a99a, user_id=4b747f134bc542d5a9b7ef697c1adf22, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:27.144132 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3db1e-3790-4e80-ae08-f683827244ba admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:27.145391 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663602b5-90f4-4c6b-80b5-0dd94f059fc8 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:27.153865 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffa938-e348-42bb-bdc3-490bcfe22a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:27.155528 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffa938-e348-42bb-bdc3-490bcfe22a87 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:27.155959 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffa938-e348-42bb-bdc3-490bcfe22a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:27.156377 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffa938-e348-42bb-bdc3-490bcfe22a87 admin admin] PATH_INFO: `/v3/projects/176d1a2d5624451f8198b5e3f5798dfa/users/fd7de67d0333441aafb9f52cf0b03adf/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:27.169578 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 998/2008] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:27 2022] PUT /identity/v3/projects/b087342d39fe4a868d015f9f8f64a99a/users/4b747f134bc542d5a9b7ef697c1adf22/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:27.169578 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3db1e-3790-4e80-ae08-f683827244ba admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:27.197548 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ffa938-e348-42bb-bdc3-490bcfe22a87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=176d1a2d5624451f8198b5e3f5798dfa, user_id=fd7de67d0333441aafb9f52cf0b03adf, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:27.202007 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ffa938-e348-42bb-bdc3-490bcfe22a87 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:27.228844 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1011/2009] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:27 2022] PUT /identity/v3/projects/176d1a2d5624451f8198b5e3f5798dfa/users/fd7de67d0333441aafb9f52cf0b03adf/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:27.239968 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffa938-e348-42bb-bdc3-490bcfe22a87 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:27.283670 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3db1e-3790-4e80-ae08-f683827244ba admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:27.315422 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffa938-e348-42bb-bdc3-490bcfe22a87 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:27.320501 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45c722-d0d3-4d1d-b8ab-0b5f2f4fcaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:27.321199 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45c722-d0d3-4d1d-b8ab-0b5f2f4fcaff admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:27.321511 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45c722-d0d3-4d1d-b8ab-0b5f2f4fcaff admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:27.321782 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45c722-d0d3-4d1d-b8ab-0b5f2f4fcaff admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:27.322415 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45c722-d0d3-4d1d-b8ab-0b5f2f4fcaff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:27.324429 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45c722-d0d3-4d1d-b8ab-0b5f2f4fcaff admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:27.345917 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f85f0-a379-473d-a1c1-1356cefb4a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:27.346530 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f85f0-a379-473d-a1c1-1356cefb4a19 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:27.346828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f85f0-a379-473d-a1c1-1356cefb4a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:27.347103 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f85f0-a379-473d-a1c1-1356cefb4a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:27.347798 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6f85f0-a379-473d-a1c1-1356cefb4a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:27.349417 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6f85f0-a379-473d-a1c1-1356cefb4a19 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:27.354885 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1012/2010] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:27 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:27.356009 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade63b6-0e4e-4010-891c-0ffd306b7dea None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:27.356292 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade63b6-0e4e-4010-891c-0ffd306b7dea None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:27.356566 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade63b6-0e4e-4010-891c-0ffd306b7dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:27.364162 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 999/2011] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:27.366069 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09df4b-ea82-4c38-992d-2618b4cbcc40 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:27.366354 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09df4b-ea82-4c38-992d-2618b4cbcc40 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:27.366627 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09df4b-ea82-4c38-992d-2618b4cbcc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:27.385860 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-6ade63b6-0e4e-4010-891c-0ffd306b7dea None None] MFA Rules not processed for user `4b747f134bc542d5a9b7ef697c1adf22`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:27.387177 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-6ade63b6-0e4e-4010-891c-0ffd306b7dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:27.394819 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-1f09df4b-ea82-4c38-992d-2618b4cbcc40 None None] MFA Rules not processed for user `fd7de67d0333441aafb9f52cf0b03adf`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:27.396041 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-1f09df4b-ea82-4c38-992d-2618b4cbcc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:27.426123 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:27.455610 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1013/2012] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:27.459806 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade63b6-0e4e-4010-891c-0ffd306b7dea None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:27.465855 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1000/2013] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:27.466775 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09df4b-ea82-4c38-992d-2618b4cbcc40 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:27.475490 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:27.536703 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade63b6-0e4e-4010-891c-0ffd306b7dea None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:27.543305 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07c45d-dbc4-46f6-8760-06acae43ea47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:27.544341 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09df4b-ea82-4c38-992d-2618b4cbcc40 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:27.544475 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07c45d-dbc4-46f6-8760-06acae43ea47 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:27.544723 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07c45d-dbc4-46f6-8760-06acae43ea47 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:27.544999 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07c45d-dbc4-46f6-8760-06acae43ea47 admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:27.545938 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07c45d-dbc4-46f6-8760-06acae43ea47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:27.547954 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07c45d-dbc4-46f6-8760-06acae43ea47 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:27.550156 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22893256-e13f-4202-ba76-412d42eca3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:27.551135 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22893256-e13f-4202-ba76-412d42eca3dd admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:27.551507 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22893256-e13f-4202-ba76-412d42eca3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:27.551871 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22893256-e13f-4202-ba76-412d42eca3dd admin admin] PATH_INFO: `/v3/projects/0457a87f166741bbb4b42b22196e0f99/users/52731013c58742e98997035e255bd032/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:27.582187 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1014/2014] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:27 2022] POST /identity/v3/users => generated 299 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:27.582187 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07c45d-dbc4-46f6-8760-06acae43ea47 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:27.586981 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22893256-e13f-4202-ba76-412d42eca3dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0457a87f166741bbb4b42b22196e0f99, user_id=52731013c58742e98997035e255bd032, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:27.590730 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22893256-e13f-4202-ba76-412d42eca3dd admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:27.596811 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07c45d-dbc4-46f6-8760-06acae43ea47 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:27.610283 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b4156-4925-47a6-9646-6ac025976e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:27.611196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b4156-4925-47a6-9646-6ac025976e54 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:27.611479 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b4156-4925-47a6-9646-6ac025976e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:27.611754 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b4156-4925-47a6-9646-6ac025976e54 admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:27.612395 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b4156-4925-47a6-9646-6ac025976e54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:27.613614 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1001/2015] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:27 2022] PUT /identity/v3/projects/0457a87f166741bbb4b42b22196e0f99/users/52731013c58742e98997035e255bd032/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:27.614794 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22893256-e13f-4202-ba76-412d42eca3dd admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:27.629627 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b4156-4925-47a6-9646-6ac025976e54 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:27.664997 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1015/2016] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:27 2022] POST /identity/v3/projects => generated 381 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:27.666225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b4156-4925-47a6-9646-6ac025976e54 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:27.698321 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22893256-e13f-4202-ba76-412d42eca3dd admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:27.749514 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b4156-4925-47a6-9646-6ac025976e54 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:27.754940 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d733024-df39-4c0b-8c81-50bc25102357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:27.755593 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d733024-df39-4c0b-8c81-50bc25102357 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:27.755930 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d733024-df39-4c0b-8c81-50bc25102357 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:27.756206 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d733024-df39-4c0b-8c81-50bc25102357 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:27.756885 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d733024-df39-4c0b-8c81-50bc25102357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:27.758538 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d733024-df39-4c0b-8c81-50bc25102357 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:27.772663 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1016/2017] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:27.772663 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80baf6b5-e010-43b3-b401-bec7870833d4 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:27.773730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80baf6b5-e010-43b3-b401-bec7870833d4 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:27.774030 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80baf6b5-e010-43b3-b401-bec7870833d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:27.778910 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c519c-3f00-44fc-b76e-442ffaaaa465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:27.779684 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c519c-3f00-44fc-b76e-442ffaaaa465 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:27.779967 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c519c-3f00-44fc-b76e-442ffaaaa465 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:27.780234 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c519c-3f00-44fc-b76e-442ffaaaa465 admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:27.780860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c519c-3f00-44fc-b76e-442ffaaaa465 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:27.783127 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c519c-3f00-44fc-b76e-442ffaaaa465 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:27.790171 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:27.811801 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-80baf6b5-e010-43b3-b401-bec7870833d4 None None] MFA Rules not processed for user `52731013c58742e98997035e255bd032`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:27.813518 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-80baf6b5-e010-43b3-b401-bec7870833d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:27.823402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1002/2018] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:27 2022] POST /identity/v3/projects => generated 381 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:27.823402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c519c-3f00-44fc-b76e-442ffaaaa465 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:27.901662 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1017/2019] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:27.902771 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c519c-3f00-44fc-b76e-442ffaaaa465 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:27.902919 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80baf6b5-e010-43b3-b401-bec7870833d4 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:27.911311 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b447d-30dc-4030-b78f-2931f114fb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:27.912166 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b447d-30dc-4030-b78f-2931f114fb52 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:27.912549 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b447d-30dc-4030-b78f-2931f114fb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:27.912987 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b447d-30dc-4030-b78f-2931f114fb52 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:27.913910 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b447d-30dc-4030-b78f-2931f114fb52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:27.916113 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80baf6b5-e010-43b3-b401-bec7870833d4 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:27.916247 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b447d-30dc-4030-b78f-2931f114fb52 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:27.921935 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd159ddb-a8c1-4fa7-a2e5-f8b0bd748fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:27.922844 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd159ddb-a8c1-4fa7-a2e5-f8b0bd748fd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:27.923189 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd159ddb-a8c1-4fa7-a2e5-f8b0bd748fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:27.923527 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd159ddb-a8c1-4fa7-a2e5-f8b0bd748fd1 admin admin] PATH_INFO: `/v3/projects/6c95caf2e7334b479d1da30e7d955daf/users/d300d6767735447d91a5821d7f514597/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:27.927866 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:27.949121 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1003/2020] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:27 2022] POST /identity/v3/users => generated 297 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:27.949121 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b447d-30dc-4030-b78f-2931f114fb52 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:27.958165 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b447d-30dc-4030-b78f-2931f114fb52 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:27.964291 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2b2a1-e621-40bd-b5f1-b42281d19094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:27.965092 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2b2a1-e621-40bd-b5f1-b42281d19094 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:27.965554 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2b2a1-e621-40bd-b5f1-b42281d19094 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:27.965897 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2b2a1-e621-40bd-b5f1-b42281d19094 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:27.966683 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2b2a1-e621-40bd-b5f1-b42281d19094 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:27.969004 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd159ddb-a8c1-4fa7-a2e5-f8b0bd748fd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c95caf2e7334b479d1da30e7d955daf, user_id=d300d6767735447d91a5821d7f514597, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:27.969198 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2b2a1-e621-40bd-b5f1-b42281d19094 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:27.978377 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd159ddb-a8c1-4fa7-a2e5-f8b0bd748fd1 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:27.998086 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1018/2021] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:27 2022] PUT /identity/v3/projects/6c95caf2e7334b479d1da30e7d955daf/users/d300d6767735447d91a5821d7f514597/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:27.999652 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd159ddb-a8c1-4fa7-a2e5-f8b0bd748fd1 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:28.014767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1004/2022] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:27 2022] POST /identity/v3/users => generated 297 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:28.016000 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2b2a1-e621-40bd-b5f1-b42281d19094 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:28.028544 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2b2a1-e621-40bd-b5f1-b42281d19094 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:28.075858 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd159ddb-a8c1-4fa7-a2e5-f8b0bd748fd1 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:28.082157 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a0aff-d053-4add-a622-9c57a5f79f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:28.082917 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a0aff-d053-4add-a622-9c57a5f79f65 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:28.083199 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a0aff-d053-4add-a622-9c57a5f79f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:28.083475 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a0aff-d053-4add-a622-9c57a5f79f65 admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:28.084116 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a0aff-d053-4add-a622-9c57a5f79f65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:28.086661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a0aff-d053-4add-a622-9c57a5f79f65 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:28.097319 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54551887-4aa0-4ade-b511-c156d5632efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:28.098249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54551887-4aa0-4ade-b511-c156d5632efb admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:28.098678 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54551887-4aa0-4ade-b511-c156d5632efb admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:28.099104 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54551887-4aa0-4ade-b511-c156d5632efb admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:28.100028 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54551887-4aa0-4ade-b511-c156d5632efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:28.101873 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54551887-4aa0-4ade-b511-c156d5632efb admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:28.114095 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1005/2023] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:28.115166 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54551887-4aa0-4ade-b511-c156d5632efb admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:28.119984 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1019/2024] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:27 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:28.119984 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a0aff-d053-4add-a622-9c57a5f79f65 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:28.129041 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54551887-4aa0-4ade-b511-c156d5632efb admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:28.191039 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:28.201635 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a0aff-d053-4add-a622-9c57a5f79f65 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:28.202516 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305bc772-c434-40d6-8349-e9e8629c9db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:28.203187 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bc772-c434-40d6-8349-e9e8629c9db2 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:28.203536 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bc772-c434-40d6-8349-e9e8629c9db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:28.203807 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305bc772-c434-40d6-8349-e9e8629c9db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:28.204842 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305bc772-c434-40d6-8349-e9e8629c9db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:28.206087 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305bc772-c434-40d6-8349-e9e8629c9db2 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:28.206952 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dafade-84b7-40a8-b6ad-66dc6c3f9f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:28.207630 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dafade-84b7-40a8-b6ad-66dc6c3f9f79 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:28.208610 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dafade-84b7-40a8-b6ad-66dc6c3f9f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:28.208610 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dafade-84b7-40a8-b6ad-66dc6c3f9f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:28.209129 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dafade-84b7-40a8-b6ad-66dc6c3f9f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:28.210792 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dafade-84b7-40a8-b6ad-66dc6c3f9f79 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:28.220704 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1006/2025] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:28.220704 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305bc772-c434-40d6-8349-e9e8629c9db2 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:28.222726 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1020/2026] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:28.226488 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dafade-84b7-40a8-b6ad-66dc6c3f9f79 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:28.232433 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305bc772-c434-40d6-8349-e9e8629c9db2 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:28.237220 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dafade-84b7-40a8-b6ad-66dc6c3f9f79 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:28.238382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60fb8f-36ce-4193-a7a6-a4ec31903a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:28.239180 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60fb8f-36ce-4193-a7a6-a4ec31903a48 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:28.239594 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60fb8f-36ce-4193-a7a6-a4ec31903a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:28.239935 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60fb8f-36ce-4193-a7a6-a4ec31903a48 admin admin] PATH_INFO: `/v3/projects/b2be63d4cfb342a9ba9cf11119e698fd/users/482011bf37b94414956c8d2eb3be221d/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:28.242170 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23176beb-e6d5-46ed-b0b8-3488bb230bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:28.242794 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23176beb-e6d5-46ed-b0b8-3488bb230bfc admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:28.243072 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23176beb-e6d5-46ed-b0b8-3488bb230bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:28.243349 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23176beb-e6d5-46ed-b0b8-3488bb230bfc admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:28.243988 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23176beb-e6d5-46ed-b0b8-3488bb230bfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:28.245967 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23176beb-e6d5-46ed-b0b8-3488bb230bfc admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:28.257388 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60fb8f-36ce-4193-a7a6-a4ec31903a48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2be63d4cfb342a9ba9cf11119e698fd, user_id=482011bf37b94414956c8d2eb3be221d, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:28.260242 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed60fb8f-36ce-4193-a7a6-a4ec31903a48 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:28.271272 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1021/2027] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:28 2022] POST /identity/v3/users => generated 290 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:28.271848 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23176beb-e6d5-46ed-b0b8-3488bb230bfc admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:28.279109 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1007/2028] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:28 2022] PUT /identity/v3/projects/b2be63d4cfb342a9ba9cf11119e698fd/users/482011bf37b94414956c8d2eb3be221d/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:28.279882 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60fb8f-36ce-4193-a7a6-a4ec31903a48 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:28.283633 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23176beb-e6d5-46ed-b0b8-3488bb230bfc admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:28.340162 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:28.356179 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d8c21-b85e-4649-8dc2-57b2bce110a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:28.356924 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d8c21-b85e-4649-8dc2-57b2bce110a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:28.357206 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d8c21-b85e-4649-8dc2-57b2bce110a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:28.357564 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d8c21-b85e-4649-8dc2-57b2bce110a4 admin admin] PATH_INFO: `/v3/projects/6c95caf2e7334b479d1da30e7d955daf/users/d300d6767735447d91a5821d7f514597/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:28.359640 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d8c21-b85e-4649-8dc2-57b2bce110a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c95caf2e7334b479d1da30e7d955daf, user_id=d300d6767735447d91a5821d7f514597, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:28.362451 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d8c21-b85e-4649-8dc2-57b2bce110a4 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:28.365160 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed60fb8f-36ce-4193-a7a6-a4ec31903a48 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:28.369987 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d6e41-9b34-4a75-ab77-c74ffd2f6161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:28.370668 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d6e41-9b34-4a75-ab77-c74ffd2f6161 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:28.370947 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d6e41-9b34-4a75-ab77-c74ffd2f6161 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:28.371215 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d6e41-9b34-4a75-ab77-c74ffd2f6161 admin admin] PATH_INFO: `/v3/projects/ba5cab5de7d9418188b777a305800e29/users/5fd488cee3e34da88bfbc0107b2f077b/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:28.377878 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1022/2029] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:28 2022] PUT /identity/v3/projects/6c95caf2e7334b479d1da30e7d955daf/users/d300d6767735447d91a5821d7f514597/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:28.379237 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d8c21-b85e-4649-8dc2-57b2bce110a4 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:28.389200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d6e41-9b34-4a75-ab77-c74ffd2f6161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba5cab5de7d9418188b777a305800e29, user_id=5fd488cee3e34da88bfbc0107b2f077b, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:28.392240 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d6e41-9b34-4a75-ab77-c74ffd2f6161 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:28.409514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1008/2030] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:28 2022] PUT /identity/v3/projects/ba5cab5de7d9418188b777a305800e29/users/5fd488cee3e34da88bfbc0107b2f077b/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:28.410819 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d6e41-9b34-4a75-ab77-c74ffd2f6161 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:28.462120 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d8c21-b85e-4649-8dc2-57b2bce110a4 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:28.481912 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d6e41-9b34-4a75-ab77-c74ffd2f6161 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:28.490510 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4af94-816d-427b-b6b9-e24b1c7cbe6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:28.491485 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4af94-816d-427b-b6b9-e24b1c7cbe6f admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:28.491917 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4af94-816d-427b-b6b9-e24b1c7cbe6f admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:28.492346 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4af94-816d-427b-b6b9-e24b1c7cbe6f admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:28.492999 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4af94-816d-427b-b6b9-e24b1c7cbe6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:28.494990 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4af94-816d-427b-b6b9-e24b1c7cbe6f admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:28.508367 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1009/2031] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:28.509149 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a707e-aa0f-4b5c-8551-211a144260d9 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:28.509945 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a707e-aa0f-4b5c-8551-211a144260d9 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:28.510058 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a707e-aa0f-4b5c-8551-211a144260d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:28.538488 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cafdc-c3b5-45ed-8b58-d6b5c8e69026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:28.539310 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cafdc-c3b5-45ed-8b58-d6b5c8e69026 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:28.539575 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cafdc-c3b5-45ed-8b58-d6b5c8e69026 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:28.540405 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447cafdc-c3b5-45ed-8b58-d6b5c8e69026 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:28.541070 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447cafdc-c3b5-45ed-8b58-d6b5c8e69026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:28.542803 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447cafdc-c3b5-45ed-8b58-d6b5c8e69026 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:28.544095 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-637a707e-aa0f-4b5c-8551-211a144260d9 None None] MFA Rules not processed for user `d300d6767735447d91a5821d7f514597`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:28.545384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-637a707e-aa0f-4b5c-8551-211a144260d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:28.563494 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1023/2032] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:28.563494 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cafdc-c3b5-45ed-8b58-d6b5c8e69026 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:28.572680 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447cafdc-c3b5-45ed-8b58-d6b5c8e69026 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:28.577522 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115be03-7e41-425d-923c-5899ee03820e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:28.578126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115be03-7e41-425d-923c-5899ee03820e admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:28.578424 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115be03-7e41-425d-923c-5899ee03820e admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:28.578719 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115be03-7e41-425d-923c-5899ee03820e admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:28.579356 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1115be03-7e41-425d-923c-5899ee03820e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:28.580938 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1115be03-7e41-425d-923c-5899ee03820e admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:28.593126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1024/2033] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:28.594051 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115be03-7e41-425d-923c-5899ee03820e admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:28.603515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:28.607732 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115be03-7e41-425d-923c-5899ee03820e admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:28.612628 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4af82b-5797-41d2-912d-2740b300c5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:28.613470 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4af82b-5797-41d2-912d-2740b300c5d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:28.613891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4af82b-5797-41d2-912d-2740b300c5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:28.614292 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4af82b-5797-41d2-912d-2740b300c5d9 admin admin] PATH_INFO: `/v3/projects/b2be63d4cfb342a9ba9cf11119e698fd/users/482011bf37b94414956c8d2eb3be221d/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:28.619126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4af82b-5797-41d2-912d-2740b300c5d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2be63d4cfb342a9ba9cf11119e698fd, user_id=482011bf37b94414956c8d2eb3be221d, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:28.622917 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4af82b-5797-41d2-912d-2740b300c5d9 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:28.649378 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1025/2034] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:28 2022] PUT /identity/v3/projects/b2be63d4cfb342a9ba9cf11119e698fd/users/482011bf37b94414956c8d2eb3be221d/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:28.649378 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4af82b-5797-41d2-912d-2740b300c5d9 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:28.681292 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1010/2035] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:28 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:28.682459 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a707e-aa0f-4b5c-8551-211a144260d9 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:28.693613 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a707e-aa0f-4b5c-8551-211a144260d9 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:28.714330 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4af82b-5797-41d2-912d-2740b300c5d9 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:28.719991 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4462ee-a4b1-4300-8457-8a4034816aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:28.720936 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4462ee-a4b1-4300-8457-8a4034816aed admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:28.721319 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4462ee-a4b1-4300-8457-8a4034816aed admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:28.722951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4462ee-a4b1-4300-8457-8a4034816aed admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:28.723717 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4462ee-a4b1-4300-8457-8a4034816aed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:28.725686 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4462ee-a4b1-4300-8457-8a4034816aed admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:28.728566 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:28.739074 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1026/2036] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:28.740527 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e04fc2-5a7c-4e42-b4a5-0e1008d618cc None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:28.740907 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e04fc2-5a7c-4e42-b4a5-0e1008d618cc None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:28.741803 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e04fc2-5a7c-4e42-b4a5-0e1008d618cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:28.774156 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-a1e04fc2-5a7c-4e42-b4a5-0e1008d618cc None None] MFA Rules not processed for user `482011bf37b94414956c8d2eb3be221d`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:28.775949 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-a1e04fc2-5a7c-4e42-b4a5-0e1008d618cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:28.776772 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97299d-f1d1-4b85-9b16-fe43e1d9edc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:28.777550 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97299d-f1d1-4b85-9b16-fe43e1d9edc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:28.777896 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97299d-f1d1-4b85-9b16-fe43e1d9edc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:28.778242 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97299d-f1d1-4b85-9b16-fe43e1d9edc9 admin admin] PATH_INFO: `/v3/projects/ba5cab5de7d9418188b777a305800e29/users/5fd488cee3e34da88bfbc0107b2f077b/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:28.780229 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97299d-f1d1-4b85-9b16-fe43e1d9edc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba5cab5de7d9418188b777a305800e29, user_id=5fd488cee3e34da88bfbc0107b2f077b, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:28.783201 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97299d-f1d1-4b85-9b16-fe43e1d9edc9 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:28.797619 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1011/2037] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:28 2022] PUT /identity/v3/projects/ba5cab5de7d9418188b777a305800e29/users/5fd488cee3e34da88bfbc0107b2f077b/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:28.798752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97299d-f1d1-4b85-9b16-fe43e1d9edc9 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:28.853240 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1027/2038] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:28 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:28.854642 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e04fc2-5a7c-4e42-b4a5-0e1008d618cc None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:28.862690 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97299d-f1d1-4b85-9b16-fe43e1d9edc9 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:28.867136 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9e9ee-4ee8-4535-bc32-680a09059e0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:28.867601 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e04fc2-5a7c-4e42-b4a5-0e1008d618cc None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:28.867732 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9e9ee-4ee8-4535-bc32-680a09059e0e service cinder] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:28.868020 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9e9ee-4ee8-4535-bc32-680a09059e0e service cinder] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:28.868417 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9e9ee-4ee8-4535-bc32-680a09059e0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:28.929918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf80f55-7c21-45bb-a9aa-f61e6ddfff4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:28.930763 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf80f55-7c21-45bb-a9aa-f61e6ddfff4b admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:28.931070 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf80f55-7c21-45bb-a9aa-f61e6ddfff4b admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:28.931480 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf80f55-7c21-45bb-a9aa-f61e6ddfff4b admin admin] PATH_INFO: `/v3/projects/253bda7fec2c428396f697ff6a413a63/users/8ab84285d60642328bdd11ded9a8568c/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:28.942871 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9e9ee-4ee8-4535-bc32-680a09059e0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:28.944335 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9e9ee-4ee8-4535-bc32-680a09059e0e service cinder] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:28.947621 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf80f55-7c21-45bb-a9aa-f61e6ddfff4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=253bda7fec2c428396f697ff6a413a63, user_id=8ab84285d60642328bdd11ded9a8568c, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:28.951062 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf80f55-7c21-45bb-a9aa-f61e6ddfff4b admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:28.954664 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1012/2039] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:28 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:28.956016 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee112814-0511-498e-924d-9436da3d30fb None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:28.956300 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee112814-0511-498e-924d-9436da3d30fb None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:28.956575 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee112814-0511-498e-924d-9436da3d30fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:28.969983 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1028/2040] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:28 2022] PUT /identity/v3/projects/253bda7fec2c428396f697ff6a413a63/users/8ab84285d60642328bdd11ded9a8568c/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:28.978312 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf80f55-7c21-45bb-a9aa-f61e6ddfff4b admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:28.983235 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-ddf80f55-7c21-45bb-a9aa-f61e6ddfff4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:28.988203 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:28.992343 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-ee112814-0511-498e-924d-9436da3d30fb None None] MFA Rules not processed for user `5fd488cee3e34da88bfbc0107b2f077b`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:28.993707 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-ee112814-0511-498e-924d-9436da3d30fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:29.054052 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf80f55-7c21-45bb-a9aa-f61e6ddfff4b admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:29.057790 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58dc867-8482-4d0d-a943-002d76894ca0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:29.058404 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dc867-8482-4d0d-a943-002d76894ca0 service cinder] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:29.058687 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dc867-8482-4d0d-a943-002d76894ca0 service cinder] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:29.058961 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58dc867-8482-4d0d-a943-002d76894ca0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:29.079145 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1013/2041] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:28 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:29.079352 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:29.080462 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a01d50-8319-4ad8-b185-bbf2e9b3a741 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:29.080757 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a01d50-8319-4ad8-b185-bbf2e9b3a741 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:29.081465 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a01d50-8319-4ad8-b185-bbf2e9b3a741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:29.114399 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-18a01d50-8319-4ad8-b185-bbf2e9b3a741 None None] MFA Rules not processed for user `8ab84285d60642328bdd11ded9a8568c`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:29.115677 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-18a01d50-8319-4ad8-b185-bbf2e9b3a741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:29.145927 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58dc867-8482-4d0d-a943-002d76894ca0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:29.148566 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58dc867-8482-4d0d-a943-002d76894ca0 service cinder] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:29.160420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1029/2042] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:28 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:29.161361 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58dc867-8482-4d0d-a943-002d76894ca0 service cinder] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:29.201229 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1014/2043] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:29.202407 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a01d50-8319-4ad8-b185-bbf2e9b3a741 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:29.235755 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a01d50-8319-4ad8-b185-bbf2e9b3a741 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:29.244954 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452a874-7187-4d28-a864-03a35436a27c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:29.245575 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452a874-7187-4d28-a864-03a35436a27c service cinder] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:29.245860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452a874-7187-4d28-a864-03a35436a27c service cinder] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:29.246743 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452a874-7187-4d28-a864-03a35436a27c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:29.258461 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c452a874-7187-4d28-a864-03a35436a27c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:29.259958 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c452a874-7187-4d28-a864-03a35436a27c service cinder] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:29.262268 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58dc867-8482-4d0d-a943-002d76894ca0 service cinder] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:29.275736 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0d73e-f426-4e8d-9c8f-219cf3c71799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:29.276499 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0d73e-f426-4e8d-9c8f-219cf3c71799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:29.276894 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0d73e-f426-4e8d-9c8f-219cf3c71799 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:29.277515 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0d73e-f426-4e8d-9c8f-219cf3c71799 admin admin] PATH_INFO: `/v3/users/9f9814f08966489fa1dd96fc90e082a3` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:29.279000 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0d73e-f426-4e8d-9c8f-219cf3c71799 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f9814f08966489fa1dd96fc90e082a3)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:29.281529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0d73e-f426-4e8d-9c8f-219cf3c71799 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:29.295802 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1015/2044] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:29 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:29.296815 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452a874-7187-4d28-a864-03a35436a27c service cinder] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:29.336322 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452a874-7187-4d28-a864-03a35436a27c service cinder] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:29.348819 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59ec39-6b2e-41e5-b162-b0da674e8d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:29.349163 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59ec39-6b2e-41e5-b162-b0da674e8d99 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:29.349477 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59ec39-6b2e-41e5-b162-b0da674e8d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:29.349755 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59ec39-6b2e-41e5-b162-b0da674e8d99 admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:29.350549 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea59ec39-6b2e-41e5-b162-b0da674e8d99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:29.363427 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-68d0d73e-f426-4e8d-9c8f-219cf3c71799 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f9814f08966489fa1dd96fc90e082a3'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:29.364708 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-68d0d73e-f426-4e8d-9c8f-219cf3c71799 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f9814f08966489fa1dd96fc90e082a3'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:29.365557 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-68d0d73e-f426-4e8d-9c8f-219cf3c71799 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f9814f08966489fa1dd96fc90e082a3'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:29.365673 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea59ec39-6b2e-41e5-b162-b0da674e8d99 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:29.383887 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-68d0d73e-f426-4e8d-9c8f-219cf3c71799 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f9814f08966489fa1dd96fc90e082a3'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:29.402046 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-68d0d73e-f426-4e8d-9c8f-219cf3c71799 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f9814f08966489fa1dd96fc90e082a3'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:29.414179 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1016/2045] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:29 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:29.423369 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59ec39-6b2e-41e5-b162-b0da674e8d99 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:29.428619 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1030/2046] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:29 2022] DELETE /identity/v3/users/9f9814f08966489fa1dd96fc90e082a3 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:29.428773 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-ea59ec39-6b2e-41e5-b162-b0da674e8d99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:29.444495 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ecc85-8dde-44eb-b2ff-c18a8fad38f6 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:29.444781 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ecc85-8dde-44eb-b2ff-c18a8fad38f6 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:29.445052 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ecc85-8dde-44eb-b2ff-c18a8fad38f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:29.500180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-6f3ecc85-8dde-44eb-b2ff-c18a8fad38f6 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:29.501838 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-6f3ecc85-8dde-44eb-b2ff-c18a8fad38f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:29.538195 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:29.554713 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:29.572421 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59ec39-6b2e-41e5-b162-b0da674e8d99 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:29.592094 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1031/2047] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:29.592094 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ecc85-8dde-44eb-b2ff-c18a8fad38f6 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:29.600805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-6f3ecc85-8dde-44eb-b2ff-c18a8fad38f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:29.679362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff1e56-1b0a-4f8f-a3c9-232f11d73a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:29.680377 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff1e56-1b0a-4f8f-a3c9-232f11d73a7d admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:29.681030 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff1e56-1b0a-4f8f-a3c9-232f11d73a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:29.681308 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff1e56-1b0a-4f8f-a3c9-232f11d73a7d admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:29.681984 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff1e56-1b0a-4f8f-a3c9-232f11d73a7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:29.684372 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff1e56-1b0a-4f8f-a3c9-232f11d73a7d admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:29.710951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ecc85-8dde-44eb-b2ff-c18a8fad38f6 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:29.716933 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9b588-1437-4ca7-b670-fedc1eb1ffda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:29.717910 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9b588-1437-4ca7-b670-fedc1eb1ffda service cinder] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:29.718766 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1017/2048] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:29 2022] POST /identity/v3/users => generated 295 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:29.718883 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9b588-1437-4ca7-b670-fedc1eb1ffda service cinder] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:29.719792 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff1e56-1b0a-4f8f-a3c9-232f11d73a7d admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:29.720087 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9b588-1437-4ca7-b670-fedc1eb1ffda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:29.722023 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-91d9b588-1437-4ca7-b670-fedc1eb1ffda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:29.723661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-b5ff1e56-1b0a-4f8f-a3c9-232f11d73a7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:29.810507 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9b588-1437-4ca7-b670-fedc1eb1ffda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:29.812815 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9b588-1437-4ca7-b670-fedc1eb1ffda service cinder] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:29.821189 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff1e56-1b0a-4f8f-a3c9-232f11d73a7d admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:29.825734 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1032/2049] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:29.826676 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9b588-1437-4ca7-b670-fedc1eb1ffda service cinder] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:29.827851 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72250576-d46d-4411-b0a4-e304a2ddde3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:29.828946 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72250576-d46d-4411-b0a4-e304a2ddde3a service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:29.829129 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72250576-d46d-4411-b0a4-e304a2ddde3a service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:29.829474 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72250576-d46d-4411-b0a4-e304a2ddde3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:29.839270 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9b588-1437-4ca7-b670-fedc1eb1ffda service cinder] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:29.844580 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72250576-d46d-4411-b0a4-e304a2ddde3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:29.847491 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27bd4d7-bf30-4d68-95f3-daec4838a848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:29.847939 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bd4d7-bf30-4d68-95f3-daec4838a848 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:29.848131 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72250576-d46d-4411-b0a4-e304a2ddde3a service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:29.848239 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bd4d7-bf30-4d68-95f3-daec4838a848 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:29.848481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bd4d7-bf30-4d68-95f3-daec4838a848 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:29.849130 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27bd4d7-bf30-4d68-95f3-daec4838a848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:29.850937 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27bd4d7-bf30-4d68-95f3-daec4838a848 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:29.874203 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1018/2050] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:29.878660 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1033/2051] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:29.885179 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72250576-d46d-4411-b0a4-e304a2ddde3a service neutron] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:29.904183 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72250576-d46d-4411-b0a4-e304a2ddde3a service neutron] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:29.907954 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27bd4d7-bf30-4d68-95f3-daec4838a848 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:29.910126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-f27bd4d7-bf30-4d68-95f3-daec4838a848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:29.919259 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544a5c2-ce65-412d-b616-8f903defe597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:29.919946 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544a5c2-ce65-412d-b616-8f903defe597 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:29.923056 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544a5c2-ce65-412d-b616-8f903defe597 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:29.923345 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544a5c2-ce65-412d-b616-8f903defe597 admin admin] PATH_INFO: `/v3/projects/d8ce544c38eb462fbc512534f8b95f8b/users/eb4bf29cfa044578afad6b421377e196/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:29.930179 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27bd4d7-bf30-4d68-95f3-daec4838a848 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:29.935738 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df546b-9b66-44b2-bef3-38b1c468bdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:29.936606 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df546b-9b66-44b2-bef3-38b1c468bdc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:29.937101 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df546b-9b66-44b2-bef3-38b1c468bdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:29.937446 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df546b-9b66-44b2-bef3-38b1c468bdc5 admin admin] PATH_INFO: `/v3/users/4b747f134bc542d5a9b7ef697c1adf22` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:29.938830 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df546b-9b66-44b2-bef3-38b1c468bdc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b747f134bc542d5a9b7ef697c1adf22)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:29.941510 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df546b-9b66-44b2-bef3-38b1c468bdc5 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:29.948993 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544a5c2-ce65-412d-b616-8f903defe597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8ce544c38eb462fbc512534f8b95f8b, user_id=eb4bf29cfa044578afad6b421377e196, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:29.951915 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544a5c2-ce65-412d-b616-8f903defe597 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:29.976230 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1019/2052] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:29 2022] PUT /identity/v3/projects/d8ce544c38eb462fbc512534f8b95f8b/users/eb4bf29cfa044578afad6b421377e196/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:29.978001 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544a5c2-ce65-412d-b616-8f903defe597 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:30.018853 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-36df546b-9b66-44b2-bef3-38b1c468bdc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b747f134bc542d5a9b7ef697c1adf22'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:30.021574 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-36df546b-9b66-44b2-bef3-38b1c468bdc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b747f134bc542d5a9b7ef697c1adf22'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:30.022918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-36df546b-9b66-44b2-bef3-38b1c468bdc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b747f134bc542d5a9b7ef697c1adf22'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:30.041386 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-36df546b-9b66-44b2-bef3-38b1c468bdc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b747f134bc542d5a9b7ef697c1adf22'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:30.051842 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-36df546b-9b66-44b2-bef3-38b1c468bdc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b747f134bc542d5a9b7ef697c1adf22'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:30.056062 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:30.084981 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1034/2053] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:29 2022] DELETE /identity/v3/users/4b747f134bc542d5a9b7ef697c1adf22 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:30.089622 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1a1a5-a431-45d1-9b2d-19180e4d87a1 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:30.090090 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1a1a5-a431-45d1-9b2d-19180e4d87a1 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:30.092022 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb1a1a5-a431-45d1-9b2d-19180e4d87a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:30.095713 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544a5c2-ce65-412d-b616-8f903defe597 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:30.121446 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-9cb1a1a5-a431-45d1-9b2d-19180e4d87a1 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:30.123099 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-9cb1a1a5-a431-45d1-9b2d-19180e4d87a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:30.147988 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:30.247485 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a4d13-ef36-4351-af66-1aebcb15a050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:30.248130 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a4d13-ef36-4351-af66-1aebcb15a050 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:30.248575 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a4d13-ef36-4351-af66-1aebcb15a050 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:30.248996 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a4d13-ef36-4351-af66-1aebcb15a050 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:30.249817 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a4d13-ef36-4351-af66-1aebcb15a050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:30.251770 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a4d13-ef36-4351-af66-1aebcb15a050 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:30.263985 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1035/2054] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:50:30.265669 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1020/2055] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:30.271132 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1a1a5-a431-45d1-9b2d-19180e4d87a1 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:30.272530 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-9cb1a1a5-a431-45d1-9b2d-19180e4d87a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:30.289775 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb1a1a5-a431-45d1-9b2d-19180e4d87a1 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:30.295222 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727948e9-6e49-4cf4-bc52-df5b24e1e56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:30.296008 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727948e9-6e49-4cf4-bc52-df5b24e1e56b admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:30.296156 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727948e9-6e49-4cf4-bc52-df5b24e1e56b admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:30.296479 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727948e9-6e49-4cf4-bc52-df5b24e1e56b admin admin] PATH_INFO: `/v3/projects/d8ce544c38eb462fbc512534f8b95f8b/users/eb4bf29cfa044578afad6b421377e196/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:30.298570 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727948e9-6e49-4cf4-bc52-df5b24e1e56b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8ce544c38eb462fbc512534f8b95f8b, user_id=eb4bf29cfa044578afad6b421377e196, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:30.301283 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727948e9-6e49-4cf4-bc52-df5b24e1e56b admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:30.312627 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a4d13-ef36-4351-af66-1aebcb15a050 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:30.323764 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1036/2056] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:30 2022] PUT /identity/v3/projects/d8ce544c38eb462fbc512534f8b95f8b/users/eb4bf29cfa044578afad6b421377e196/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:30.326207 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-ab4a4d13-ef36-4351-af66-1aebcb15a050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:30.327514 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea127c1-0edf-4c1b-8970-197c46a7dad6 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:30.327948 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea127c1-0edf-4c1b-8970-197c46a7dad6 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:30.328446 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea127c1-0edf-4c1b-8970-197c46a7dad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:30.382045 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-9ea127c1-0edf-4c1b-8970-197c46a7dad6 None None] MFA Rules not processed for user `eb4bf29cfa044578afad6b421377e196`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:30.385866 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-9ea127c1-0edf-4c1b-8970-197c46a7dad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:30.440744 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a4d13-ef36-4351-af66-1aebcb15a050 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:30.547591 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1037/2057] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:30.561025 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea127c1-0edf-4c1b-8970-197c46a7dad6 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:30.563408 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf5897-fbe6-40f5-a55c-666d0d13fa91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:30.563555 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-9ea127c1-0edf-4c1b-8970-197c46a7dad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:30.564626 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf5897-fbe6-40f5-a55c-666d0d13fa91 service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:30.564626 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf5897-fbe6-40f5-a55c-666d0d13fa91 service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:30.564886 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf5897-fbe6-40f5-a55c-666d0d13fa91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:30.698169 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea127c1-0edf-4c1b-8970-197c46a7dad6 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:30.709179 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4b4a1-7939-4fef-ae86-1fd9cb53937b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:30.712046 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4b4a1-7939-4fef-ae86-1fd9cb53937b service cinder] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:30.712211 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4b4a1-7939-4fef-ae86-1fd9cb53937b service cinder] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:30.712509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4b4a1-7939-4fef-ae86-1fd9cb53937b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:30.714565 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf5897-fbe6-40f5-a55c-666d0d13fa91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:30.716673 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf5897-fbe6-40f5-a55c-666d0d13fa91 service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:30.736825 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4b4a1-7939-4fef-ae86-1fd9cb53937b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:30.742196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4b4a1-7939-4fef-ae86-1fd9cb53937b service cinder] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:30.748124 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1021/2058] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:30.749065 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf5897-fbe6-40f5-a55c-666d0d13fa91 service neutron] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:30.753685 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-49bf5897-fbe6-40f5-a55c-666d0d13fa91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:30.774213 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1038/2059] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:50:30.791364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf5897-fbe6-40f5-a55c-666d0d13fa91 service neutron] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:30.810476 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415d9f9-3084-43af-a829-8883d8fbc938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:30.812461 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415d9f9-3084-43af-a829-8883d8fbc938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:30.813996 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415d9f9-3084-43af-a829-8883d8fbc938 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:30.814285 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3415d9f9-3084-43af-a829-8883d8fbc938 admin admin] PATH_INFO: `/v3/projects/90ba41470b6e4bc79c01a684360d65cc` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:30.817229 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3415d9f9-3084-43af-a829-8883d8fbc938 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90ba41470b6e4bc79c01a684360d65cc)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:30.819226 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3415d9f9-3084-43af-a829-8883d8fbc938 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:30.835668 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:30.841372 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4b4a1-7939-4fef-ae86-1fd9cb53937b service cinder] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:30.843112 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-f4a4b4a1-7939-4fef-ae86-1fd9cb53937b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:30.864308 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4b4a1-7939-4fef-ae86-1fd9cb53937b service cinder] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:30.876134 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00752c-4ab3-4257-96d9-c616b59b47be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:30.877054 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00752c-4ab3-4257-96d9-c616b59b47be service cinder] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:30.878195 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00752c-4ab3-4257-96d9-c616b59b47be service cinder] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:30.880154 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00752c-4ab3-4257-96d9-c616b59b47be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:30.889395 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-4e00752c-4ab3-4257-96d9-c616b59b47be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:30.907004 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:30.926739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-3415d9f9-3084-43af-a829-8883d8fbc938 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90ba41470b6e4bc79c01a684360d65cc', 'request_id': 'req-3415d9f9-3084-43af-a829-8883d8fbc938'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:30.942287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-3415d9f9-3084-43af-a829-8883d8fbc938 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90ba41470b6e4bc79c01a684360d65cc', 'request_id': 'req-3415d9f9-3084-43af-a829-8883d8fbc938'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:30.955394 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-3415d9f9-3084-43af-a829-8883d8fbc938 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90ba41470b6e4bc79c01a684360d65cc', 'request_id': 'req-3415d9f9-3084-43af-a829-8883d8fbc938'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:30.997149 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-3415d9f9-3084-43af-a829-8883d8fbc938 admin admin] The token cache is being invalidate because project 90ba41470b6e4bc79c01a684360d65cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:30.997395 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-3415d9f9-3084-43af-a829-8883d8fbc938 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:31.000353 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-3415d9f9-3084-43af-a829-8883d8fbc938 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:31.009405 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1022/2060] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:30 2022] DELETE /identity/v3/projects/90ba41470b6e4bc79c01a684360d65cc => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:31.012786 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415d9f9-3084-43af-a829-8883d8fbc938 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:31.013829 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-3415d9f9-3084-43af-a829-8883d8fbc938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:31.076064 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00752c-4ab3-4257-96d9-c616b59b47be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:31.077909 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00752c-4ab3-4257-96d9-c616b59b47be service cinder] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:31.101571 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1039/2061] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:30 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:50:31.163869 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3415d9f9-3084-43af-a829-8883d8fbc938 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:31.174697 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257e379-91c8-4eca-be8f-aba0c6894c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:31.176770 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257e379-91c8-4eca-be8f-aba0c6894c95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:31.177415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257e379-91c8-4eca-be8f-aba0c6894c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:31.177700 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257e379-91c8-4eca-be8f-aba0c6894c95 admin admin] PATH_INFO: `/v3/users/d300d6767735447d91a5821d7f514597` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:31.179007 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257e379-91c8-4eca-be8f-aba0c6894c95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d300d6767735447d91a5821d7f514597)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:31.181107 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257e379-91c8-4eca-be8f-aba0c6894c95 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:31.275815 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-2257e379-91c8-4eca-be8f-aba0c6894c95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd300d6767735447d91a5821d7f514597'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:31.276566 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-2257e379-91c8-4eca-be8f-aba0c6894c95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd300d6767735447d91a5821d7f514597'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:31.277196 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-2257e379-91c8-4eca-be8f-aba0c6894c95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd300d6767735447d91a5821d7f514597'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:31.295182 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-2257e379-91c8-4eca-be8f-aba0c6894c95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd300d6767735447d91a5821d7f514597'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:31.324661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-2257e379-91c8-4eca-be8f-aba0c6894c95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd300d6767735447d91a5821d7f514597'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:31.360209 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1023/2062] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:31 2022] DELETE /identity/v3/users/d300d6767735447d91a5821d7f514597 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:31.521574 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00752c-4ab3-4257-96d9-c616b59b47be service cinder] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:31.523860 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-4e00752c-4ab3-4257-96d9-c616b59b47be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:31.565616 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00752c-4ab3-4257-96d9-c616b59b47be service cinder] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:31.746355 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a565a-6e56-497c-a992-069027d7827f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:31.747024 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a565a-6e56-497c-a992-069027d7827f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:31.747310 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a565a-6e56-497c-a992-069027d7827f admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:31.747589 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a565a-6e56-497c-a992-069027d7827f admin admin] PATH_INFO: `/v3/projects/b087342d39fe4a868d015f9f8f64a99a` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:31.749842 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a565a-6e56-497c-a992-069027d7827f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b087342d39fe4a868d015f9f8f64a99a)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:31.752453 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a565a-6e56-497c-a992-069027d7827f admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:31.851818 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-fb0a565a-6e56-497c-a992-069027d7827f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b087342d39fe4a868d015f9f8f64a99a', 'request_id': 'req-fb0a565a-6e56-497c-a992-069027d7827f'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:31.862056 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-fb0a565a-6e56-497c-a992-069027d7827f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b087342d39fe4a868d015f9f8f64a99a', 'request_id': 'req-fb0a565a-6e56-497c-a992-069027d7827f'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:31.883621 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-fb0a565a-6e56-497c-a992-069027d7827f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b087342d39fe4a868d015f9f8f64a99a', 'request_id': 'req-fb0a565a-6e56-497c-a992-069027d7827f'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:31.899084 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-fb0a565a-6e56-497c-a992-069027d7827f admin admin] The token cache is being invalidate because project b087342d39fe4a868d015f9f8f64a99a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:31.899084 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-fb0a565a-6e56-497c-a992-069027d7827f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:31.899375 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-fb0a565a-6e56-497c-a992-069027d7827f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:31.901378 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1040/2063] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:31 2022] DELETE /identity/v3/projects/b087342d39fe4a868d015f9f8f64a99a => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:31.906366 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257e379-91c8-4eca-be8f-aba0c6894c95 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:31.908990 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-2257e379-91c8-4eca-be8f-aba0c6894c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:31.947567 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257e379-91c8-4eca-be8f-aba0c6894c95 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:31.978020 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:32.033526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93598c-8cca-48bb-bcb3-a209fddabc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:32.034680 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93598c-8cca-48bb-bcb3-a209fddabc06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:32.035202 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93598c-8cca-48bb-bcb3-a209fddabc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:32.035828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93598c-8cca-48bb-bcb3-a209fddabc06 admin admin] PATH_INFO: `/v3/users/482011bf37b94414956c8d2eb3be221d` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:32.038273 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93598c-8cca-48bb-bcb3-a209fddabc06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=482011bf37b94414956c8d2eb3be221d)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:32.041162 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93598c-8cca-48bb-bcb3-a209fddabc06 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:32.150403 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-cc93598c-8cca-48bb-bcb3-a209fddabc06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '482011bf37b94414956c8d2eb3be221d'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:32.157091 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-cc93598c-8cca-48bb-bcb3-a209fddabc06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '482011bf37b94414956c8d2eb3be221d'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:32.157091 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-cc93598c-8cca-48bb-bcb3-a209fddabc06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '482011bf37b94414956c8d2eb3be221d'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:32.171383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-cc93598c-8cca-48bb-bcb3-a209fddabc06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '482011bf37b94414956c8d2eb3be221d'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:32.182079 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-cc93598c-8cca-48bb-bcb3-a209fddabc06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '482011bf37b94414956c8d2eb3be221d'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:32.204304 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1024/2064] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:31 2022] DELETE /identity/v3/users/482011bf37b94414956c8d2eb3be221d => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:32.658597 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a565a-6e56-497c-a992-069027d7827f admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:32.661777 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-fb0a565a-6e56-497c-a992-069027d7827f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:32.686374 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a565a-6e56-497c-a992-069027d7827f admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:32.759361 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:32.799427 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3e53e-ad77-4bdc-9808-0137c0300734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:32.800753 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3e53e-ad77-4bdc-9808-0137c0300734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:32.801100 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3e53e-ad77-4bdc-9808-0137c0300734 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:32.804357 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3e53e-ad77-4bdc-9808-0137c0300734 admin admin] PATH_INFO: `/v3/projects/6c95caf2e7334b479d1da30e7d955daf` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:32.806098 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3e53e-ad77-4bdc-9808-0137c0300734 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c95caf2e7334b479d1da30e7d955daf)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:32.808432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3e53e-ad77-4bdc-9808-0137c0300734 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:32.911606 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-8aa3e53e-ad77-4bdc-9808-0137c0300734 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c95caf2e7334b479d1da30e7d955daf', 'request_id': 'req-8aa3e53e-ad77-4bdc-9808-0137c0300734'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:32.925662 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-8aa3e53e-ad77-4bdc-9808-0137c0300734 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c95caf2e7334b479d1da30e7d955daf', 'request_id': 'req-8aa3e53e-ad77-4bdc-9808-0137c0300734'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:32.950935 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-8aa3e53e-ad77-4bdc-9808-0137c0300734 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c95caf2e7334b479d1da30e7d955daf', 'request_id': 'req-8aa3e53e-ad77-4bdc-9808-0137c0300734'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:32.991622 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-8aa3e53e-ad77-4bdc-9808-0137c0300734 admin admin] The token cache is being invalidate because project 6c95caf2e7334b479d1da30e7d955daf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:32.991908 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-8aa3e53e-ad77-4bdc-9808-0137c0300734 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:32.992593 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-8aa3e53e-ad77-4bdc-9808-0137c0300734 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:32.995360 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1041/2065] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:32 2022] DELETE /identity/v3/projects/6c95caf2e7334b479d1da30e7d955daf => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:33.003865 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b6d6e-4f0f-4f9c-a337-323e52dbe552 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:33.004747 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b6d6e-4f0f-4f9c-a337-323e52dbe552 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:33.005205 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b6d6e-4f0f-4f9c-a337-323e52dbe552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:33.016616 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3e53e-ad77-4bdc-9808-0137c0300734 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:33.019078 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-8aa3e53e-ad77-4bdc-9808-0137c0300734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:33.046059 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-c50b6d6e-4f0f-4f9c-a337-323e52dbe552 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:33.048931 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-c50b6d6e-4f0f-4f9c-a337-323e52dbe552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:33.171191 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1025/2066] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:33.173989 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b6d6e-4f0f-4f9c-a337-323e52dbe552 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:33.176735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-c50b6d6e-4f0f-4f9c-a337-323e52dbe552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:33.204225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3e53e-ad77-4bdc-9808-0137c0300734 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:33.209497 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b6d6e-4f0f-4f9c-a337-323e52dbe552 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:33.217068 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e0b3ed-3827-4898-965d-55f6df26479f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:33.217751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0b3ed-3827-4898-965d-55f6df26479f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:33.218033 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0b3ed-3827-4898-965d-55f6df26479f admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:33.220648 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e130fd-bfe6-4498-bd96-502b23e4c280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:33.221306 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e130fd-bfe6-4498-bd96-502b23e4c280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:33.221616 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e130fd-bfe6-4498-bd96-502b23e4c280 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:33.221891 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e130fd-bfe6-4498-bd96-502b23e4c280 admin admin] PATH_INFO: `/v3/projects/b2be63d4cfb342a9ba9cf11119e698fd` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:33.223196 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e130fd-bfe6-4498-bd96-502b23e4c280 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2be63d4cfb342a9ba9cf11119e698fd)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:33.225290 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e130fd-bfe6-4498-bd96-502b23e4c280 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:33.230687 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e0b3ed-3827-4898-965d-55f6df26479f admin admin] PATH_INFO: `/v3/users/fd7de67d0333441aafb9f52cf0b03adf` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:33.232177 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0b3ed-3827-4898-965d-55f6df26479f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd7de67d0333441aafb9f52cf0b03adf)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:33.236964 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e0b3ed-3827-4898-965d-55f6df26479f admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:33.338605 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:33.366103 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-b6e130fd-bfe6-4498-bd96-502b23e4c280 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2be63d4cfb342a9ba9cf11119e698fd', 'request_id': 'req-b6e130fd-bfe6-4498-bd96-502b23e4c280'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:33.380793 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-77e0b3ed-3827-4898-965d-55f6df26479f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd7de67d0333441aafb9f52cf0b03adf'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:33.384106 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-77e0b3ed-3827-4898-965d-55f6df26479f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd7de67d0333441aafb9f52cf0b03adf'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:33.389765 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-77e0b3ed-3827-4898-965d-55f6df26479f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd7de67d0333441aafb9f52cf0b03adf'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:33.391821 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-b6e130fd-bfe6-4498-bd96-502b23e4c280 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2be63d4cfb342a9ba9cf11119e698fd', 'request_id': 'req-b6e130fd-bfe6-4498-bd96-502b23e4c280'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:33.415985 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-b6e130fd-bfe6-4498-bd96-502b23e4c280 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2be63d4cfb342a9ba9cf11119e698fd', 'request_id': 'req-b6e130fd-bfe6-4498-bd96-502b23e4c280'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:33.419971 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-77e0b3ed-3827-4898-965d-55f6df26479f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd7de67d0333441aafb9f52cf0b03adf'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:33.426487 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:33.429945 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-b6e130fd-bfe6-4498-bd96-502b23e4c280 admin admin] The token cache is being invalidate because project b2be63d4cfb342a9ba9cf11119e698fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:33.430377 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-b6e130fd-bfe6-4498-bd96-502b23e4c280 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:33.431407 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-b6e130fd-bfe6-4498-bd96-502b23e4c280 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:33.433857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1026/2067] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:33 2022] DELETE /identity/v3/projects/b2be63d4cfb342a9ba9cf11119e698fd => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:33.435376 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbff63d-ff9a-4ec1-8963-121469ce310f None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:33.435953 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbff63d-ff9a-4ec1-8963-121469ce310f None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:33.436375 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbff63d-ff9a-4ec1-8963-121469ce310f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:33.439770 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-77e0b3ed-3827-4898-965d-55f6df26479f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd7de67d0333441aafb9f52cf0b03adf'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:33.470915 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1042/2068] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:33 2022] DELETE /identity/v3/users/fd7de67d0333441aafb9f52cf0b03adf => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:50:33.474439 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6083f7-1e48-403d-a3ee-d5051a7d0c83 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:33.477513 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6083f7-1e48-403d-a3ee-d5051a7d0c83 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:33.478713 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6083f7-1e48-403d-a3ee-d5051a7d0c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:33.478823 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-5bbff63d-ff9a-4ec1-8963-121469ce310f None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:33.480307 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-5bbff63d-ff9a-4ec1-8963-121469ce310f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:33.519359 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-dd6083f7-1e48-403d-a3ee-d5051a7d0c83 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:33.520905 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-dd6083f7-1e48-403d-a3ee-d5051a7d0c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:33.618722 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1027/2069] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:33.620589 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcb747-3d39-489f-9144-c0f2ae077218 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:33.621022 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcb747-3d39-489f-9144-c0f2ae077218 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:33.623314 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcb747-3d39-489f-9144-c0f2ae077218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:33.636007 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1043/2070] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:33.637486 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6083f7-1e48-403d-a3ee-d5051a7d0c83 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:33.657233 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-16fcb747-3d39-489f-9144-c0f2ae077218 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:33.658181 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-16fcb747-3d39-489f-9144-c0f2ae077218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:33.659977 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6083f7-1e48-403d-a3ee-d5051a7d0c83 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:33.666970 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af801b-d452-43d6-be9f-e07419ef9cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:33.667804 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af801b-d452-43d6-be9f-e07419ef9cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:33.668255 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af801b-d452-43d6-be9f-e07419ef9cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:33.668699 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af801b-d452-43d6-be9f-e07419ef9cf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:33.669786 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af801b-d452-43d6-be9f-e07419ef9cf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:33.670823 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af801b-d452-43d6-be9f-e07419ef9cf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:33.674112 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af801b-d452-43d6-be9f-e07419ef9cf7 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:33.679598 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1028/2071] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:33.681046 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a06d69-d8c1-4ac8-a649-a924316a88e3 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:33.681430 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a06d69-d8c1-4ac8-a649-a924316a88e3 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:33.681632 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a06d69-d8c1-4ac8-a649-a924316a88e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:33.689718 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1044/2072] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:33.690579 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af801b-d452-43d6-be9f-e07419ef9cf7 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:33.693153 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-56af801b-d452-43d6-be9f-e07419ef9cf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:33.708108 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-b9a06d69-d8c1-4ac8-a649-a924316a88e3 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:33.709489 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-b9a06d69-d8c1-4ac8-a649-a924316a88e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:33.717906 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1029/2073] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:33.722243 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a06d69-d8c1-4ac8-a649-a924316a88e3 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:33.733021 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a06d69-d8c1-4ac8-a649-a924316a88e3 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:33.738670 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7206827-3822-4ec4-af02-f6c912ba7900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:33.739446 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7206827-3822-4ec4-af02-f6c912ba7900 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:33.739788 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7206827-3822-4ec4-af02-f6c912ba7900 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:33.740069 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7206827-3822-4ec4-af02-f6c912ba7900 admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:33.740703 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7206827-3822-4ec4-af02-f6c912ba7900 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:33.742687 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7206827-3822-4ec4-af02-f6c912ba7900 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:33.773491 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1030/2074] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:33 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:33.776371 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af801b-d452-43d6-be9f-e07419ef9cf7 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:33.777527 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7206827-3822-4ec4-af02-f6c912ba7900 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:33.827609 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ec1a6-29a2-43f8-b8fc-e9dd43725d06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:33.828141 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ec1a6-29a2-43f8-b8fc-e9dd43725d06 service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:33.828446 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ec1a6-29a2-43f8-b8fc-e9dd43725d06 service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:33.828686 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ec1a6-29a2-43f8-b8fc-e9dd43725d06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:33.839980 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7206827-3822-4ec4-af02-f6c912ba7900 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:33.844799 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc14b8b-e1ad-4b68-8aee-8f80872dfb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:33.845445 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc14b8b-e1ad-4b68-8aee-8f80872dfb69 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:33.845733 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc14b8b-e1ad-4b68-8aee-8f80872dfb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:33.846005 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc14b8b-e1ad-4b68-8aee-8f80872dfb69 admin admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:33.846687 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc14b8b-e1ad-4b68-8aee-8f80872dfb69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:33.846998 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc14b8b-e1ad-4b68-8aee-8f80872dfb69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:33.848644 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc14b8b-e1ad-4b68-8aee-8f80872dfb69 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:33.863541 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1031/2075] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:33.863541 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc14b8b-e1ad-4b68-8aee-8f80872dfb69 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:33.863541 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-fdc14b8b-e1ad-4b68-8aee-8f80872dfb69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:33.873643 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:33.877229 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc14b8b-e1ad-4b68-8aee-8f80872dfb69 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:33.883126 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c9f5c-42c8-4a90-87bb-d6403ce0c75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:33.883789 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c9f5c-42c8-4a90-87bb-d6403ce0c75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:33.884085 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c9f5c-42c8-4a90-87bb-d6403ce0c75f admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:33.884363 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c9f5c-42c8-4a90-87bb-d6403ce0c75f admin admin] PATH_INFO: `/v3/users/0a0a837efc394b70b9e2b1d4a4857c04` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:33.885657 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c9f5c-42c8-4a90-87bb-d6403ce0c75f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a0a837efc394b70b9e2b1d4a4857c04)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:33.887689 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c9f5c-42c8-4a90-87bb-d6403ce0c75f admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:33.895252 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ec1a6-29a2-43f8-b8fc-e9dd43725d06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:33.896727 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ec1a6-29a2-43f8-b8fc-e9dd43725d06 service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:33.906111 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:33.907641 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1045/2076] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:33.908386 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ec1a6-29a2-43f8-b8fc-e9dd43725d06 service neutron] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:33.919567 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ec1a6-29a2-43f8-b8fc-e9dd43725d06 service neutron] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:33.926888 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e5391-e7e3-40a5-8bac-b4151a33442f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:33.929110 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e5391-e7e3-40a5-8bac-b4151a33442f admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:33.929239 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e5391-e7e3-40a5-8bac-b4151a33442f admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:33.929531 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e5391-e7e3-40a5-8bac-b4151a33442f admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:33.930264 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e5391-e7e3-40a5-8bac-b4151a33442f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:33.932247 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e5391-e7e3-40a5-8bac-b4151a33442f admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:33.948291 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-e13c9f5c-42c8-4a90-87bb-d6403ce0c75f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a0a837efc394b70b9e2b1d4a4857c04'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:33.949043 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-e13c9f5c-42c8-4a90-87bb-d6403ce0c75f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a0a837efc394b70b9e2b1d4a4857c04'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:33.949694 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-e13c9f5c-42c8-4a90-87bb-d6403ce0c75f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a0a837efc394b70b9e2b1d4a4857c04'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:33.961401 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1046/2077] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:33 2022] POST /identity/v3/users => generated 292 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:33.962587 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e5391-e7e3-40a5-8bac-b4151a33442f admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:33.963957 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-e13c9f5c-42c8-4a90-87bb-d6403ce0c75f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a0a837efc394b70b9e2b1d4a4857c04'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:33.964357 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-723e5391-e7e3-40a5-8bac-b4151a33442f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:33.971983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-e13c9f5c-42c8-4a90-87bb-d6403ce0c75f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a0a837efc394b70b9e2b1d4a4857c04'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:33.979591 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e5391-e7e3-40a5-8bac-b4151a33442f admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:33.984819 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9357ea-7714-401a-b593-a88a8880e835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:33.985555 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9357ea-7714-401a-b593-a88a8880e835 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:33.985843 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9357ea-7714-401a-b593-a88a8880e835 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:33.986117 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9357ea-7714-401a-b593-a88a8880e835 admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:33.986851 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9357ea-7714-401a-b593-a88a8880e835 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:33.989124 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9357ea-7714-401a-b593-a88a8880e835 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:33.992557 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1032/2078] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:33 2022] DELETE /identity/v3/users/0a0a837efc394b70b9e2b1d4a4857c04 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:33.993642 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c9f5c-42c8-4a90-87bb-d6403ce0c75f admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:33.995131 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-e13c9f5c-42c8-4a90-87bb-d6403ce0c75f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:34.026528 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1047/2079] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:33 2022] POST /identity/v3/projects => generated 371 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:34.030731 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9357ea-7714-401a-b593-a88a8880e835 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:34.104588 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c9f5c-42c8-4a90-87bb-d6403ce0c75f admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:34.123128 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9357ea-7714-401a-b593-a88a8880e835 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:34.133031 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a776ecc-f39d-4bbe-9cc0-969092748e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:34.134076 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a776ecc-f39d-4bbe-9cc0-969092748e52 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:34.134612 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a776ecc-f39d-4bbe-9cc0-969092748e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:34.134740 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a776ecc-f39d-4bbe-9cc0-969092748e52 admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:34.135827 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a776ecc-f39d-4bbe-9cc0-969092748e52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:34.138388 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a776ecc-f39d-4bbe-9cc0-969092748e52 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:34.177432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1048/2080] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:34 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:50:34.181473 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a776ecc-f39d-4bbe-9cc0-969092748e52 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:34.201320 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a776ecc-f39d-4bbe-9cc0-969092748e52 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:34.209982 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21eb257-166f-49a9-8e86-e3ab47e66949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:34.212138 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21eb257-166f-49a9-8e86-e3ab47e66949 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:34.212556 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21eb257-166f-49a9-8e86-e3ab47e66949 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:34.213427 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21eb257-166f-49a9-8e86-e3ab47e66949 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:34.216584 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21eb257-166f-49a9-8e86-e3ab47e66949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:34.220053 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21eb257-166f-49a9-8e86-e3ab47e66949 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:34.237388 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1049/2081] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:50:34.241390 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21eb257-166f-49a9-8e86-e3ab47e66949 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:34.269569 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c8b8a-1f3b-4325-9405-6ce9caa9a3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:34.270400 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c8b8a-1f3b-4325-9405-6ce9caa9a3f2 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:34.270808 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c8b8a-1f3b-4325-9405-6ce9caa9a3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:34.271418 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c8b8a-1f3b-4325-9405-6ce9caa9a3f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:34.273922 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c8b8a-1f3b-4325-9405-6ce9caa9a3f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:34.277121 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21eb257-166f-49a9-8e86-e3ab47e66949 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:34.277764 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c8b8a-1f3b-4325-9405-6ce9caa9a3f2 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:34.289810 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce036a5-881c-4c87-b3a4-0b29367bdfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:34.290472 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce036a5-881c-4c87-b3a4-0b29367bdfdc admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:34.290756 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce036a5-881c-4c87-b3a4-0b29367bdfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:34.291057 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce036a5-881c-4c87-b3a4-0b29367bdfdc admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:34.291751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce036a5-881c-4c87-b3a4-0b29367bdfdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:34.293458 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce036a5-881c-4c87-b3a4-0b29367bdfdc admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:34.302253 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1033/2082] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:33 2022] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:34.303208 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c8b8a-1f3b-4325-9405-6ce9caa9a3f2 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:34.306619 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-c91c8b8a-1f3b-4325-9405-6ce9caa9a3f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:34.307191 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1050/2083] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:34.311140 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce036a5-881c-4c87-b3a4-0b29367bdfdc admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:34.314125 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-4ce036a5-881c-4c87-b3a4-0b29367bdfdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:34.325284 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c8b8a-1f3b-4325-9405-6ce9caa9a3f2 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:34.330473 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce036a5-881c-4c87-b3a4-0b29367bdfdc admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:34.330964 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65ecfe-adbb-4732-90ad-5bd4b6937ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:34.331668 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65ecfe-adbb-4732-90ad-5bd4b6937ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:34.331950 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65ecfe-adbb-4732-90ad-5bd4b6937ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:34.332225 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65ecfe-adbb-4732-90ad-5bd4b6937ebf admin admin] PATH_INFO: `/v3/projects/176d1a2d5624451f8198b5e3f5798dfa` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:34.333391 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65ecfe-adbb-4732-90ad-5bd4b6937ebf admin admin] RBAC: Authorizing `identity:delete_project(project_id=176d1a2d5624451f8198b5e3f5798dfa)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:34.335351 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65ecfe-adbb-4732-90ad-5bd4b6937ebf admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:34.335702 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ab21b-fe63-49d7-b81d-a909fecad765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:34.336395 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ab21b-fe63-49d7-b81d-a909fecad765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:34.336735 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ab21b-fe63-49d7-b81d-a909fecad765 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:34.337070 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ab21b-fe63-49d7-b81d-a909fecad765 admin admin] PATH_INFO: `/v3/projects/35277b5a0b954300859020aea7d676f4` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:34.338309 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ab21b-fe63-49d7-b81d-a909fecad765 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35277b5a0b954300859020aea7d676f4)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:34.340255 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ab21b-fe63-49d7-b81d-a909fecad765 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:34.396899 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:34.397132 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-ba2ab21b-fe63-49d7-b81d-a909fecad765 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35277b5a0b954300859020aea7d676f4', 'request_id': 'req-ba2ab21b-fe63-49d7-b81d-a909fecad765'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:34.402952 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-ba2ab21b-fe63-49d7-b81d-a909fecad765 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35277b5a0b954300859020aea7d676f4', 'request_id': 'req-ba2ab21b-fe63-49d7-b81d-a909fecad765'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:34.404578 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-7d65ecfe-adbb-4732-90ad-5bd4b6937ebf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '176d1a2d5624451f8198b5e3f5798dfa', 'request_id': 'req-7d65ecfe-adbb-4732-90ad-5bd4b6937ebf'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:34.412465 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-ba2ab21b-fe63-49d7-b81d-a909fecad765 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35277b5a0b954300859020aea7d676f4', 'request_id': 'req-ba2ab21b-fe63-49d7-b81d-a909fecad765'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:34.414332 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=87,keystone:INSERT=8,keystone:DELETE=5 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:34.421215 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-7d65ecfe-adbb-4732-90ad-5bd4b6937ebf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '176d1a2d5624451f8198b5e3f5798dfa', 'request_id': 'req-7d65ecfe-adbb-4732-90ad-5bd4b6937ebf'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:34.426816 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-ba2ab21b-fe63-49d7-b81d-a909fecad765 admin admin] The token cache is being invalidate because project 35277b5a0b954300859020aea7d676f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:34.427479 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-ba2ab21b-fe63-49d7-b81d-a909fecad765 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:34.429591 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-ba2ab21b-fe63-49d7-b81d-a909fecad765 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:34.431351 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1051/2084] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:34 2022] DELETE /identity/v3/projects/35277b5a0b954300859020aea7d676f4 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:34.432410 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ab21b-fe63-49d7-b81d-a909fecad765 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:34.433874 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-7d65ecfe-adbb-4732-90ad-5bd4b6937ebf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '176d1a2d5624451f8198b5e3f5798dfa', 'request_id': 'req-7d65ecfe-adbb-4732-90ad-5bd4b6937ebf'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:34.437083 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-ba2ab21b-fe63-49d7-b81d-a909fecad765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:34.449919 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-7d65ecfe-adbb-4732-90ad-5bd4b6937ebf admin admin] The token cache is being invalidate because project 176d1a2d5624451f8198b5e3f5798dfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:34.450304 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-7d65ecfe-adbb-4732-90ad-5bd4b6937ebf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:34.451068 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-7d65ecfe-adbb-4732-90ad-5bd4b6937ebf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:34.452873 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1034/2085] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:34 2022] DELETE /identity/v3/projects/176d1a2d5624451f8198b5e3f5798dfa => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:34.453470 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65ecfe-adbb-4732-90ad-5bd4b6937ebf admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:34.454850 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-7d65ecfe-adbb-4732-90ad-5bd4b6937ebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:34.525435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ab21b-fe63-49d7-b81d-a909fecad765 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:34.549209 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65ecfe-adbb-4732-90ad-5bd4b6937ebf admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:34.555395 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e6841-7f4c-44b1-b6ea-4f093d1cf40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:34.556194 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e6841-7f4c-44b1-b6ea-4f093d1cf40e admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:34.556481 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e6841-7f4c-44b1-b6ea-4f093d1cf40e admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:34.556808 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e6841-7f4c-44b1-b6ea-4f093d1cf40e admin admin] PATH_INFO: `/v3/projects/7c143fbf42c84d349f83ebcf0caffbad/users/97aa212e71cf46458998107bea0a4ac1/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:34.581314 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e6841-7f4c-44b1-b6ea-4f093d1cf40e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c143fbf42c84d349f83ebcf0caffbad, user_id=97aa212e71cf46458998107bea0a4ac1, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:34.584979 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e6841-7f4c-44b1-b6ea-4f093d1cf40e admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:34.606233 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1035/2086] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:34 2022] PUT /identity/v3/projects/7c143fbf42c84d349f83ebcf0caffbad/users/97aa212e71cf46458998107bea0a4ac1/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:34.608182 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3820e5b-6d14-4305-8682-4390838612da None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:34.608555 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3820e5b-6d14-4305-8682-4390838612da None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:34.608906 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3820e5b-6d14-4305-8682-4390838612da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:34.640730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a731dd2-cde6-4130-a29e-2df994b5b435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:34.641698 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a731dd2-cde6-4130-a29e-2df994b5b435 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:34.642041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a731dd2-cde6-4130-a29e-2df994b5b435 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:34.642293 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a731dd2-cde6-4130-a29e-2df994b5b435 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:34.642962 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a731dd2-cde6-4130-a29e-2df994b5b435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:34.643287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-f3820e5b-6d14-4305-8682-4390838612da None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:34.644667 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a731dd2-cde6-4130-a29e-2df994b5b435 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:34.644900 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-f3820e5b-6d14-4305-8682-4390838612da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:34.657648 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1052/2087] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:34 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:34.658542 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a731dd2-cde6-4130-a29e-2df994b5b435 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:34.660255 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-2a731dd2-cde6-4130-a29e-2df994b5b435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:34.678857 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a731dd2-cde6-4130-a29e-2df994b5b435 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:34.740026 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1036/2088] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:34.741257 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea61ce5-ffaf-46ab-adcc-445e438dac45 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:34.741592 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea61ce5-ffaf-46ab-adcc-445e438dac45 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:34.741872 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea61ce5-ffaf-46ab-adcc-445e438dac45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:34.766550 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f99eb3-ac77-4902-8cb8-0772153e3959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:34.767252 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f99eb3-ac77-4902-8cb8-0772153e3959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:34.767477 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f99eb3-ac77-4902-8cb8-0772153e3959 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:34.767864 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f99eb3-ac77-4902-8cb8-0772153e3959 admin admin] PATH_INFO: `/v3/users/5fd488cee3e34da88bfbc0107b2f077b` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:34.769044 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f99eb3-ac77-4902-8cb8-0772153e3959 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fd488cee3e34da88bfbc0107b2f077b)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:34.771216 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f99eb3-ac77-4902-8cb8-0772153e3959 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:34.777906 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-2ea61ce5-ffaf-46ab-adcc-445e438dac45 None None] MFA Rules not processed for user `97aa212e71cf46458998107bea0a4ac1`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:34.779172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-2ea61ce5-ffaf-46ab-adcc-445e438dac45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:34.811509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:DELETE=7,keystone:SELECT=93 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:34.818558 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:34.822927 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-a2f99eb3-ac77-4902-8cb8-0772153e3959 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fd488cee3e34da88bfbc0107b2f077b'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:34.823640 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-a2f99eb3-ac77-4902-8cb8-0772153e3959 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fd488cee3e34da88bfbc0107b2f077b'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:34.824442 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-a2f99eb3-ac77-4902-8cb8-0772153e3959 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fd488cee3e34da88bfbc0107b2f077b'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:34.837828 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-a2f99eb3-ac77-4902-8cb8-0772153e3959 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fd488cee3e34da88bfbc0107b2f077b'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:34.846604 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-a2f99eb3-ac77-4902-8cb8-0772153e3959 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fd488cee3e34da88bfbc0107b2f077b'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:34.859813 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1037/2089] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:34.859813 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea61ce5-ffaf-46ab-adcc-445e438dac45 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:34.859813 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-2ea61ce5-ffaf-46ab-adcc-445e438dac45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:34.864791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1053/2090] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:34 2022] DELETE /identity/v3/users/5fd488cee3e34da88bfbc0107b2f077b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:34.866368 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7377bcb-001d-40b7-a428-8895197dc6d7 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:34.866822 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7377bcb-001d-40b7-a428-8895197dc6d7 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:34.867244 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7377bcb-001d-40b7-a428-8895197dc6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:34.878146 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea61ce5-ffaf-46ab-adcc-445e438dac45 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:34.891198 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-d7377bcb-001d-40b7-a428-8895197dc6d7 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:34.892754 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-d7377bcb-001d-40b7-a428-8895197dc6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:34.945802 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eaa00b-25db-4eb3-af4d-6e8e1964c324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:34.946752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eaa00b-25db-4eb3-af4d-6e8e1964c324 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:34.947050 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eaa00b-25db-4eb3-af4d-6e8e1964c324 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:34.947292 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eaa00b-25db-4eb3-af4d-6e8e1964c324 admin admin] PATH_INFO: `/v3/projects/2e4de3ce987e46f3a4a269d36c4ee261/users/989493ad6c05493089394c03d4d32f5d/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:34.964243 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eaa00b-25db-4eb3-af4d-6e8e1964c324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e4de3ce987e46f3a4a269d36c4ee261, user_id=989493ad6c05493089394c03d4d32f5d, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:34.967235 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eaa00b-25db-4eb3-af4d-6e8e1964c324 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:34.980630 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1054/2091] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:34.981800 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7377bcb-001d-40b7-a428-8895197dc6d7 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:34.983108 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-d7377bcb-001d-40b7-a428-8895197dc6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:34.984613 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1038/2092] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:34 2022] PUT /identity/v3/projects/2e4de3ce987e46f3a4a269d36c4ee261/users/989493ad6c05493089394c03d4d32f5d/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:34.990285 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eaa00b-25db-4eb3-af4d-6e8e1964c324 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:34.995378 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-85eaa00b-25db-4eb3-af4d-6e8e1964c324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:34.995764 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7377bcb-001d-40b7-a428-8895197dc6d7 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:35.066143 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70105d8-7036-4044-bda2-965c1bf41d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:35.067051 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70105d8-7036-4044-bda2-965c1bf41d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:35.067494 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70105d8-7036-4044-bda2-965c1bf41d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:35.068080 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70105d8-7036-4044-bda2-965c1bf41d98 admin admin] PATH_INFO: `/v3/users/52731013c58742e98997035e255bd032` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:35.068926 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70105d8-7036-4044-bda2-965c1bf41d98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52731013c58742e98997035e255bd032)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:35.070915 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70105d8-7036-4044-bda2-965c1bf41d98 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:35.075917 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eaa00b-25db-4eb3-af4d-6e8e1964c324 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:35.079746 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b2e49-7ef4-4f38-b40a-0a741d8c8f3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:35.080331 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b2e49-7ef4-4f38-b40a-0a741d8c8f3e service cinder] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:35.080838 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b2e49-7ef4-4f38-b40a-0a741d8c8f3e service cinder] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:35.080943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b2e49-7ef4-4f38-b40a-0a741d8c8f3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:35.130600 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-e70105d8-7036-4044-bda2-965c1bf41d98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52731013c58742e98997035e255bd032'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:35.136731 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-e70105d8-7036-4044-bda2-965c1bf41d98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52731013c58742e98997035e255bd032'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:35.137379 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-e70105d8-7036-4044-bda2-965c1bf41d98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52731013c58742e98997035e255bd032'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:35.144177 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:35.152997 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9b2e49-7ef4-4f38-b40a-0a741d8c8f3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:35.154835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9b2e49-7ef4-4f38-b40a-0a741d8c8f3e service cinder] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:35.164504 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-e70105d8-7036-4044-bda2-965c1bf41d98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52731013c58742e98997035e255bd032'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:35.169287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1039/2093] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:35.171741 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b2e49-7ef4-4f38-b40a-0a741d8c8f3e service cinder] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:35.179135 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-e70105d8-7036-4044-bda2-965c1bf41d98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52731013c58742e98997035e255bd032'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:35.186110 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b2e49-7ef4-4f38-b40a-0a741d8c8f3e service cinder] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:35.192116 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f981ec-0c19-4ae7-a8cb-fe5556c9bc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:35.193004 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f981ec-0c19-4ae7-a8cb-fe5556c9bc7e admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:35.193501 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f981ec-0c19-4ae7-a8cb-fe5556c9bc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:35.193918 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f981ec-0c19-4ae7-a8cb-fe5556c9bc7e admin admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:35.194725 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f981ec-0c19-4ae7-a8cb-fe5556c9bc7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:35.195036 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f981ec-0c19-4ae7-a8cb-fe5556c9bc7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:35.199775 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1055/2094] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:34 2022] DELETE /identity/v3/users/52731013c58742e98997035e255bd032 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:35.200216 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f981ec-0c19-4ae7-a8cb-fe5556c9bc7e admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:35.200471 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7cdda-8aff-4c3d-8807-ef2d0c5b952e None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:35.200471 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7cdda-8aff-4c3d-8807-ef2d0c5b952e None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:35.200471 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7cdda-8aff-4c3d-8807-ef2d0c5b952e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:35.204934 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:35.212657 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1040/2095] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:35.213938 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f981ec-0c19-4ae7-a8cb-fe5556c9bc7e admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:35.216779 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-76f981ec-0c19-4ae7-a8cb-fe5556c9bc7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:35.230974 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f981ec-0c19-4ae7-a8cb-fe5556c9bc7e admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:35.232459 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-55c7cdda-8aff-4c3d-8807-ef2d0c5b952e None None] MFA Rules not processed for user `989493ad6c05493089394c03d4d32f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:35.233790 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-55c7cdda-8aff-4c3d-8807-ef2d0c5b952e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:35.292830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8e70c-4275-47c8-a7c2-474c6140738f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:35.293499 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8e70c-4275-47c8-a7c2-474c6140738f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:35.293784 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8e70c-4275-47c8-a7c2-474c6140738f admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:35.294064 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8e70c-4275-47c8-a7c2-474c6140738f admin admin] PATH_INFO: `/v3/projects/ba5cab5de7d9418188b777a305800e29` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:35.295216 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df8e70c-4275-47c8-a7c2-474c6140738f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba5cab5de7d9418188b777a305800e29)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:35.297156 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df8e70c-4275-47c8-a7c2-474c6140738f admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:35.312244 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1056/2096] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:35.313106 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7cdda-8aff-4c3d-8807-ef2d0c5b952e None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:35.314820 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-55c7cdda-8aff-4c3d-8807-ef2d0c5b952e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:35.332416 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7cdda-8aff-4c3d-8807-ef2d0c5b952e None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:35.337597 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc94bf-a179-41f6-b9b0-f84c9de64b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:35.338485 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc94bf-a179-41f6-b9b0-f84c9de64b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:35.338767 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc94bf-a179-41f6-b9b0-f84c9de64b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:35.339033 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc94bf-a179-41f6-b9b0-f84c9de64b4e admin admin] PATH_INFO: `/v3/users/97aa212e71cf46458998107bea0a4ac1` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:35.340200 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc94bf-a179-41f6-b9b0-f84c9de64b4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=97aa212e71cf46458998107bea0a4ac1)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:35.342212 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc94bf-a179-41f6-b9b0-f84c9de64b4e admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:35.348452 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-0df8e70c-4275-47c8-a7c2-474c6140738f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba5cab5de7d9418188b777a305800e29', 'request_id': 'req-0df8e70c-4275-47c8-a7c2-474c6140738f'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:35.357730 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-0df8e70c-4275-47c8-a7c2-474c6140738f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba5cab5de7d9418188b777a305800e29', 'request_id': 'req-0df8e70c-4275-47c8-a7c2-474c6140738f'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:35.365504 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-0df8e70c-4275-47c8-a7c2-474c6140738f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba5cab5de7d9418188b777a305800e29', 'request_id': 'req-0df8e70c-4275-47c8-a7c2-474c6140738f'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:35.378106 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-0df8e70c-4275-47c8-a7c2-474c6140738f admin admin] The token cache is being invalidate because project ba5cab5de7d9418188b777a305800e29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:35.378390 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-0df8e70c-4275-47c8-a7c2-474c6140738f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:35.379133 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-0df8e70c-4275-47c8-a7c2-474c6140738f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:35.380732 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1041/2097] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:35 2022] DELETE /identity/v3/projects/ba5cab5de7d9418188b777a305800e29 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:35.384201 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd4298-502f-489b-9b84-7081f3db5385 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:35.384201 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd4298-502f-489b-9b84-7081f3db5385 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:35.384201 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd4298-502f-489b-9b84-7081f3db5385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:35.393961 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-7ccc94bf-a179-41f6-b9b0-f84c9de64b4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97aa212e71cf46458998107bea0a4ac1'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:35.394612 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-7ccc94bf-a179-41f6-b9b0-f84c9de64b4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97aa212e71cf46458998107bea0a4ac1'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:35.395264 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-7ccc94bf-a179-41f6-b9b0-f84c9de64b4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97aa212e71cf46458998107bea0a4ac1'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:35.400842 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-7abd4298-502f-489b-9b84-7081f3db5385 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:35.402089 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-7abd4298-502f-489b-9b84-7081f3db5385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:35.407071 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-7ccc94bf-a179-41f6-b9b0-f84c9de64b4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97aa212e71cf46458998107bea0a4ac1'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:35.415391 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-7ccc94bf-a179-41f6-b9b0-f84c9de64b4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97aa212e71cf46458998107bea0a4ac1'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:35.427685 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1057/2098] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:35 2022] DELETE /identity/v3/users/97aa212e71cf46458998107bea0a4ac1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:35.430270 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc94bf-a179-41f6-b9b0-f84c9de64b4e admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:35.431749 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-7ccc94bf-a179-41f6-b9b0-f84c9de64b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:35.460494 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1042/2099] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:35.461514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd4298-502f-489b-9b84-7081f3db5385 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:35.463467 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-7abd4298-502f-489b-9b84-7081f3db5385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:35.473160 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:35.475764 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd4298-502f-489b-9b84-7081f3db5385 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:35.498179 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc94bf-a179-41f6-b9b0-f84c9de64b4e admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:35.503211 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31564cf9-cc8d-4039-9513-6d6a9617bfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:35.503830 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31564cf9-cc8d-4039-9513-6d6a9617bfaa admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:35.504119 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31564cf9-cc8d-4039-9513-6d6a9617bfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:35.504262 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:35.504382 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31564cf9-cc8d-4039-9513-6d6a9617bfaa admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:35.505008 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31564cf9-cc8d-4039-9513-6d6a9617bfaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:35.507204 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31564cf9-cc8d-4039-9513-6d6a9617bfaa admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:35.537936 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1058/2100] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:35 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:35.537936 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e0d22-8b84-47d6-bc4d-cad490c5d2c7 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:35.537936 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e0d22-8b84-47d6-bc4d-cad490c5d2c7 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:35.537936 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e0d22-8b84-47d6-bc4d-cad490c5d2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:35.539635 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23ecbf-5174-4533-a786-8046d660d62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:35.540258 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23ecbf-5174-4533-a786-8046d660d62e admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:35.540576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23ecbf-5174-4533-a786-8046d660d62e admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:35.541032 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23ecbf-5174-4533-a786-8046d660d62e admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:35.541708 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23ecbf-5174-4533-a786-8046d660d62e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:35.543927 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23ecbf-5174-4533-a786-8046d660d62e admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:35.556877 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-1b9e0d22-8b84-47d6-bc4d-cad490c5d2c7 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:35.558113 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-1b9e0d22-8b84-47d6-bc4d-cad490c5d2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:35.572507 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1043/2101] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:35 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:35.574379 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92c549-54ad-4011-a458-c013a0a937d2 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:35.574664 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92c549-54ad-4011-a458-c013a0a937d2 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:35.574935 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92c549-54ad-4011-a458-c013a0a937d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:35.596257 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-ce92c549-54ad-4011-a458-c013a0a937d2 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:35.597527 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-ce92c549-54ad-4011-a458-c013a0a937d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:35.627363 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1059/2102] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:35.628195 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e0d22-8b84-47d6-bc4d-cad490c5d2c7 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:35.629629 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-1b9e0d22-8b84-47d6-bc4d-cad490c5d2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:35.666305 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1044/2103] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:35.670544 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92c549-54ad-4011-a458-c013a0a937d2 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:35.682640 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92c549-54ad-4011-a458-c013a0a937d2 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:35.688066 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb497b-adde-445d-b45c-a8df8683531b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:35.688730 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb497b-adde-445d-b45c-a8df8683531b admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:35.689150 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb497b-adde-445d-b45c-a8df8683531b admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:35.689464 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb497b-adde-445d-b45c-a8df8683531b admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:35.690099 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb497b-adde-445d-b45c-a8df8683531b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:35.692064 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb497b-adde-445d-b45c-a8df8683531b admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:35.692765 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e0d22-8b84-47d6-bc4d-cad490c5d2c7 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:35.715274 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1045/2104] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:35 2022] POST /identity/v3/users => generated 283 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:35.716654 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb497b-adde-445d-b45c-a8df8683531b admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:35.732180 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb497b-adde-445d-b45c-a8df8683531b admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:35.737314 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd2ed3-8d11-49df-a5ee-fa6316ceeeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:35.737960 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd2ed3-8d11-49df-a5ee-fa6316ceeeea admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:35.738241 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd2ed3-8d11-49df-a5ee-fa6316ceeeea admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:35.738514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd2ed3-8d11-49df-a5ee-fa6316ceeeea admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:35.739137 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd2ed3-8d11-49df-a5ee-fa6316ceeeea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:35.741073 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd2ed3-8d11-49df-a5ee-fa6316ceeeea admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:35.771879 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1046/2105] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:35 2022] POST /identity/v3/users => generated 297 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:35.773207 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84d834-fa40-43dc-bd9b-6e014e977955 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:35.773533 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84d834-fa40-43dc-bd9b-6e014e977955 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:35.773811 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84d834-fa40-43dc-bd9b-6e014e977955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:35.776677 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6b5cc-5cf1-4a66-bec6-7d7a9a546443 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:35.777647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6b5cc-5cf1-4a66-bec6-7d7a9a546443 service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:35.777928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6b5cc-5cf1-4a66-bec6-7d7a9a546443 service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:35.778202 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6b5cc-5cf1-4a66-bec6-7d7a9a546443 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:35.790985 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6b5cc-5cf1-4a66-bec6-7d7a9a546443 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:35.792547 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6b5cc-5cf1-4a66-bec6-7d7a9a546443 service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:35.805434 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-dc84d834-fa40-43dc-bd9b-6e014e977955 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:35.805581 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1060/2106] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:35.806469 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6b5cc-5cf1-4a66-bec6-7d7a9a546443 service neutron] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:35.807445 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-dc84d834-fa40-43dc-bd9b-6e014e977955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:35.816352 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6b5cc-5cf1-4a66-bec6-7d7a9a546443 service neutron] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:35.819862 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1047/2107] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:35.820995 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84d834-fa40-43dc-bd9b-6e014e977955 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:35.824449 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b21fb-9c4d-4753-ac58-3ac067219fcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:35.825306 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b21fb-9c4d-4753-ac58-3ac067219fcb service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:35.825778 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b21fb-9c4d-4753-ac58-3ac067219fcb service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:35.826155 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b21fb-9c4d-4753-ac58-3ac067219fcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:35.834229 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84d834-fa40-43dc-bd9b-6e014e977955 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:35.839539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b21fb-9c4d-4753-ac58-3ac067219fcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:35.840367 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535163b-a60f-4387-9703-6acd23395234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:35.841122 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535163b-a60f-4387-9703-6acd23395234 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:35.841399 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b21fb-9c4d-4753-ac58-3ac067219fcb service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:35.841549 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535163b-a60f-4387-9703-6acd23395234 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:35.841910 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535163b-a60f-4387-9703-6acd23395234 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:35.842778 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535163b-a60f-4387-9703-6acd23395234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:35.844723 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535163b-a60f-4387-9703-6acd23395234 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:35.861540 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1048/2108] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:35.861718 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1061/2109] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:35.861800 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535163b-a60f-4387-9703-6acd23395234 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:35.861907 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b21fb-9c4d-4753-ac58-3ac067219fcb service neutron] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:35.871618 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535163b-a60f-4387-9703-6acd23395234 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:35.876452 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:35.879002 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552b3b5-7ea9-4007-918c-f77f7702e741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:35.879758 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552b3b5-7ea9-4007-918c-f77f7702e741 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:35.880327 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552b3b5-7ea9-4007-918c-f77f7702e741 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:35.880520 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552b3b5-7ea9-4007-918c-f77f7702e741 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:35.881400 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7552b3b5-7ea9-4007-918c-f77f7702e741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:35.883231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7552b3b5-7ea9-4007-918c-f77f7702e741 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:35.885261 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b21fb-9c4d-4753-ac58-3ac067219fcb service neutron] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:35.895474 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d1beb-d93c-460b-9885-493dd0173f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:35.896064 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d1beb-d93c-460b-9885-493dd0173f21 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:35.896343 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d1beb-d93c-460b-9885-493dd0173f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:35.896718 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d1beb-d93c-460b-9885-493dd0173f21 admin admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:35.897732 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d1beb-d93c-460b-9885-493dd0173f21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:35.898042 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d1beb-d93c-460b-9885-493dd0173f21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:35.900560 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d1beb-d93c-460b-9885-493dd0173f21 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:35.905951 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1049/2110] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:35.905951 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552b3b5-7ea9-4007-918c-f77f7702e741 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:35.918293 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552b3b5-7ea9-4007-918c-f77f7702e741 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:35.918461 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1062/2111] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:35.919084 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d1beb-d93c-460b-9885-493dd0173f21 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:35.930158 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d1beb-d93c-460b-9885-493dd0173f21 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:35.936090 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917acc1-451f-4cb2-a659-703d4e73bf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:35.936929 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917acc1-451f-4cb2-a659-703d4e73bf46 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:35.937254 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917acc1-451f-4cb2-a659-703d4e73bf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:35.937562 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917acc1-451f-4cb2-a659-703d4e73bf46 admin admin] PATH_INFO: `/v3/projects/7b1d273d0f8a4ddd88a24fb6ef808ca3/users/2d1017b242cd4c09b124a18589ec130c/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:35.938563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947dd75-3c95-4982-b30e-64074c3ea9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:35.939468 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947dd75-3c95-4982-b30e-64074c3ea9ef admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:35.939741 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947dd75-3c95-4982-b30e-64074c3ea9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:35.940108 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947dd75-3c95-4982-b30e-64074c3ea9ef admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:35.940917 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947dd75-3c95-4982-b30e-64074c3ea9ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:35.942682 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947dd75-3c95-4982-b30e-64074c3ea9ef admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:35.956978 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1050/2112] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:35.959531 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917acc1-451f-4cb2-a659-703d4e73bf46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b1d273d0f8a4ddd88a24fb6ef808ca3, user_id=2d1017b242cd4c09b124a18589ec130c, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:35.961224 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947dd75-3c95-4982-b30e-64074c3ea9ef admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:35.964486 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917acc1-451f-4cb2-a659-703d4e73bf46 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:35.974132 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947dd75-3c95-4982-b30e-64074c3ea9ef admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:35.988897 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1063/2113] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:35 2022] PUT /identity/v3/projects/7b1d273d0f8a4ddd88a24fb6ef808ca3/users/2d1017b242cd4c09b124a18589ec130c/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:35.988897 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917acc1-451f-4cb2-a659-703d4e73bf46 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:36.032999 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:36.064845 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb28b81-bfa5-4aa7-a18b-7e6f41376893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:36.065525 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb28b81-bfa5-4aa7-a18b-7e6f41376893 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:36.065804 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb28b81-bfa5-4aa7-a18b-7e6f41376893 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:36.066070 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb28b81-bfa5-4aa7-a18b-7e6f41376893 admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:36.066735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb28b81-bfa5-4aa7-a18b-7e6f41376893 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:36.068704 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb28b81-bfa5-4aa7-a18b-7e6f41376893 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:36.075825 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917acc1-451f-4cb2-a659-703d4e73bf46 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:36.081528 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd81abd-6023-42c6-91e0-5cf2f217c656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:36.082426 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd81abd-6023-42c6-91e0-5cf2f217c656 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:36.082641 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd81abd-6023-42c6-91e0-5cf2f217c656 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:36.082919 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd81abd-6023-42c6-91e0-5cf2f217c656 admin admin] PATH_INFO: `/v3/projects/d937f8edf4574567aa2abb50826af2a2/users/2c4cfefbc06641818ba7e6e019a16a61/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:36.103352 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd81abd-6023-42c6-91e0-5cf2f217c656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d937f8edf4574567aa2abb50826af2a2, user_id=2c4cfefbc06641818ba7e6e019a16a61, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:36.106602 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1051/2114] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:35 2022] POST /identity/v3/projects => generated 377 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:36.107912 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb28b81-bfa5-4aa7-a18b-7e6f41376893 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:36.110964 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd81abd-6023-42c6-91e0-5cf2f217c656 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:36.130953 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1064/2115] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:35 2022] PUT /identity/v3/projects/d937f8edf4574567aa2abb50826af2a2/users/2c4cfefbc06641818ba7e6e019a16a61/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:36.131934 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd81abd-6023-42c6-91e0-5cf2f217c656 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:36.252040 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb28b81-bfa5-4aa7-a18b-7e6f41376893 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:36.253376 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd81abd-6023-42c6-91e0-5cf2f217c656 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:36.257652 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b6339-4109-4550-bad6-01e06b50ac32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:36.258336 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b6339-4109-4550-bad6-01e06b50ac32 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:36.258707 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b6339-4109-4550-bad6-01e06b50ac32 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:36.259090 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b6339-4109-4550-bad6-01e06b50ac32 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:36.259815 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b6339-4109-4550-bad6-01e06b50ac32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:36.261951 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b6339-4109-4550-bad6-01e06b50ac32 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:36.263512 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e633baf-e2b1-4c78-854e-22a0509ca2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:36.267727 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e633baf-e2b1-4c78-854e-22a0509ca2d3 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:36.268020 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e633baf-e2b1-4c78-854e-22a0509ca2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:36.268305 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e633baf-e2b1-4c78-854e-22a0509ca2d3 admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:36.269073 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e633baf-e2b1-4c78-854e-22a0509ca2d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:36.273765 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1052/2116] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:36.277150 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e633baf-e2b1-4c78-854e-22a0509ca2d3 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:36.279021 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7460b64-b68c-499a-bb72-722605b9c90a None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:36.279525 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7460b64-b68c-499a-bb72-722605b9c90a None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:36.280019 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7460b64-b68c-499a-bb72-722605b9c90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:36.321639 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1065/2117] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:36 2022] POST /identity/v3/users => generated 289 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:36.322353 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e633baf-e2b1-4c78-854e-22a0509ca2d3 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:36.345133 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-a7460b64-b68c-499a-bb72-722605b9c90a None None] MFA Rules not processed for user `2c4cfefbc06641818ba7e6e019a16a61`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:36.345693 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e633baf-e2b1-4c78-854e-22a0509ca2d3 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:36.346906 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-a7460b64-b68c-499a-bb72-722605b9c90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:36.350742 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dec409-ab1d-4402-a6f9-6dd62b110018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:36.351719 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dec409-ab1d-4402-a6f9-6dd62b110018 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:36.352154 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dec409-ab1d-4402-a6f9-6dd62b110018 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:36.352432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dec409-ab1d-4402-a6f9-6dd62b110018 admin admin] PATH_INFO: `/v3/projects/7b1d273d0f8a4ddd88a24fb6ef808ca3/users/2d1017b242cd4c09b124a18589ec130c/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:36.354642 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dec409-ab1d-4402-a6f9-6dd62b110018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b1d273d0f8a4ddd88a24fb6ef808ca3, user_id=2d1017b242cd4c09b124a18589ec130c, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:36.357536 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dec409-ab1d-4402-a6f9-6dd62b110018 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:36.373116 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1066/2118] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:36 2022] PUT /identity/v3/projects/7b1d273d0f8a4ddd88a24fb6ef808ca3/users/2d1017b242cd4c09b124a18589ec130c/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:36.378241 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dec409-ab1d-4402-a6f9-6dd62b110018 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:36.424819 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:36.435995 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1053/2119] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:36.436851 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7460b64-b68c-499a-bb72-722605b9c90a None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:36.438198 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-a7460b64-b68c-499a-bb72-722605b9c90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:36.452275 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7460b64-b68c-499a-bb72-722605b9c90a None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:36.462376 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dec409-ab1d-4402-a6f9-6dd62b110018 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:36.467218 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb3f37-0a47-4d53-8d97-d41346ec6fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:36.467901 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb3f37-0a47-4d53-8d97-d41346ec6fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:36.468250 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb3f37-0a47-4d53-8d97-d41346ec6fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:36.468525 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb3f37-0a47-4d53-8d97-d41346ec6fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:36.469172 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb3f37-0a47-4d53-8d97-d41346ec6fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:36.470872 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb3f37-0a47-4d53-8d97-d41346ec6fe8 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:36.480931 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1067/2120] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:36.484754 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb3f37-0a47-4d53-8d97-d41346ec6fe8 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:36.486540 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-ecbb3f37-0a47-4d53-8d97-d41346ec6fe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:36.499168 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb3f37-0a47-4d53-8d97-d41346ec6fe8 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:36.501617 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:36.504628 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f627f296-4d9e-4150-a305-c1ec0afa3d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:36.505248 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627f296-4d9e-4150-a305-c1ec0afa3d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:36.505536 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627f296-4d9e-4150-a305-c1ec0afa3d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:36.505807 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f627f296-4d9e-4150-a305-c1ec0afa3d68 admin admin] PATH_INFO: `/v3/projects/0457a87f166741bbb4b42b22196e0f99` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:36.506909 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627f296-4d9e-4150-a305-c1ec0afa3d68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0457a87f166741bbb4b42b22196e0f99)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:36.508797 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f627f296-4d9e-4150-a305-c1ec0afa3d68 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:36.513708 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889f3b9-fddf-4789-a49f-d80a13dad7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:36.514348 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889f3b9-fddf-4789-a49f-d80a13dad7b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:36.514656 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889f3b9-fddf-4789-a49f-d80a13dad7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:36.514932 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889f3b9-fddf-4789-a49f-d80a13dad7b1 admin admin] PATH_INFO: `/v3/projects/7c143fbf42c84d349f83ebcf0caffbad` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:36.516541 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889f3b9-fddf-4789-a49f-d80a13dad7b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c143fbf42c84d349f83ebcf0caffbad)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:36.519077 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889f3b9-fddf-4789-a49f-d80a13dad7b1 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:36.558078 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-f627f296-4d9e-4150-a305-c1ec0afa3d68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0457a87f166741bbb4b42b22196e0f99', 'request_id': 'req-f627f296-4d9e-4150-a305-c1ec0afa3d68'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:36.564385 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-f627f296-4d9e-4150-a305-c1ec0afa3d68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0457a87f166741bbb4b42b22196e0f99', 'request_id': 'req-f627f296-4d9e-4150-a305-c1ec0afa3d68'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:36.566236 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-1889f3b9-fddf-4789-a49f-d80a13dad7b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c143fbf42c84d349f83ebcf0caffbad', 'request_id': 'req-1889f3b9-fddf-4789-a49f-d80a13dad7b1'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:36.572219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-f627f296-4d9e-4150-a305-c1ec0afa3d68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0457a87f166741bbb4b42b22196e0f99', 'request_id': 'req-f627f296-4d9e-4150-a305-c1ec0afa3d68'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:36.574571 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-1889f3b9-fddf-4789-a49f-d80a13dad7b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c143fbf42c84d349f83ebcf0caffbad', 'request_id': 'req-1889f3b9-fddf-4789-a49f-d80a13dad7b1'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:36.580961 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-1889f3b9-fddf-4789-a49f-d80a13dad7b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c143fbf42c84d349f83ebcf0caffbad', 'request_id': 'req-1889f3b9-fddf-4789-a49f-d80a13dad7b1'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:36.582922 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-f627f296-4d9e-4150-a305-c1ec0afa3d68 admin admin] The token cache is being invalidate because project 0457a87f166741bbb4b42b22196e0f99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:36.583207 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-f627f296-4d9e-4150-a305-c1ec0afa3d68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:36.583845 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-f627f296-4d9e-4150-a305-c1ec0afa3d68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:36.585761 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1068/2121] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:36 2022] DELETE /identity/v3/projects/0457a87f166741bbb4b42b22196e0f99 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:36.589681 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da202fe-8df0-4434-8d08-0dc946a020c0 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:36.589961 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da202fe-8df0-4434-8d08-0dc946a020c0 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:36.590242 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da202fe-8df0-4434-8d08-0dc946a020c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:36.592516 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-1889f3b9-fddf-4789-a49f-d80a13dad7b1 admin admin] The token cache is being invalidate because project 7c143fbf42c84d349f83ebcf0caffbad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:36.592805 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-1889f3b9-fddf-4789-a49f-d80a13dad7b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:36.593548 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-1889f3b9-fddf-4789-a49f-d80a13dad7b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:36.595102 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1054/2122] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:36 2022] DELETE /identity/v3/projects/7c143fbf42c84d349f83ebcf0caffbad => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:36.598295 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889f3b9-fddf-4789-a49f-d80a13dad7b1 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:36.598295 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-1889f3b9-fddf-4789-a49f-d80a13dad7b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:36.619268 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-5da202fe-8df0-4434-8d08-0dc946a020c0 None None] MFA Rules not processed for user `2d1017b242cd4c09b124a18589ec130c`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:36.620498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-5da202fe-8df0-4434-8d08-0dc946a020c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:36.663197 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889f3b9-fddf-4789-a49f-d80a13dad7b1 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:36.667797 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02908ca1-d611-4252-844a-1c327562740c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:36.668411 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02908ca1-d611-4252-844a-1c327562740c admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:36.668688 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02908ca1-d611-4252-844a-1c327562740c admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:36.668960 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02908ca1-d611-4252-844a-1c327562740c admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:36.669632 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02908ca1-d611-4252-844a-1c327562740c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:36.671562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02908ca1-d611-4252-844a-1c327562740c admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:36.690324 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1069/2123] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:36 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:36.691240 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da202fe-8df0-4434-8d08-0dc946a020c0 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:36.692516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-5da202fe-8df0-4434-8d08-0dc946a020c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:36.706466 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1055/2124] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:36 2022] POST /identity/v3/projects => generated 363 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:36.706871 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da202fe-8df0-4434-8d08-0dc946a020c0 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:36.707375 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02908ca1-d611-4252-844a-1c327562740c admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:36.708912 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-02908ca1-d611-4252-844a-1c327562740c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:36.741026 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:36.770894 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6bcd2-f63e-4e69-bdda-e242cad8084b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:36.771543 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6bcd2-f63e-4e69-bdda-e242cad8084b admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:36.771824 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6bcd2-f63e-4e69-bdda-e242cad8084b admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:36.772092 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6bcd2-f63e-4e69-bdda-e242cad8084b admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:36.772775 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6bcd2-f63e-4e69-bdda-e242cad8084b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:36.774417 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6bcd2-f63e-4e69-bdda-e242cad8084b admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:36.777247 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02908ca1-d611-4252-844a-1c327562740c admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:36.782028 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd98c7-2f81-40e5-a395-a72125b97505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:36.782694 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd98c7-2f81-40e5-a395-a72125b97505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:36.782978 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd98c7-2f81-40e5-a395-a72125b97505 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:36.783254 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd98c7-2f81-40e5-a395-a72125b97505 admin admin] PATH_INFO: `/v3/users/8ab84285d60642328bdd11ded9a8568c` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:36.784416 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd98c7-2f81-40e5-a395-a72125b97505 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ab84285d60642328bdd11ded9a8568c)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:36.784530 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1070/2125] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:36.785722 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c019cb-7d7d-479e-bcb9-37d1b17012ac None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:36.786007 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c019cb-7d7d-479e-bcb9-37d1b17012ac None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:36.786279 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c019cb-7d7d-479e-bcb9-37d1b17012ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:36.786429 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd98c7-2f81-40e5-a395-a72125b97505 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:36.792177 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:36.807845 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-54c019cb-7d7d-479e-bcb9-37d1b17012ac None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:36.809062 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-54c019cb-7d7d-479e-bcb9-37d1b17012ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:36.818333 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1071/2126] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:36.819182 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c019cb-7d7d-479e-bcb9-37d1b17012ac None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:36.820561 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-54c019cb-7d7d-479e-bcb9-37d1b17012ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:36.848061 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-0edd98c7-2f81-40e5-a395-a72125b97505 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ab84285d60642328bdd11ded9a8568c'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:36.848774 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-0edd98c7-2f81-40e5-a395-a72125b97505 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ab84285d60642328bdd11ded9a8568c'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:36.849463 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-0edd98c7-2f81-40e5-a395-a72125b97505 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ab84285d60642328bdd11ded9a8568c'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:36.861804 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-0edd98c7-2f81-40e5-a395-a72125b97505 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ab84285d60642328bdd11ded9a8568c'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:36.870215 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-0edd98c7-2f81-40e5-a395-a72125b97505 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ab84285d60642328bdd11ded9a8568c'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:36.879552 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c019cb-7d7d-479e-bcb9-37d1b17012ac None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:36.883291 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99eb5f-7067-40bc-b096-d6f82e4e7d4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:36.883896 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99eb5f-7067-40bc-b096-d6f82e4e7d4d service cinder] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:36.884068 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1056/2127] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:36 2022] DELETE /identity/v3/users/8ab84285d60642328bdd11ded9a8568c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:36.884189 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99eb5f-7067-40bc-b096-d6f82e4e7d4d service cinder] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:36.884429 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99eb5f-7067-40bc-b096-d6f82e4e7d4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:36.884876 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd98c7-2f81-40e5-a395-a72125b97505 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:36.886239 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-cb99eb5f-7067-40bc-b096-d6f82e4e7d4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:36.886343 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-0edd98c7-2f81-40e5-a395-a72125b97505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:36.964751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99eb5f-7067-40bc-b096-d6f82e4e7d4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:36.965485 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd98c7-2f81-40e5-a395-a72125b97505 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:36.966969 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99eb5f-7067-40bc-b096-d6f82e4e7d4d service cinder] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:36.971895 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5cdbca-21e7-4d79-ab66-537ec366d234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:36.971895 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cdbca-21e7-4d79-ab66-537ec366d234 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:36.972164 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cdbca-21e7-4d79-ab66-537ec366d234 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:36.972375 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cdbca-21e7-4d79-ab66-537ec366d234 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:36.973066 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5cdbca-21e7-4d79-ab66-537ec366d234 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:36.975237 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5cdbca-21e7-4d79-ab66-537ec366d234 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:36.980969 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1072/2128] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:36 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:36.982278 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99eb5f-7067-40bc-b096-d6f82e4e7d4d service cinder] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:36.983832 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-cb99eb5f-7067-40bc-b096-d6f82e4e7d4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:37.001869 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1057/2129] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:36 2022] POST /identity/v3/users => generated 288 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:37.003289 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449d860-bd2e-40c9-9492-ea11ea21641c None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:37.003587 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449d860-bd2e-40c9-9492-ea11ea21641c None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:37.003891 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449d860-bd2e-40c9-9492-ea11ea21641c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:37.005114 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99eb5f-7067-40bc-b096-d6f82e4e7d4d service cinder] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:37.010469 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a06aa-1222-41ba-8191-5faedd91c8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:37.011307 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a06aa-1222-41ba-8191-5faedd91c8c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:37.011630 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a06aa-1222-41ba-8191-5faedd91c8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:37.012000 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a06aa-1222-41ba-8191-5faedd91c8c2 admin admin] PATH_INFO: `/v3/projects/9aa07466fa7b4d60b7386c05060c1817/users/2f15f3fa87c54edc833d933457104c96/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:37.028466 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-b449d860-bd2e-40c9-9492-ea11ea21641c None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:37.029609 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-b449d860-bd2e-40c9-9492-ea11ea21641c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:37.034084 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a06aa-1222-41ba-8191-5faedd91c8c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aa07466fa7b4d60b7386c05060c1817, user_id=2f15f3fa87c54edc833d933457104c96, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:37.037766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a06aa-1222-41ba-8191-5faedd91c8c2 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:37.039181 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1058/2130] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:37.043718 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449d860-bd2e-40c9-9492-ea11ea21641c None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:37.056976 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449d860-bd2e-40c9-9492-ea11ea21641c None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:37.059410 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1073/2131] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:36 2022] PUT /identity/v3/projects/9aa07466fa7b4d60b7386c05060c1817/users/2f15f3fa87c54edc833d933457104c96/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:37.060800 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a06aa-1222-41ba-8191-5faedd91c8c2 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:37.127732 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7f075-f756-44eb-b233-670fd72307e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:37.128398 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7f075-f756-44eb-b233-670fd72307e9 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:37.128678 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7f075-f756-44eb-b233-670fd72307e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:37.129420 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7f075-f756-44eb-b233-670fd72307e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:37.130090 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f7f075-f756-44eb-b233-670fd72307e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:37.131740 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f7f075-f756-44eb-b233-670fd72307e9 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:37.146020 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:37.152553 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1059/2132] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:37.155588 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f1b69-ea87-4ed3-bfe9-cc7cbea63511 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:37.155962 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f1b69-ea87-4ed3-bfe9-cc7cbea63511 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:37.156315 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f1b69-ea87-4ed3-bfe9-cc7cbea63511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:37.168262 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:37.172014 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a06aa-1222-41ba-8191-5faedd91c8c2 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:37.177882 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aaf7f8-e34d-4842-8ae4-6d4e5e6ec699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:37.178529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aaf7f8-e34d-4842-8ae4-6d4e5e6ec699 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:37.178844 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aaf7f8-e34d-4842-8ae4-6d4e5e6ec699 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:37.179128 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aaf7f8-e34d-4842-8ae4-6d4e5e6ec699 admin admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:37.179801 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aaf7f8-e34d-4842-8ae4-6d4e5e6ec699 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:37.180109 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aaf7f8-e34d-4842-8ae4-6d4e5e6ec699 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:37.181862 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aaf7f8-e34d-4842-8ae4-6d4e5e6ec699 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:37.195590 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1074/2133] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:37.196469 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aaf7f8-e34d-4842-8ae4-6d4e5e6ec699 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:37.199135 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-e1aaf7f8-e34d-4842-8ae4-6d4e5e6ec699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:37.213768 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-765f1b69-ea87-4ed3-bfe9-cc7cbea63511 None None] MFA Rules not processed for user `2f15f3fa87c54edc833d933457104c96`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:37.215098 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-765f1b69-ea87-4ed3-bfe9-cc7cbea63511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:37.271150 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aaf7f8-e34d-4842-8ae4-6d4e5e6ec699 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:37.274816 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3a753-a053-4692-bf98-d3fca3706ad7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:37.275476 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3a753-a053-4692-bf98-d3fca3706ad7 service cinder] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:37.275712 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3a753-a053-4692-bf98-d3fca3706ad7 service cinder] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:37.275960 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de3a753-a053-4692-bf98-d3fca3706ad7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:37.277808 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-6de3a753-a053-4692-bf98-d3fca3706ad7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:37.299590 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1060/2134] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:37.299590 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f1b69-ea87-4ed3-bfe9-cc7cbea63511 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:37.314908 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f1b69-ea87-4ed3-bfe9-cc7cbea63511 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:37.320659 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c29ba9-f7f8-4c5c-a437-7f3aed5984f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:37.321354 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c29ba9-f7f8-4c5c-a437-7f3aed5984f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:37.321648 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c29ba9-f7f8-4c5c-a437-7f3aed5984f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:37.321920 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c29ba9-f7f8-4c5c-a437-7f3aed5984f8 admin admin] PATH_INFO: `/v3/projects/ccd8bc7bd82f4df4b696274e282f3351/users/3c6282bb237b4a94be1e3c988a9b83d2/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:37.338681 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c29ba9-f7f8-4c5c-a437-7f3aed5984f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccd8bc7bd82f4df4b696274e282f3351, user_id=3c6282bb237b4a94be1e3c988a9b83d2, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:37.343081 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c29ba9-f7f8-4c5c-a437-7f3aed5984f8 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:37.348021 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3a753-a053-4692-bf98-d3fca3706ad7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:37.349512 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de3a753-a053-4692-bf98-d3fca3706ad7 service cinder] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:37.358737 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1061/2135] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:37 2022] PUT /identity/v3/projects/ccd8bc7bd82f4df4b696274e282f3351/users/3c6282bb237b4a94be1e3c988a9b83d2/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:37.359549 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c29ba9-f7f8-4c5c-a437-7f3aed5984f8 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:37.363798 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1075/2136] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:37.364708 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3a753-a053-4692-bf98-d3fca3706ad7 service cinder] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:37.366222 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-6de3a753-a053-4692-bf98-d3fca3706ad7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:37.381860 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de3a753-a053-4692-bf98-d3fca3706ad7 service cinder] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:37.454331 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c29ba9-f7f8-4c5c-a437-7f3aed5984f8 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:37.458347 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6f5f0-5f57-4ab2-8d94-84b6b3450584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:37.458969 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6f5f0-5f57-4ab2-8d94-84b6b3450584 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:37.459251 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6f5f0-5f57-4ab2-8d94-84b6b3450584 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:37.459361 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503a9f4-06b6-429f-81d3-f72f515a22f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:37.459527 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6f5f0-5f57-4ab2-8d94-84b6b3450584 admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:37.460142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503a9f4-06b6-429f-81d3-f72f515a22f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:37.460270 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6f5f0-5f57-4ab2-8d94-84b6b3450584 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:37.460425 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503a9f4-06b6-429f-81d3-f72f515a22f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:37.460698 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503a9f4-06b6-429f-81d3-f72f515a22f4 admin admin] PATH_INFO: `/v3/projects/253bda7fec2c428396f697ff6a413a63` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:37.462141 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6f5f0-5f57-4ab2-8d94-84b6b3450584 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:37.462268 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503a9f4-06b6-429f-81d3-f72f515a22f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=253bda7fec2c428396f697ff6a413a63)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:37.464576 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503a9f4-06b6-429f-81d3-f72f515a22f4 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:37.507343 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1062/2137] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:37 2022] POST /identity/v3/projects => generated 375 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:37.508274 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6f5f0-5f57-4ab2-8d94-84b6b3450584 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:37.510926 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-3db6f5f0-5f57-4ab2-8d94-84b6b3450584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:37.539123 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:37.555672 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-8503a9f4-06b6-429f-81d3-f72f515a22f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '253bda7fec2c428396f697ff6a413a63', 'request_id': 'req-8503a9f4-06b6-429f-81d3-f72f515a22f4'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:37.563611 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-8503a9f4-06b6-429f-81d3-f72f515a22f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '253bda7fec2c428396f697ff6a413a63', 'request_id': 'req-8503a9f4-06b6-429f-81d3-f72f515a22f4'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:37.576857 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-8503a9f4-06b6-429f-81d3-f72f515a22f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '253bda7fec2c428396f697ff6a413a63', 'request_id': 'req-8503a9f4-06b6-429f-81d3-f72f515a22f4'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:37.589760 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:37.608058 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-8503a9f4-06b6-429f-81d3-f72f515a22f4 admin admin] The token cache is being invalidate because project 253bda7fec2c428396f697ff6a413a63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:37.608286 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-8503a9f4-06b6-429f-81d3-f72f515a22f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:37.609020 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-8503a9f4-06b6-429f-81d3-f72f515a22f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:37.617735 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1076/2138] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:37 2022] DELETE /identity/v3/projects/253bda7fec2c428396f697ff6a413a63 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:37.619007 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503a9f4-06b6-429f-81d3-f72f515a22f4 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:37.621014 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-8503a9f4-06b6-429f-81d3-f72f515a22f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:37.623520 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6f5f0-5f57-4ab2-8d94-84b6b3450584 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:37.689418 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46b11d-5be4-4f74-8896-edbf930bbccf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be44ea93247420d994e24912a9ac32e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:37.690265 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46b11d-5be4-4f74-8896-edbf930bbccf service glance] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:37.690529 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46b11d-5be4-4f74-8896-edbf930bbccf service glance] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:37.690910 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46b11d-5be4-4f74-8896-edbf930bbccf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:37.695301 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-6e46b11d-5be4-4f74-8896-edbf930bbccf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:37.697154 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503a9f4-06b6-429f-81d3-f72f515a22f4 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:37.702104 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad34d66-7960-491b-9628-d407f34938cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:37.702716 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad34d66-7960-491b-9628-d407f34938cf admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:37.702998 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad34d66-7960-491b-9628-d407f34938cf admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:37.703269 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad34d66-7960-491b-9628-d407f34938cf admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:37.703920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad34d66-7960-491b-9628-d407f34938cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:37.705764 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad34d66-7960-491b-9628-d407f34938cf admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:37.717539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1077/2139] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:37.717539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad34d66-7960-491b-9628-d407f34938cf admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:37.718781 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-3ad34d66-7960-491b-9628-d407f34938cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:37.732841 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad34d66-7960-491b-9628-d407f34938cf admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:37.737758 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc0780-bdda-465b-99d7-64b79b9baa7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:37.738359 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc0780-bdda-465b-99d7-64b79b9baa7b admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:37.738639 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc0780-bdda-465b-99d7-64b79b9baa7b admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:37.738908 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc0780-bdda-465b-99d7-64b79b9baa7b admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:37.739531 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc0780-bdda-465b-99d7-64b79b9baa7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:37.741509 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc0780-bdda-465b-99d7-64b79b9baa7b admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:37.759793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46b11d-5be4-4f74-8896-edbf930bbccf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:37.761290 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46b11d-5be4-4f74-8896-edbf930bbccf service glance] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:37.763583 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1078/2140] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:37 2022] POST /identity/v3/users => generated 288 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:37.764401 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc0780-bdda-465b-99d7-64b79b9baa7b admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:37.766105 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-d2cc0780-bdda-465b-99d7-64b79b9baa7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:37.773062 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1063/2141] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:37.774127 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46b11d-5be4-4f74-8896-edbf930bbccf service glance] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:37.776057 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-6e46b11d-5be4-4f74-8896-edbf930bbccf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:37.778668 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc0780-bdda-465b-99d7-64b79b9baa7b admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:37.783760 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26e04b-83e2-477a-ae9b-a416055e0f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:37.784465 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26e04b-83e2-477a-ae9b-a416055e0f75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:37.784798 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26e04b-83e2-477a-ae9b-a416055e0f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:37.785135 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26e04b-83e2-477a-ae9b-a416055e0f75 admin admin] PATH_INFO: `/v3/users/eb4bf29cfa044578afad6b421377e196` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:37.786382 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26e04b-83e2-477a-ae9b-a416055e0f75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb4bf29cfa044578afad6b421377e196)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:37.788446 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26e04b-83e2-477a-ae9b-a416055e0f75 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:37.790211 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46b11d-5be4-4f74-8896-edbf930bbccf service glance] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:37.796823 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8295264-9996-444a-b349-a6db5529b62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:37.797754 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8295264-9996-444a-b349-a6db5529b62f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:37.797754 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8295264-9996-444a-b349-a6db5529b62f admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:37.798093 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8295264-9996-444a-b349-a6db5529b62f admin admin] PATH_INFO: `/v3/users/989493ad6c05493089394c03d4d32f5d` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:37.799269 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8295264-9996-444a-b349-a6db5529b62f admin admin] RBAC: Authorizing `identity:delete_user(user_id=989493ad6c05493089394c03d4d32f5d)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:37.801203 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8295264-9996-444a-b349-a6db5529b62f admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:37.845240 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-ec26e04b-83e2-477a-ae9b-a416055e0f75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb4bf29cfa044578afad6b421377e196'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:37.846351 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-ec26e04b-83e2-477a-ae9b-a416055e0f75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb4bf29cfa044578afad6b421377e196'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:37.846987 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-ec26e04b-83e2-477a-ae9b-a416055e0f75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb4bf29cfa044578afad6b421377e196'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:37.862049 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-c8295264-9996-444a-b349-a6db5529b62f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '989493ad6c05493089394c03d4d32f5d'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:37.863178 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-c8295264-9996-444a-b349-a6db5529b62f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '989493ad6c05493089394c03d4d32f5d'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:37.863534 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-ec26e04b-83e2-477a-ae9b-a416055e0f75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb4bf29cfa044578afad6b421377e196'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:37.863905 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-c8295264-9996-444a-b349-a6db5529b62f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '989493ad6c05493089394c03d4d32f5d'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:37.872376 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-ec26e04b-83e2-477a-ae9b-a416055e0f75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb4bf29cfa044578afad6b421377e196'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:37.879115 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-c8295264-9996-444a-b349-a6db5529b62f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '989493ad6c05493089394c03d4d32f5d'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:37.887517 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1079/2142] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:37 2022] DELETE /identity/v3/users/eb4bf29cfa044578afad6b421377e196 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:37.888243 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26e04b-83e2-477a-ae9b-a416055e0f75 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:37.889657 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-ec26e04b-83e2-477a-ae9b-a416055e0f75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:37.901987 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-c8295264-9996-444a-b349-a6db5529b62f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '989493ad6c05493089394c03d4d32f5d'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:37.910579 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=81,keystone:DELETE=14,keystone:INSERT=5 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:37.929909 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1064/2143] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:37 2022] DELETE /identity/v3/users/989493ad6c05493089394c03d4d32f5d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:37.935238 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8295264-9996-444a-b349-a6db5529b62f admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:37.937883 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-c8295264-9996-444a-b349-a6db5529b62f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:37.967876 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:37.968313 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26e04b-83e2-477a-ae9b-a416055e0f75 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:38.039672 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8295264-9996-444a-b349-a6db5529b62f admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:38.044884 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e445ed44-700c-4554-9ff3-3e6532f8201c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:38.045788 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445ed44-700c-4554-9ff3-3e6532f8201c admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:38.046328 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445ed44-700c-4554-9ff3-3e6532f8201c admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:38.046868 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445ed44-700c-4554-9ff3-3e6532f8201c admin admin] PATH_INFO: `/v3/projects/ccd8bc7bd82f4df4b696274e282f3351/users/3c6282bb237b4a94be1e3c988a9b83d2/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:38.047715 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23cc11-6f68-4151-a901-2be1ac32a451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:38.049046 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23cc11-6f68-4151-a901-2be1ac32a451 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:38.049207 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23cc11-6f68-4151-a901-2be1ac32a451 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:38.049789 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23cc11-6f68-4151-a901-2be1ac32a451 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:38.050206 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23cc11-6f68-4151-a901-2be1ac32a451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:38.050796 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e445ed44-700c-4554-9ff3-3e6532f8201c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccd8bc7bd82f4df4b696274e282f3351, user_id=3c6282bb237b4a94be1e3c988a9b83d2, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:38.052129 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23cc11-6f68-4151-a901-2be1ac32a451 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:38.054720 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e445ed44-700c-4554-9ff3-3e6532f8201c admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:38.067319 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1065/2144] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:37 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:38.067319 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d70fa-f836-4fe5-a888-1ae4f522bd7c None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:38.067319 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d70fa-f836-4fe5-a888-1ae4f522bd7c None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:38.067319 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6d70fa-f836-4fe5-a888-1ae4f522bd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:38.074381 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1080/2145] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:37 2022] PUT /identity/v3/projects/ccd8bc7bd82f4df4b696274e282f3351/users/3c6282bb237b4a94be1e3c988a9b83d2/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:38.083770 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e445ed44-700c-4554-9ff3-3e6532f8201c admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:38.089916 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-5b6d70fa-f836-4fe5-a888-1ae4f522bd7c None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:38.094508 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-5b6d70fa-f836-4fe5-a888-1ae4f522bd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:38.162068 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1066/2146] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:38.163432 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48d59f-7edf-485a-ac09-fa16ed7bdfc8 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:38.163722 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48d59f-7edf-485a-ac09-fa16ed7bdfc8 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:38.164336 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48d59f-7edf-485a-ac09-fa16ed7bdfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:38.193018 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e445ed44-700c-4554-9ff3-3e6532f8201c admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:38.199197 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e51670-0859-4542-81bf-a4a976844bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:38.200135 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e51670-0859-4542-81bf-a4a976844bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:38.200664 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e51670-0859-4542-81bf-a4a976844bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:38.200892 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e51670-0859-4542-81bf-a4a976844bd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:38.201749 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e51670-0859-4542-81bf-a4a976844bd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:38.202790 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-ee48d59f-7edf-485a-ac09-fa16ed7bdfc8 None None] MFA Rules not processed for user `3c6282bb237b4a94be1e3c988a9b83d2`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:38.203774 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e51670-0859-4542-81bf-a4a976844bd0 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:38.204066 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-ee48d59f-7edf-485a-ac09-fa16ed7bdfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:38.217109 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1081/2147] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:38 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:38.218298 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e51670-0859-4542-81bf-a4a976844bd0 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:38.221048 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-e9e51670-0859-4542-81bf-a4a976844bd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:38.296584 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e51670-0859-4542-81bf-a4a976844bd0 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:38.301700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4374f9-d0cc-4e50-8a20-64842b90782e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:38.302365 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4374f9-d0cc-4e50-8a20-64842b90782e service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:38.302688 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4374f9-d0cc-4e50-8a20-64842b90782e service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:38.302958 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4374f9-d0cc-4e50-8a20-64842b90782e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:38.312767 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:38.315530 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4374f9-d0cc-4e50-8a20-64842b90782e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:38.317768 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4374f9-d0cc-4e50-8a20-64842b90782e service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:38.330938 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1067/2148] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:38 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:38.330938 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48d59f-7edf-485a-ac09-fa16ed7bdfc8 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:38.341164 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1082/2149] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:38.341992 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4374f9-d0cc-4e50-8a20-64842b90782e service neutron] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:38.343497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-4c4374f9-d0cc-4e50-8a20-64842b90782e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:38.353610 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48d59f-7edf-485a-ac09-fa16ed7bdfc8 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:38.359769 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4374f9-d0cc-4e50-8a20-64842b90782e service neutron] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:38.362696 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838abef-74c6-4a2a-ac7e-c579e3cf0d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:38.362849 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838abef-74c6-4a2a-ac7e-c579e3cf0d93 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:38.363058 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838abef-74c6-4a2a-ac7e-c579e3cf0d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:38.363340 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838abef-74c6-4a2a-ac7e-c579e3cf0d93 admin admin] PATH_INFO: `/v3/projects/ca5b72a7e0d34535a9f7a277e4ab98a6/users/65b3692786294198b84c55cca680dbcf/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:38.367332 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e019b7-e72b-4239-bd9b-9ef70b63d395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:38.368189 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e019b7-e72b-4239-bd9b-9ef70b63d395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:38.368565 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e019b7-e72b-4239-bd9b-9ef70b63d395 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:38.368933 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e019b7-e72b-4239-bd9b-9ef70b63d395 admin admin] PATH_INFO: `/v3/projects/d8ce544c38eb462fbc512534f8b95f8b` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:38.370310 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e019b7-e72b-4239-bd9b-9ef70b63d395 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8ce544c38eb462fbc512534f8b95f8b)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:38.372475 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e019b7-e72b-4239-bd9b-9ef70b63d395 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:38.383477 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838abef-74c6-4a2a-ac7e-c579e3cf0d93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca5b72a7e0d34535a9f7a277e4ab98a6, user_id=65b3692786294198b84c55cca680dbcf, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:38.386728 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838abef-74c6-4a2a-ac7e-c579e3cf0d93 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:38.406906 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1068/2150] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:38 2022] PUT /identity/v3/projects/ca5b72a7e0d34535a9f7a277e4ab98a6/users/65b3692786294198b84c55cca680dbcf/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:38.407797 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838abef-74c6-4a2a-ac7e-c579e3cf0d93 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:38.409532 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-3838abef-74c6-4a2a-ac7e-c579e3cf0d93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:38.440391 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:38.456161 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-e5e019b7-e72b-4239-bd9b-9ef70b63d395 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8ce544c38eb462fbc512534f8b95f8b', 'request_id': 'req-e5e019b7-e72b-4239-bd9b-9ef70b63d395'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:38.465702 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-e5e019b7-e72b-4239-bd9b-9ef70b63d395 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8ce544c38eb462fbc512534f8b95f8b', 'request_id': 'req-e5e019b7-e72b-4239-bd9b-9ef70b63d395'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:38.481195 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-e5e019b7-e72b-4239-bd9b-9ef70b63d395 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8ce544c38eb462fbc512534f8b95f8b', 'request_id': 'req-e5e019b7-e72b-4239-bd9b-9ef70b63d395'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:38.495542 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838abef-74c6-4a2a-ac7e-c579e3cf0d93 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:38.536280 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-e5e019b7-e72b-4239-bd9b-9ef70b63d395 admin admin] The token cache is being invalidate because project d8ce544c38eb462fbc512534f8b95f8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:38.536280 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-e5e019b7-e72b-4239-bd9b-9ef70b63d395 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:38.536280 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-e5e019b7-e72b-4239-bd9b-9ef70b63d395 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:38.536280 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1083/2151] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:38 2022] DELETE /identity/v3/projects/d8ce544c38eb462fbc512534f8b95f8b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:38.536280 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153cc11-5aa6-41d0-ac0a-0a7f333e9f0c None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:38.536740 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153cc11-5aa6-41d0-ac0a-0a7f333e9f0c None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:38.536740 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153cc11-5aa6-41d0-ac0a-0a7f333e9f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:38.562401 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-4153cc11-5aa6-41d0-ac0a-0a7f333e9f0c None None] MFA Rules not processed for user `65b3692786294198b84c55cca680dbcf`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:38.564027 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7133602-0bcb-467f-b188-210a9ae41582 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:38.564305 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-4153cc11-5aa6-41d0-ac0a-0a7f333e9f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:38.564660 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7133602-0bcb-467f-b188-210a9ae41582 service cinder] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:38.564942 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7133602-0bcb-467f-b188-210a9ae41582 service cinder] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:38.565210 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7133602-0bcb-467f-b188-210a9ae41582 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:38.567280 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-e7133602-0bcb-467f-b188-210a9ae41582 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:38.641172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7133602-0bcb-467f-b188-210a9ae41582 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:38.642911 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7133602-0bcb-467f-b188-210a9ae41582 service cinder] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:38.661191 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1069/2152] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:38.676375 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bad8a-f5b0-4274-8210-4bc56617fd75 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:38.678131 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1084/2153] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:38.678584 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bad8a-f5b0-4274-8210-4bc56617fd75 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:38.679012 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bad8a-f5b0-4274-8210-4bc56617fd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:38.713753 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-4e6bad8a-f5b0-4274-8210-4bc56617fd75 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:38.715152 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-4e6bad8a-f5b0-4274-8210-4bc56617fd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:38.719586 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153cc11-5aa6-41d0-ac0a-0a7f333e9f0c None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:38.721130 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-4153cc11-5aa6-41d0-ac0a-0a7f333e9f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:38.735090 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153cc11-5aa6-41d0-ac0a-0a7f333e9f0c None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:38.739742 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365ded2-87ed-4aa2-9bee-c550b4e6c952 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:38.740460 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365ded2-87ed-4aa2-9bee-c550b4e6c952 service cinder] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:38.740924 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365ded2-87ed-4aa2-9bee-c550b4e6c952 service cinder] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:38.741282 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365ded2-87ed-4aa2-9bee-c550b4e6c952 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:38.751661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0365ded2-87ed-4aa2-9bee-c550b4e6c952 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:38.753200 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0365ded2-87ed-4aa2-9bee-c550b4e6c952 service cinder] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:38.764110 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1085/2154] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:50:38.803512 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365ded2-87ed-4aa2-9bee-c550b4e6c952 service cinder] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:38.805073 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-0365ded2-87ed-4aa2-9bee-c550b4e6c952 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:38.817071 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1070/2155] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:38.826393 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3c060-bf78-421b-af27-66497ad36359 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:38.826947 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3c060-bf78-421b-af27-66497ad36359 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:38.827442 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3c060-bf78-421b-af27-66497ad36359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:38.875257 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-29f3c060-bf78-421b-af27-66497ad36359 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:38.877156 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-29f3c060-bf78-421b-af27-66497ad36359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:38.897230 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1071/2156] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:38.899379 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3c060-bf78-421b-af27-66497ad36359 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:38.910517 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3c060-bf78-421b-af27-66497ad36359 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:38.917763 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40038e7-6e3f-4221-947c-0725e07df4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:38.918672 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40038e7-6e3f-4221-947c-0725e07df4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:38.919017 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40038e7-6e3f-4221-947c-0725e07df4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:38.919315 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40038e7-6e3f-4221-947c-0725e07df4e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:38.920239 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40038e7-6e3f-4221-947c-0725e07df4e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:38.920598 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40038e7-6e3f-4221-947c-0725e07df4e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:38.922745 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40038e7-6e3f-4221-947c-0725e07df4e7 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:38.940984 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1072/2157] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:38.941915 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40038e7-6e3f-4221-947c-0725e07df4e7 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:38.948817 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:38.958460 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40038e7-6e3f-4221-947c-0725e07df4e7 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:38.979292 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:38.980457 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba652e2-484b-40c9-bad2-b3f4c7841b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:38.988437 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba652e2-484b-40c9-bad2-b3f4c7841b69 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:38.989588 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba652e2-484b-40c9-bad2-b3f4c7841b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:38.990002 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba652e2-484b-40c9-bad2-b3f4c7841b69 admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:38.991014 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba652e2-484b-40c9-bad2-b3f4c7841b69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:38.992583 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365ded2-87ed-4aa2-9bee-c550b4e6c952 service cinder] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:38.996463 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba652e2-484b-40c9-bad2-b3f4c7841b69 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:39.008699 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e240792-7e8f-41f1-a6aa-a0ef6f99c736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:39.009439 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e240792-7e8f-41f1-a6aa-a0ef6f99c736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:39.009733 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e240792-7e8f-41f1-a6aa-a0ef6f99c736 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:39.010011 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e240792-7e8f-41f1-a6aa-a0ef6f99c736 admin admin] PATH_INFO: `/v3/projects/2e4de3ce987e46f3a4a269d36c4ee261` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:39.011255 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e240792-7e8f-41f1-a6aa-a0ef6f99c736 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e4de3ce987e46f3a4a269d36c4ee261)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:39.013675 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e240792-7e8f-41f1-a6aa-a0ef6f99c736 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:39.066258 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1073/2158] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:38 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:39.067707 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba652e2-484b-40c9-bad2-b3f4c7841b69 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:39.115333 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-3e240792-7e8f-41f1-a6aa-a0ef6f99c736 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e4de3ce987e46f3a4a269d36c4ee261', 'request_id': 'req-3e240792-7e8f-41f1-a6aa-a0ef6f99c736'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:39.125024 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-3e240792-7e8f-41f1-a6aa-a0ef6f99c736 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e4de3ce987e46f3a4a269d36c4ee261', 'request_id': 'req-3e240792-7e8f-41f1-a6aa-a0ef6f99c736'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:39.147228 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-3e240792-7e8f-41f1-a6aa-a0ef6f99c736 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e4de3ce987e46f3a4a269d36c4ee261', 'request_id': 'req-3e240792-7e8f-41f1-a6aa-a0ef6f99c736'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:39.174816 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba652e2-484b-40c9-bad2-b3f4c7841b69 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:39.181578 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-3e240792-7e8f-41f1-a6aa-a0ef6f99c736 admin admin] The token cache is being invalidate because project 2e4de3ce987e46f3a4a269d36c4ee261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:39.181578 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-3e240792-7e8f-41f1-a6aa-a0ef6f99c736 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:39.191300 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-3e240792-7e8f-41f1-a6aa-a0ef6f99c736 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:39.194837 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1086/2159] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:38 2022] DELETE /identity/v3/projects/2e4de3ce987e46f3a4a269d36c4ee261 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:50:39.195638 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e240792-7e8f-41f1-a6aa-a0ef6f99c736 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:39.197441 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-3e240792-7e8f-41f1-a6aa-a0ef6f99c736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:39.265327 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e240792-7e8f-41f1-a6aa-a0ef6f99c736 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:39.269760 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d264b5-82ce-4c3a-926f-1e1b674c2364 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:39.270305 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c04470-fd30-4ecd-aa0c-6b350e52a448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:39.270439 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d264b5-82ce-4c3a-926f-1e1b674c2364 service cinder] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:39.270649 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d264b5-82ce-4c3a-926f-1e1b674c2364 service cinder] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:39.270921 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d264b5-82ce-4c3a-926f-1e1b674c2364 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:39.271267 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c04470-fd30-4ecd-aa0c-6b350e52a448 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:39.271847 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c04470-fd30-4ecd-aa0c-6b350e52a448 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:39.272393 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c04470-fd30-4ecd-aa0c-6b350e52a448 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:39.272786 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-81d264b5-82ce-4c3a-926f-1e1b674c2364 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:39.273370 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c04470-fd30-4ecd-aa0c-6b350e52a448 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:39.276001 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c04470-fd30-4ecd-aa0c-6b350e52a448 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:39.304053 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1074/2160] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:39 2022] POST /identity/v3/users => generated 294 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:39.304053 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c04470-fd30-4ecd-aa0c-6b350e52a448 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:39.305208 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-f3c04470-fd30-4ecd-aa0c-6b350e52a448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:39.318517 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c04470-fd30-4ecd-aa0c-6b350e52a448 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:39.323298 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc397913-f16f-4fae-a39a-71d793af7591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:39.324081 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc397913-f16f-4fae-a39a-71d793af7591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:39.324365 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc397913-f16f-4fae-a39a-71d793af7591 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:39.324711 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc397913-f16f-4fae-a39a-71d793af7591 admin admin] PATH_INFO: `/v3/users/2d1017b242cd4c09b124a18589ec130c` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:39.325941 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc397913-f16f-4fae-a39a-71d793af7591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d1017b242cd4c09b124a18589ec130c)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:39.327950 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc397913-f16f-4fae-a39a-71d793af7591 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:39.340312 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d264b5-82ce-4c3a-926f-1e1b674c2364 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:39.341830 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d264b5-82ce-4c3a-926f-1e1b674c2364 service cinder] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:39.351473 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1087/2161] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:39.352285 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d264b5-82ce-4c3a-926f-1e1b674c2364 service cinder] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:39.353662 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-81d264b5-82ce-4c3a-926f-1e1b674c2364 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:39.369683 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d264b5-82ce-4c3a-926f-1e1b674c2364 service cinder] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:39.374782 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e422afe-d807-4c6b-8d0d-4499ebc32efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:39.375396 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e422afe-d807-4c6b-8d0d-4499ebc32efd admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:39.375677 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e422afe-d807-4c6b-8d0d-4499ebc32efd admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:39.375942 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e422afe-d807-4c6b-8d0d-4499ebc32efd admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:39.377007 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e422afe-d807-4c6b-8d0d-4499ebc32efd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:39.378625 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e422afe-d807-4c6b-8d0d-4499ebc32efd admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:39.392561 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-fc397913-f16f-4fae-a39a-71d793af7591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d1017b242cd4c09b124a18589ec130c'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:39.393510 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1088/2162] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:39.395097 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e422afe-d807-4c6b-8d0d-4499ebc32efd admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:39.395239 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-fc397913-f16f-4fae-a39a-71d793af7591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d1017b242cd4c09b124a18589ec130c'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:39.397420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-9e422afe-d807-4c6b-8d0d-4499ebc32efd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:39.397576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-fc397913-f16f-4fae-a39a-71d793af7591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d1017b242cd4c09b124a18589ec130c'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:39.410702 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e422afe-d807-4c6b-8d0d-4499ebc32efd admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:39.415808 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-fc397913-f16f-4fae-a39a-71d793af7591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d1017b242cd4c09b124a18589ec130c'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:39.416019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e32089-096c-44dc-b7e1-8257258c942b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:39.416594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e32089-096c-44dc-b7e1-8257258c942b admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:39.416939 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e32089-096c-44dc-b7e1-8257258c942b admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:39.417180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e32089-096c-44dc-b7e1-8257258c942b admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:39.417824 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e32089-096c-44dc-b7e1-8257258c942b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:39.419601 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e32089-096c-44dc-b7e1-8257258c942b admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:39.427367 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-fc397913-f16f-4fae-a39a-71d793af7591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d1017b242cd4c09b124a18589ec130c'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:39.429976 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:39.435351 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1089/2163] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:50:39.436848 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e32089-096c-44dc-b7e1-8257258c942b admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:39.450234 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e32089-096c-44dc-b7e1-8257258c942b admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:39.453571 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1075/2164] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:39 2022] DELETE /identity/v3/users/2d1017b242cd4c09b124a18589ec130c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:39.459730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916f1a5-69d2-4633-9514-bb667f91debe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:39.460501 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916f1a5-69d2-4633-9514-bb667f91debe admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:39.460756 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916f1a5-69d2-4633-9514-bb667f91debe admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:39.461031 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916f1a5-69d2-4633-9514-bb667f91debe admin admin] PATH_INFO: `/v3/projects/cbf8635d10c34379859cdc32d53c7afc/users/a7b251ce7419424c93ec49c83c3ed1ea/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:39.483132 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916f1a5-69d2-4633-9514-bb667f91debe admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf8635d10c34379859cdc32d53c7afc, user_id=a7b251ce7419424c93ec49c83c3ed1ea, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:39.485966 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916f1a5-69d2-4633-9514-bb667f91debe admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:39.488899 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:39.520830 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1090/2165] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:39 2022] PUT /identity/v3/projects/cbf8635d10c34379859cdc32d53c7afc/users/a7b251ce7419424c93ec49c83c3ed1ea/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:39.522468 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f0bdb-d8ef-4bf8-b50e-9dd1187aefa6 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:39.522765 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f0bdb-d8ef-4bf8-b50e-9dd1187aefa6 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:39.523070 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f0bdb-d8ef-4bf8-b50e-9dd1187aefa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:39.572320 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-922f0bdb-d8ef-4bf8-b50e-9dd1187aefa6 None None] MFA Rules not processed for user `a7b251ce7419424c93ec49c83c3ed1ea`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:39.573609 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-922f0bdb-d8ef-4bf8-b50e-9dd1187aefa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:39.646276 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1076/2166] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:39.651027 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916f1a5-69d2-4633-9514-bb667f91debe admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:39.731959 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916f1a5-69d2-4633-9514-bb667f91debe admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:39.736882 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca0d93-da0b-4b89-933e-45ec2d99c679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:39.737636 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca0d93-da0b-4b89-933e-45ec2d99c679 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:39.737953 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca0d93-da0b-4b89-933e-45ec2d99c679 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:39.738270 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca0d93-da0b-4b89-933e-45ec2d99c679 admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:39.739278 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca0d93-da0b-4b89-933e-45ec2d99c679 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:39.741361 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca0d93-da0b-4b89-933e-45ec2d99c679 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:39.778203 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1091/2167] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:39 2022] POST /identity/v3/projects => generated 387 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:39.779968 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f0bdb-d8ef-4bf8-b50e-9dd1187aefa6 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:39.790806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f0bdb-d8ef-4bf8-b50e-9dd1187aefa6 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:39.831206 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca0d93-da0b-4b89-933e-45ec2d99c679 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:39.833258 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-91ca0d93-da0b-4b89-933e-45ec2d99c679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:39.854148 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d42f4-c341-4137-b4d5-65262530a283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:39.855589 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d42f4-c341-4137-b4d5-65262530a283 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:39.855993 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d42f4-c341-4137-b4d5-65262530a283 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:39.856299 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d42f4-c341-4137-b4d5-65262530a283 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:39.857573 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d42f4-c341-4137-b4d5-65262530a283 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:39.860340 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d42f4-c341-4137-b4d5-65262530a283 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:39.887105 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1077/2168] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:39 2022] POST /identity/v3/users => generated 300 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:39.889025 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d42f4-c341-4137-b4d5-65262530a283 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:39.898952 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d42f4-c341-4137-b4d5-65262530a283 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:39.903574 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407be2da-0858-45d7-bba6-d389235f7a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:39.904165 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407be2da-0858-45d7-bba6-d389235f7a68 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:39.904549 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407be2da-0858-45d7-bba6-d389235f7a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:39.904824 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407be2da-0858-45d7-bba6-d389235f7a68 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:39.905490 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407be2da-0858-45d7-bba6-d389235f7a68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:39.905961 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca0d93-da0b-4b89-933e-45ec2d99c679 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:39.907130 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407be2da-0858-45d7-bba6-d389235f7a68 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:39.910766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613fb1cc-2fe2-43db-ba08-b9d685b7b5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:39.911461 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fb1cc-2fe2-43db-ba08-b9d685b7b5cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:39.911805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fb1cc-2fe2-43db-ba08-b9d685b7b5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:39.912084 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fb1cc-2fe2-43db-ba08-b9d685b7b5cc admin admin] PATH_INFO: `/v3/projects/7b1d273d0f8a4ddd88a24fb6ef808ca3` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:39.913201 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613fb1cc-2fe2-43db-ba08-b9d685b7b5cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b1d273d0f8a4ddd88a24fb6ef808ca3)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:39.915450 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613fb1cc-2fe2-43db-ba08-b9d685b7b5cc admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:39.917582 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1078/2169] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:50:39.922227 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407be2da-0858-45d7-bba6-d389235f7a68 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:39.933496 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407be2da-0858-45d7-bba6-d389235f7a68 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:39.938176 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daee1d5-12ea-4c2b-90ff-48061f2c091e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:39.938918 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daee1d5-12ea-4c2b-90ff-48061f2c091e admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:39.939199 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daee1d5-12ea-4c2b-90ff-48061f2c091e admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:39.939473 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daee1d5-12ea-4c2b-90ff-48061f2c091e admin admin] PATH_INFO: `/v3/projects/7e4911ee62204e04aa76396b5dafef7f/users/2de15825344644c3bc0cf072ecb0bcec/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:39.955709 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daee1d5-12ea-4c2b-90ff-48061f2c091e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e4911ee62204e04aa76396b5dafef7f, user_id=2de15825344644c3bc0cf072ecb0bcec, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:39.958417 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daee1d5-12ea-4c2b-90ff-48061f2c091e admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:39.963990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-613fb1cc-2fe2-43db-ba08-b9d685b7b5cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b1d273d0f8a4ddd88a24fb6ef808ca3', 'request_id': 'req-613fb1cc-2fe2-43db-ba08-b9d685b7b5cc'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:39.970502 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-613fb1cc-2fe2-43db-ba08-b9d685b7b5cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b1d273d0f8a4ddd88a24fb6ef808ca3', 'request_id': 'req-613fb1cc-2fe2-43db-ba08-b9d685b7b5cc'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:39.972830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1079/2170] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:39 2022] PUT /identity/v3/projects/7e4911ee62204e04aa76396b5dafef7f/users/2de15825344644c3bc0cf072ecb0bcec/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:39.976968 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daee1d5-12ea-4c2b-90ff-48061f2c091e admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:39.978880 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-613fb1cc-2fe2-43db-ba08-b9d685b7b5cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b1d273d0f8a4ddd88a24fb6ef808ca3', 'request_id': 'req-613fb1cc-2fe2-43db-ba08-b9d685b7b5cc'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:39.992716 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-613fb1cc-2fe2-43db-ba08-b9d685b7b5cc admin admin] The token cache is being invalidate because project 7b1d273d0f8a4ddd88a24fb6ef808ca3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:39.993391 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-613fb1cc-2fe2-43db-ba08-b9d685b7b5cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:39.993610 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-613fb1cc-2fe2-43db-ba08-b9d685b7b5cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:39.995139 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1092/2171] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:39 2022] DELETE /identity/v3/projects/7b1d273d0f8a4ddd88a24fb6ef808ca3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:50:39.999745 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa2f17-36fc-467b-a772-94cd46e29767 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:40.000023 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa2f17-36fc-467b-a772-94cd46e29767 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:40.000289 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa2f17-36fc-467b-a772-94cd46e29767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:40.016437 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:40.021184 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-0caa2f17-36fc-467b-a772-94cd46e29767 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:40.022501 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-0caa2f17-36fc-467b-a772-94cd46e29767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:40.027530 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:40.046693 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daee1d5-12ea-4c2b-90ff-48061f2c091e admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:40.051493 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad2057-0558-4871-b3a2-acaca321e3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:40.052102 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad2057-0558-4871-b3a2-acaca321e3dd admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:40.052380 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad2057-0558-4871-b3a2-acaca321e3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:40.052653 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad2057-0558-4871-b3a2-acaca321e3dd admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:40.053291 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad2057-0558-4871-b3a2-acaca321e3dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:40.055154 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ad2057-0558-4871-b3a2-acaca321e3dd admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:40.065620 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1080/2172] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:50:40.069904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad2057-0558-4871-b3a2-acaca321e3dd admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:40.071583 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-03ad2057-0558-4871-b3a2-acaca321e3dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:40.083944 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad2057-0558-4871-b3a2-acaca321e3dd admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:40.086035 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1093/2173] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:50:40.088921 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b43839-876c-44bc-bdda-3ec525e0df55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:40.089605 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b43839-876c-44bc-bdda-3ec525e0df55 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:40.089885 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b43839-876c-44bc-bdda-3ec525e0df55 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:40.090157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b43839-876c-44bc-bdda-3ec525e0df55 admin admin] PATH_INFO: `/v3/projects/7e4911ee62204e04aa76396b5dafef7f/users/2de15825344644c3bc0cf072ecb0bcec/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:40.092193 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b43839-876c-44bc-bdda-3ec525e0df55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e4911ee62204e04aa76396b5dafef7f, user_id=2de15825344644c3bc0cf072ecb0bcec, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:40.094314 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb4f2d-f05c-4174-b185-ea2230f957cb None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:40.094665 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb4f2d-f05c-4174-b185-ea2230f957cb None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:40.094903 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b43839-876c-44bc-bdda-3ec525e0df55 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:40.095109 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb4f2d-f05c-4174-b185-ea2230f957cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:40.105667 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1081/2174] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:40 2022] PUT /identity/v3/projects/7e4911ee62204e04aa76396b5dafef7f/users/2de15825344644c3bc0cf072ecb0bcec/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:40.117935 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65576498-573d-4938-a261-fb78e3bb928b None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:40.118159 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65576498-573d-4938-a261-fb78e3bb928b None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:40.118474 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65576498-573d-4938-a261-fb78e3bb928b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:40.119748 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-1ddb4f2d-f05c-4174-b185-ea2230f957cb None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:40.121077 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-1ddb4f2d-f05c-4174-b185-ea2230f957cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:40.153821 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-65576498-573d-4938-a261-fb78e3bb928b None None] MFA Rules not processed for user `2de15825344644c3bc0cf072ecb0bcec`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:40.155007 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-65576498-573d-4938-a261-fb78e3bb928b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:40.202571 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1094/2175] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:40.206913 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb4f2d-f05c-4174-b185-ea2230f957cb None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:40.219521 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb4f2d-f05c-4174-b185-ea2230f957cb None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:40.221785 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92b954-8971-42c6-bb95-b5ff227051c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:40.222373 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92b954-8971-42c6-bb95-b5ff227051c5 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:40.222663 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92b954-8971-42c6-bb95-b5ff227051c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:40.222915 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92b954-8971-42c6-bb95-b5ff227051c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:40.223570 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b92b954-8971-42c6-bb95-b5ff227051c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:40.223859 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b92b954-8971-42c6-bb95-b5ff227051c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:40.225536 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b92b954-8971-42c6-bb95-b5ff227051c5 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:40.236391 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1082/2176] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:40 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:50:40.241379 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1095/2177] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:40.244047 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65576498-573d-4938-a261-fb78e3bb928b None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:40.252584 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92b954-8971-42c6-bb95-b5ff227051c5 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:40.254616 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-6b92b954-8971-42c6-bb95-b5ff227051c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:40.256900 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65576498-573d-4938-a261-fb78e3bb928b None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:40.261784 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c6fd1-fa5c-498e-b33b-65ba934d1e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:40.262420 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c6fd1-fa5c-498e-b33b-65ba934d1e59 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:40.262703 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c6fd1-fa5c-498e-b33b-65ba934d1e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:40.262975 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c6fd1-fa5c-498e-b33b-65ba934d1e59 admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:40.263609 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c6fd1-fa5c-498e-b33b-65ba934d1e59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:40.265567 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c6fd1-fa5c-498e-b33b-65ba934d1e59 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:40.307738 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1083/2178] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:40 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:40.312747 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c6fd1-fa5c-498e-b33b-65ba934d1e59 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:40.336241 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92b954-8971-42c6-bb95-b5ff227051c5 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:40.395036 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b34566-e4b1-433c-886d-5ad7ecf50020 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:40.395942 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b34566-e4b1-433c-886d-5ad7ecf50020 service cinder] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:40.397003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b34566-e4b1-433c-886d-5ad7ecf50020 service cinder] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:40.397003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b34566-e4b1-433c-886d-5ad7ecf50020 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:40.400608 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c6fd1-fa5c-498e-b33b-65ba934d1e59 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:40.403554 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:40.405775 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03571c0a-ff74-48a4-8d9e-207e6940b927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:40.406705 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03571c0a-ff74-48a4-8d9e-207e6940b927 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:40.407015 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03571c0a-ff74-48a4-8d9e-207e6940b927 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:40.407460 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03571c0a-ff74-48a4-8d9e-207e6940b927 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:40.408325 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03571c0a-ff74-48a4-8d9e-207e6940b927 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:40.410315 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03571c0a-ff74-48a4-8d9e-207e6940b927 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:40.435201 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1084/2179] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:40 2022] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:40.441270 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03571c0a-ff74-48a4-8d9e-207e6940b927 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:40.452066 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03571c0a-ff74-48a4-8d9e-207e6940b927 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:40.458035 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e7aea-0f00-4f2e-8632-1ba6cd6f8184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:40.458651 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e7aea-0f00-4f2e-8632-1ba6cd6f8184 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:40.459071 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e7aea-0f00-4f2e-8632-1ba6cd6f8184 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:40.459416 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338e7aea-0f00-4f2e-8632-1ba6cd6f8184 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:40.460196 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338e7aea-0f00-4f2e-8632-1ba6cd6f8184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:40.462468 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338e7aea-0f00-4f2e-8632-1ba6cd6f8184 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:40.466137 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:40.476669 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1085/2180] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:40.480304 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e7aea-0f00-4f2e-8632-1ba6cd6f8184 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:40.482695 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b34566-e4b1-433c-886d-5ad7ecf50020 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:40.484443 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b34566-e4b1-433c-886d-5ad7ecf50020 service cinder] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:40.493688 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338e7aea-0f00-4f2e-8632-1ba6cd6f8184 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:40.495254 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1096/2181] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:40 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:40.501013 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa7d666-16f4-4d42-8f84-7490c1f8c3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:40.502007 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7d666-16f4-4d42-8f84-7490c1f8c3be admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:40.502290 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7d666-16f4-4d42-8f84-7490c1f8c3be admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:40.502756 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7d666-16f4-4d42-8f84-7490c1f8c3be admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:40.503458 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa7d666-16f4-4d42-8f84-7490c1f8c3be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:40.505313 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa7d666-16f4-4d42-8f84-7490c1f8c3be admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:40.517999 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1086/2182] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:40.522162 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b34566-e4b1-433c-886d-5ad7ecf50020 service cinder] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:40.535880 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b34566-e4b1-433c-886d-5ad7ecf50020 service cinder] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:40.541817 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6cbee9-54a6-498b-a12d-718ffaecbee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:40.542624 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cbee9-54a6-498b-a12d-718ffaecbee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:40.544695 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cbee9-54a6-498b-a12d-718ffaecbee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:40.544695 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cbee9-54a6-498b-a12d-718ffaecbee0 admin admin] PATH_INFO: `/v3/projects/2772cc9d06a54742910f38532782de17/users/40bfccde5f2a447d8fdf8cc1d4c7ffbc/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:40.588011 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6cbee9-54a6-498b-a12d-718ffaecbee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2772cc9d06a54742910f38532782de17, user_id=40bfccde5f2a447d8fdf8cc1d4c7ffbc, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:40.594303 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6cbee9-54a6-498b-a12d-718ffaecbee0 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:40.613120 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1097/2183] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:40 2022] PUT /identity/v3/projects/2772cc9d06a54742910f38532782de17/users/40bfccde5f2a447d8fdf8cc1d4c7ffbc/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:50:40.624506 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2574be0-bdc9-4b2a-acb5-76e065223443 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:40.624915 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2574be0-bdc9-4b2a-acb5-76e065223443 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:40.625203 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2574be0-bdc9-4b2a-acb5-76e065223443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:40.668321 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-f2574be0-bdc9-4b2a-acb5-76e065223443 None None] MFA Rules not processed for user `40bfccde5f2a447d8fdf8cc1d4c7ffbc`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:40.669619 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-f2574be0-bdc9-4b2a-acb5-76e065223443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:40.746810 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1087/2184] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:40.754765 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6cbee9-54a6-498b-a12d-718ffaecbee0 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:40.843294 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6cbee9-54a6-498b-a12d-718ffaecbee0 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:40.851175 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e5ccd-f888-409b-a189-30c22079eaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:40.851812 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e5ccd-f888-409b-a189-30c22079eaf7 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:40.852089 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e5ccd-f888-409b-a189-30c22079eaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:40.852396 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e5ccd-f888-409b-a189-30c22079eaf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:40.853044 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e5ccd-f888-409b-a189-30c22079eaf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:40.855105 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e5ccd-f888-409b-a189-30c22079eaf7 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:40.901777 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1098/2185] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:40 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:40.906077 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2574be0-bdc9-4b2a-acb5-76e065223443 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:40.924049 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2574be0-bdc9-4b2a-acb5-76e065223443 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:41.006648 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d49bbd-fede-4738-8a6a-62dbbd00d397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:41.007352 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d49bbd-fede-4738-8a6a-62dbbd00d397 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:41.007741 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d49bbd-fede-4738-8a6a-62dbbd00d397 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:41.008185 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d49bbd-fede-4738-8a6a-62dbbd00d397 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:41.009011 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d49bbd-fede-4738-8a6a-62dbbd00d397 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:41.014885 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d49bbd-fede-4738-8a6a-62dbbd00d397 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:41.043706 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1088/2186] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:40 2022] POST /identity/v3/users => generated 299 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:50:41.044980 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e5ccd-f888-409b-a189-30c22079eaf7 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:41.062794 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e5ccd-f888-409b-a189-30c22079eaf7 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:41.067811 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5453313c-a448-47ff-b47a-d9cebd2c3fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:41.068524 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453313c-a448-47ff-b47a-d9cebd2c3fba admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:41.068899 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453313c-a448-47ff-b47a-d9cebd2c3fba admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:41.069283 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453313c-a448-47ff-b47a-d9cebd2c3fba admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:41.070072 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5453313c-a448-47ff-b47a-d9cebd2c3fba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:41.071895 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5453313c-a448-47ff-b47a-d9cebd2c3fba admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:41.086651 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1099/2187] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:41.089140 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d49bbd-fede-4738-8a6a-62dbbd00d397 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:41.099982 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d49bbd-fede-4738-8a6a-62dbbd00d397 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:41.104679 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74b2c2-6458-4cfd-b8f8-c4076639043e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:41.105314 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74b2c2-6458-4cfd-b8f8-c4076639043e admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:41.105619 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74b2c2-6458-4cfd-b8f8-c4076639043e admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:41.105889 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74b2c2-6458-4cfd-b8f8-c4076639043e admin admin] PATH_INFO: `/v3/projects/824539686f45410bb097c6c1aca5ecc0/users/f868e514695c4b3480ea49cac7b88ca1/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:41.121319 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd74b2c2-6458-4cfd-b8f8-c4076639043e admin admin] RBAC: Authorizing `identity:create_grant(project_id=824539686f45410bb097c6c1aca5ecc0, user_id=f868e514695c4b3480ea49cac7b88ca1, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:41.124825 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd74b2c2-6458-4cfd-b8f8-c4076639043e admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:41.142390 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1089/2188] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:41 2022] PUT /identity/v3/projects/824539686f45410bb097c6c1aca5ecc0/users/f868e514695c4b3480ea49cac7b88ca1/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:41.146332 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5453313c-a448-47ff-b47a-d9cebd2c3fba admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:41.166393 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5453313c-a448-47ff-b47a-d9cebd2c3fba admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:41.238184 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:41.249705 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a800e15-41c8-4e16-ab07-addfecbbdcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:41.249705 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a800e15-41c8-4e16-ab07-addfecbbdcc0 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:41.249705 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a800e15-41c8-4e16-ab07-addfecbbdcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:41.250021 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a800e15-41c8-4e16-ab07-addfecbbdcc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:41.251086 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a800e15-41c8-4e16-ab07-addfecbbdcc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:41.252427 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a800e15-41c8-4e16-ab07-addfecbbdcc0 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:41.265374 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1100/2189] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:50:41.268237 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74b2c2-6458-4cfd-b8f8-c4076639043e admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:41.279266 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74b2c2-6458-4cfd-b8f8-c4076639043e admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:41.284448 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a792a62-8c7f-431d-ae58-3cbb5be83b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:41.285241 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a792a62-8c7f-431d-ae58-3cbb5be83b02 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:41.285622 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a792a62-8c7f-431d-ae58-3cbb5be83b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:41.285900 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a792a62-8c7f-431d-ae58-3cbb5be83b02 admin admin] PATH_INFO: `/v3/projects/824539686f45410bb097c6c1aca5ecc0/users/f868e514695c4b3480ea49cac7b88ca1/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:41.289993 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a792a62-8c7f-431d-ae58-3cbb5be83b02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=824539686f45410bb097c6c1aca5ecc0, user_id=f868e514695c4b3480ea49cac7b88ca1, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:41.293489 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a792a62-8c7f-431d-ae58-3cbb5be83b02 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:41.308093 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1090/2190] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:41 2022] PUT /identity/v3/projects/824539686f45410bb097c6c1aca5ecc0/users/f868e514695c4b3480ea49cac7b88ca1/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:41.309835 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a800e15-41c8-4e16-ab07-addfecbbdcc0 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:41.318494 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87ecad-8f94-4398-9430-c6e717224bd0 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:41.318778 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87ecad-8f94-4398-9430-c6e717224bd0 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:41.319048 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87ecad-8f94-4398-9430-c6e717224bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:41.320226 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a800e15-41c8-4e16-ab07-addfecbbdcc0 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:41.349751 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-db87ecad-8f94-4398-9430-c6e717224bd0 None None] MFA Rules not processed for user `f868e514695c4b3480ea49cac7b88ca1`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:41.351006 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-db87ecad-8f94-4398-9430-c6e717224bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:41.368421 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:41.381658 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4873674-640c-446b-82db-15577c9175d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:41.382294 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4873674-640c-446b-82db-15577c9175d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:41.382571 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4873674-640c-446b-82db-15577c9175d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:41.382852 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4873674-640c-446b-82db-15577c9175d2 admin admin] PATH_INFO: `/v3/users/a7b251ce7419424c93ec49c83c3ed1ea` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:41.384013 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4873674-640c-446b-82db-15577c9175d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7b251ce7419424c93ec49c83c3ed1ea)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:41.386015 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4873674-640c-446b-82db-15577c9175d2 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:41.426054 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1091/2191] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:41 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:50:41.436453 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-a4873674-640c-446b-82db-15577c9175d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7b251ce7419424c93ec49c83c3ed1ea'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:41.437143 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-a4873674-640c-446b-82db-15577c9175d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7b251ce7419424c93ec49c83c3ed1ea'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:41.437816 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-a4873674-640c-446b-82db-15577c9175d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7b251ce7419424c93ec49c83c3ed1ea'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:41.438474 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87ecad-8f94-4398-9430-c6e717224bd0 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:41.453703 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-a4873674-640c-446b-82db-15577c9175d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7b251ce7419424c93ec49c83c3ed1ea'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:41.462896 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-a4873674-640c-446b-82db-15577c9175d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7b251ce7419424c93ec49c83c3ed1ea'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:41.475456 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1101/2192] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:41 2022] DELETE /identity/v3/users/a7b251ce7419424c93ec49c83c3ed1ea => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:50:41.479989 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bb362-b018-44fb-9e95-8e37f4289502 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:41.480391 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bb362-b018-44fb-9e95-8e37f4289502 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:41.480803 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bb362-b018-44fb-9e95-8e37f4289502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:41.500592 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87ecad-8f94-4398-9430-c6e717224bd0 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:41.503076 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-8e7bb362-b018-44fb-9e95-8e37f4289502 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:41.504233 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-8e7bb362-b018-44fb-9e95-8e37f4289502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:41.553621 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a28a49-6d9f-4264-8457-bd47f24fe4f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:41.554244 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a28a49-6d9f-4264-8457-bd47f24fe4f2 service cinder] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:41.554519 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a28a49-6d9f-4264-8457-bd47f24fe4f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:41.554784 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a28a49-6d9f-4264-8457-bd47f24fe4f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:41.556648 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-56a28a49-6d9f-4264-8457-bd47f24fe4f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:41.566478 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1102/2193] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:50:41.576330 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bb362-b018-44fb-9e95-8e37f4289502 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:41.577933 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-8e7bb362-b018-44fb-9e95-8e37f4289502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:41.590439 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:41.642509 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a28a49-6d9f-4264-8457-bd47f24fe4f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:41.643998 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a28a49-6d9f-4264-8457-bd47f24fe4f2 service cinder] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:41.650736 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bb362-b018-44fb-9e95-8e37f4289502 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:41.654526 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba820239-0e86-474f-91bc-c868b621e5c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:41.655204 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba820239-0e86-474f-91bc-c868b621e5c1 service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:41.655579 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba820239-0e86-474f-91bc-c868b621e5c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:41.655835 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba820239-0e86-474f-91bc-c868b621e5c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:41.656564 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1092/2194] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:50:41.669310 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba820239-0e86-474f-91bc-c868b621e5c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:41.670922 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba820239-0e86-474f-91bc-c868b621e5c1 service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:41.683008 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1103/2195] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:50:42.026445 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a28a49-6d9f-4264-8457-bd47f24fe4f2 service cinder] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:42.030510 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-56a28a49-6d9f-4264-8457-bd47f24fe4f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:42.053157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a28a49-6d9f-4264-8457-bd47f24fe4f2 service cinder] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:42.068389 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ba539-84d1-4874-ac8d-f4c96d3006bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:42.069142 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ba539-84d1-4874-ac8d-f4c96d3006bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:42.069544 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ba539-84d1-4874-ac8d-f4c96d3006bd admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:42.071239 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ba539-84d1-4874-ac8d-f4c96d3006bd admin admin] PATH_INFO: `/v3/projects/cbf8635d10c34379859cdc32d53c7afc` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:42.072926 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ba539-84d1-4874-ac8d-f4c96d3006bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbf8635d10c34379859cdc32d53c7afc)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:42.074955 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ba539-84d1-4874-ac8d-f4c96d3006bd admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:42.123082 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:42.163805 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-ef0ba539-84d1-4874-ac8d-f4c96d3006bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbf8635d10c34379859cdc32d53c7afc', 'request_id': 'req-ef0ba539-84d1-4874-ac8d-f4c96d3006bd'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:42.191456 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-ef0ba539-84d1-4874-ac8d-f4c96d3006bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbf8635d10c34379859cdc32d53c7afc', 'request_id': 'req-ef0ba539-84d1-4874-ac8d-f4c96d3006bd'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:42.198988 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-ef0ba539-84d1-4874-ac8d-f4c96d3006bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbf8635d10c34379859cdc32d53c7afc', 'request_id': 'req-ef0ba539-84d1-4874-ac8d-f4c96d3006bd'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:42.212629 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-ef0ba539-84d1-4874-ac8d-f4c96d3006bd admin admin] The token cache is being invalidate because project cbf8635d10c34379859cdc32d53c7afc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:42.213008 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-ef0ba539-84d1-4874-ac8d-f4c96d3006bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:42.213729 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-ef0ba539-84d1-4874-ac8d-f4c96d3006bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:42.217385 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1093/2196] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:42 2022] DELETE /identity/v3/projects/cbf8635d10c34379859cdc32d53c7afc => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:42.219405 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba820239-0e86-474f-91bc-c868b621e5c1 service neutron] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:42.232421 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba820239-0e86-474f-91bc-c868b621e5c1 service neutron] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:42.301647 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4fa7a1-4ca9-4624-8b81-d526bb0c61ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:42.302355 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fa7a1-4ca9-4624-8b81-d526bb0c61ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:42.302653 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fa7a1-4ca9-4624-8b81-d526bb0c61ee admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:42.302922 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fa7a1-4ca9-4624-8b81-d526bb0c61ee admin admin] PATH_INFO: `/v3/users/2de15825344644c3bc0cf072ecb0bcec` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:42.304257 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4fa7a1-4ca9-4624-8b81-d526bb0c61ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=2de15825344644c3bc0cf072ecb0bcec)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:42.306258 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4fa7a1-4ca9-4624-8b81-d526bb0c61ee admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:42.364653 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-dd4fa7a1-4ca9-4624-8b81-d526bb0c61ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2de15825344644c3bc0cf072ecb0bcec'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:42.365296 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-dd4fa7a1-4ca9-4624-8b81-d526bb0c61ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2de15825344644c3bc0cf072ecb0bcec'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:42.365915 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-dd4fa7a1-4ca9-4624-8b81-d526bb0c61ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2de15825344644c3bc0cf072ecb0bcec'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:42.379668 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-dd4fa7a1-4ca9-4624-8b81-d526bb0c61ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2de15825344644c3bc0cf072ecb0bcec'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:42.395514 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-dd4fa7a1-4ca9-4624-8b81-d526bb0c61ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2de15825344644c3bc0cf072ecb0bcec'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:42.403978 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ba539-84d1-4874-ac8d-f4c96d3006bd admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:42.405600 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-ef0ba539-84d1-4874-ac8d-f4c96d3006bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:42.412982 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1104/2197] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:42 2022] DELETE /identity/v3/users/2de15825344644c3bc0cf072ecb0bcec => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:42.419327 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ba539-84d1-4874-ac8d-f4c96d3006bd admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:42.484217 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd2304-4e07-43c2-8dbc-1bcae910c3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:42.484995 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd2304-4e07-43c2-8dbc-1bcae910c3cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:42.485270 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd2304-4e07-43c2-8dbc-1bcae910c3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:42.485572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd2304-4e07-43c2-8dbc-1bcae910c3cc admin admin] PATH_INFO: `/v3/users/2c4cfefbc06641818ba7e6e019a16a61` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:42.486778 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd2304-4e07-43c2-8dbc-1bcae910c3cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c4cfefbc06641818ba7e6e019a16a61)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:42.488966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd2304-4e07-43c2-8dbc-1bcae910c3cc admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:42.539801 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-48fd2304-4e07-43c2-8dbc-1bcae910c3cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c4cfefbc06641818ba7e6e019a16a61'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:42.540467 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-48fd2304-4e07-43c2-8dbc-1bcae910c3cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c4cfefbc06641818ba7e6e019a16a61'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:42.541091 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-48fd2304-4e07-43c2-8dbc-1bcae910c3cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c4cfefbc06641818ba7e6e019a16a61'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:42.553402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-48fd2304-4e07-43c2-8dbc-1bcae910c3cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c4cfefbc06641818ba7e6e019a16a61'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:42.565394 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-48fd2304-4e07-43c2-8dbc-1bcae910c3cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c4cfefbc06641818ba7e6e019a16a61'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:42.580141 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1094/2198] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:42 2022] DELETE /identity/v3/users/2c4cfefbc06641818ba7e6e019a16a61 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:50:42.584717 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8a112-c738-4701-ac23-8921a49692b9 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:42.585005 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8a112-c738-4701-ac23-8921a49692b9 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:42.585278 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8a112-c738-4701-ac23-8921a49692b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:42.606462 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-5ba8a112-c738-4701-ac23-8921a49692b9 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:42.607651 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-5ba8a112-c738-4701-ac23-8921a49692b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:42.636222 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:42.672942 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1105/2199] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:42.685614 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd2304-4e07-43c2-8dbc-1bcae910c3cc admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:42.687150 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-48fd2304-4e07-43c2-8dbc-1bcae910c3cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:42.699468 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8a112-c738-4701-ac23-8921a49692b9 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:42.701124 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-5ba8a112-c738-4701-ac23-8921a49692b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:42.716234 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8a112-c738-4701-ac23-8921a49692b9 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:42.721131 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:42.728624 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc9ee48-6ff3-4b67-bd37-ae13ec51c480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:42.729425 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9ee48-6ff3-4b67-bd37-ae13ec51c480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:42.729691 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9ee48-6ff3-4b67-bd37-ae13ec51c480 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:42.729978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc9ee48-6ff3-4b67-bd37-ae13ec51c480 admin admin] PATH_INFO: `/v3/projects/7e4911ee62204e04aa76396b5dafef7f` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:42.731171 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc9ee48-6ff3-4b67-bd37-ae13ec51c480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e4911ee62204e04aa76396b5dafef7f)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:42.733233 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc9ee48-6ff3-4b67-bd37-ae13ec51c480 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:42.753814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd2304-4e07-43c2-8dbc-1bcae910c3cc admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:42.757450 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fbc61e-afc7-49c8-9c85-6a36a39adb8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:42.758065 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbc61e-afc7-49c8-9c85-6a36a39adb8e service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:42.758344 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbc61e-afc7-49c8-9c85-6a36a39adb8e service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:42.758615 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbc61e-afc7-49c8-9c85-6a36a39adb8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:42.768821 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fbc61e-afc7-49c8-9c85-6a36a39adb8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:42.770535 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fbc61e-afc7-49c8-9c85-6a36a39adb8e service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:42.781503 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1095/2200] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:50:42.795621 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-4dc9ee48-6ff3-4b67-bd37-ae13ec51c480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e4911ee62204e04aa76396b5dafef7f', 'request_id': 'req-4dc9ee48-6ff3-4b67-bd37-ae13ec51c480'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:42.802724 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-4dc9ee48-6ff3-4b67-bd37-ae13ec51c480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e4911ee62204e04aa76396b5dafef7f', 'request_id': 'req-4dc9ee48-6ff3-4b67-bd37-ae13ec51c480'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:42.810930 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-4dc9ee48-6ff3-4b67-bd37-ae13ec51c480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e4911ee62204e04aa76396b5dafef7f', 'request_id': 'req-4dc9ee48-6ff3-4b67-bd37-ae13ec51c480'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:42.822172 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-4dc9ee48-6ff3-4b67-bd37-ae13ec51c480 admin admin] The token cache is being invalidate because project 7e4911ee62204e04aa76396b5dafef7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:42.822465 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-4dc9ee48-6ff3-4b67-bd37-ae13ec51c480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:42.825320 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-4dc9ee48-6ff3-4b67-bd37-ae13ec51c480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:42.827228 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1106/2201] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:42 2022] DELETE /identity/v3/projects/7e4911ee62204e04aa76396b5dafef7f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:50:42.832444 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a828d-d190-4217-8932-d0e3703c7d84 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:42.832723 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a828d-d190-4217-8932-d0e3703c7d84 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:42.832976 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a828d-d190-4217-8932-d0e3703c7d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:42.856640 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-b93a828d-d190-4217-8932-d0e3703c7d84 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:42.858050 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-b93a828d-d190-4217-8932-d0e3703c7d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:42.938093 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1096/2202] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:42.939859 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72ef4f-1ce2-4630-b072-098ed16de837 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:42.940149 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72ef4f-1ce2-4630-b072-098ed16de837 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:42.940421 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72ef4f-1ce2-4630-b072-098ed16de837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:42.964314 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-6d72ef4f-1ce2-4630-b072-098ed16de837 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:42.965589 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-6d72ef4f-1ce2-4630-b072-098ed16de837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:42.974747 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1107/2203] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:42.978816 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a828d-d190-4217-8932-d0e3703c7d84 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:42.989233 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a828d-d190-4217-8932-d0e3703c7d84 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:42.994256 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c6f95-625c-4ad8-9f0c-bc42f58fc4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:42.995273 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c6f95-625c-4ad8-9f0c-bc42f58fc4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:42.995638 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c6f95-625c-4ad8-9f0c-bc42f58fc4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:42.995917 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c6f95-625c-4ad8-9f0c-bc42f58fc4f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:42.996757 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c6f95-625c-4ad8-9f0c-bc42f58fc4f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:42.997525 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c6f95-625c-4ad8-9f0c-bc42f58fc4f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:42.999599 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c6f95-625c-4ad8-9f0c-bc42f58fc4f4 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:43.018516 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1097/2204] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:43.019716 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72ef4f-1ce2-4630-b072-098ed16de837 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:43.030546 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72ef4f-1ce2-4630-b072-098ed16de837 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:43.035716 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e451a18-0c5b-4c66-89f0-bdfac72c1a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:43.036398 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e451a18-0c5b-4c66-89f0-bdfac72c1a08 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:43.036748 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e451a18-0c5b-4c66-89f0-bdfac72c1a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:43.037087 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e451a18-0c5b-4c66-89f0-bdfac72c1a08 admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:43.037855 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e451a18-0c5b-4c66-89f0-bdfac72c1a08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:43.039943 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e451a18-0c5b-4c66-89f0-bdfac72c1a08 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:43.070844 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1108/2205] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:43 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:43.072391 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c6f95-625c-4ad8-9f0c-bc42f58fc4f4 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:43.074382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-a64c6f95-625c-4ad8-9f0c-bc42f58fc4f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:43.075565 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e451a18-0c5b-4c66-89f0-bdfac72c1a08 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:43.097185 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c6f95-625c-4ad8-9f0c-bc42f58fc4f4 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:43.142164 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e451a18-0c5b-4c66-89f0-bdfac72c1a08 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:43.147450 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3ee3e-b358-4d1d-ab51-99cb78a2835a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:43.148091 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3ee3e-b358-4d1d-ab51-99cb78a2835a admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:43.148371 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3ee3e-b358-4d1d-ab51-99cb78a2835a admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:43.148748 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3ee3e-b358-4d1d-ab51-99cb78a2835a admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:43.149293 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3ee3e-b358-4d1d-ab51-99cb78a2835a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:43.151266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3ee3e-b358-4d1d-ab51-99cb78a2835a admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:43.162150 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031cd6d6-a495-4302-a1a0-db2ac2a6ea56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:43.162934 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cd6d6-a495-4302-a1a0-db2ac2a6ea56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:43.163235 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cd6d6-a495-4302-a1a0-db2ac2a6ea56 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:43.163547 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cd6d6-a495-4302-a1a0-db2ac2a6ea56 admin admin] PATH_INFO: `/v3/projects/d937f8edf4574567aa2abb50826af2a2` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:43.164907 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031cd6d6-a495-4302-a1a0-db2ac2a6ea56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d937f8edf4574567aa2abb50826af2a2)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:43.167288 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031cd6d6-a495-4302-a1a0-db2ac2a6ea56 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:43.175162 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1109/2206] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:43 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:50:43.179193 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3ee3e-b358-4d1d-ab51-99cb78a2835a admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:43.189317 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3ee3e-b358-4d1d-ab51-99cb78a2835a admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:43.194799 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfbded-9163-4a55-a2d9-7be570474e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:43.195339 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfbded-9163-4a55-a2d9-7be570474e2c admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:43.195615 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfbded-9163-4a55-a2d9-7be570474e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:43.195900 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfbded-9163-4a55-a2d9-7be570474e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:43.196706 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cfbded-9163-4a55-a2d9-7be570474e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:43.198346 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cfbded-9163-4a55-a2d9-7be570474e2c admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:43.209935 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1110/2207] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:50:43.214629 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfbded-9163-4a55-a2d9-7be570474e2c admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:43.226007 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-031cd6d6-a495-4302-a1a0-db2ac2a6ea56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd937f8edf4574567aa2abb50826af2a2', 'request_id': 'req-031cd6d6-a495-4302-a1a0-db2ac2a6ea56'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:43.228069 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:43.233248 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfbded-9163-4a55-a2d9-7be570474e2c admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:43.239550 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-031cd6d6-a495-4302-a1a0-db2ac2a6ea56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd937f8edf4574567aa2abb50826af2a2', 'request_id': 'req-031cd6d6-a495-4302-a1a0-db2ac2a6ea56'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:43.247032 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-031cd6d6-a495-4302-a1a0-db2ac2a6ea56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd937f8edf4574567aa2abb50826af2a2', 'request_id': 'req-031cd6d6-a495-4302-a1a0-db2ac2a6ea56'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:43.249585 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:43.268490 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-031cd6d6-a495-4302-a1a0-db2ac2a6ea56 admin admin] The token cache is being invalidate because project d937f8edf4574567aa2abb50826af2a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:43.268790 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-031cd6d6-a495-4302-a1a0-db2ac2a6ea56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:43.270261 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-031cd6d6-a495-4302-a1a0-db2ac2a6ea56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:43.275256 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1098/2208] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:43 2022] DELETE /identity/v3/projects/d937f8edf4574567aa2abb50826af2a2 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:43.279589 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031cd6d6-a495-4302-a1a0-db2ac2a6ea56 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:43.282729 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-031cd6d6-a495-4302-a1a0-db2ac2a6ea56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:43.349138 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909cd42-413f-40b5-9ca2-aceec03a21f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:43.349900 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909cd42-413f-40b5-9ca2-aceec03a21f5 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:43.350399 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909cd42-413f-40b5-9ca2-aceec03a21f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:43.350813 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909cd42-413f-40b5-9ca2-aceec03a21f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:43.351612 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909cd42-413f-40b5-9ca2-aceec03a21f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:43.359200 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909cd42-413f-40b5-9ca2-aceec03a21f5 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:43.376326 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1111/2209] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:43.380986 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909cd42-413f-40b5-9ca2-aceec03a21f5 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:43.385988 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031cd6d6-a495-4302-a1a0-db2ac2a6ea56 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:43.386155 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-4909cd42-413f-40b5-9ca2-aceec03a21f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:43.391648 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded62b45-4c59-4347-9003-cc501c4fa920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:43.392476 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded62b45-4c59-4347-9003-cc501c4fa920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:43.393290 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded62b45-4c59-4347-9003-cc501c4fa920 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:43.393290 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded62b45-4c59-4347-9003-cc501c4fa920 admin admin] PATH_INFO: `/v3/users/3c6282bb237b4a94be1e3c988a9b83d2` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:43.394489 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded62b45-4c59-4347-9003-cc501c4fa920 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c6282bb237b4a94be1e3c988a9b83d2)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:43.396441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded62b45-4c59-4347-9003-cc501c4fa920 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:43.409591 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909cd42-413f-40b5-9ca2-aceec03a21f5 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:43.416277 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e9ff0-fa5b-4ee2-af3c-ddc526d78fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:43.416955 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e9ff0-fa5b-4ee2-af3c-ddc526d78fa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:43.417373 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e9ff0-fa5b-4ee2-af3c-ddc526d78fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:43.417667 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e9ff0-fa5b-4ee2-af3c-ddc526d78fa4 admin admin] PATH_INFO: `/v3/projects/b76f64941c234d5783df705a61a8d9fb/users/4c5e0313bfbe4f11972a56c65316b53f/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:43.467552 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e9ff0-fa5b-4ee2-af3c-ddc526d78fa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b76f64941c234d5783df705a61a8d9fb, user_id=4c5e0313bfbe4f11972a56c65316b53f, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:43.470892 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e9ff0-fa5b-4ee2-af3c-ddc526d78fa4 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:43.501698 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1112/2210] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:43 2022] PUT /identity/v3/projects/b76f64941c234d5783df705a61a8d9fb/users/4c5e0313bfbe4f11972a56c65316b53f/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:50:43.515471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-ded62b45-4c59-4347-9003-cc501c4fa920 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c6282bb237b4a94be1e3c988a9b83d2'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:43.517154 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-ded62b45-4c59-4347-9003-cc501c4fa920 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c6282bb237b4a94be1e3c988a9b83d2'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:43.517860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-ded62b45-4c59-4347-9003-cc501c4fa920 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c6282bb237b4a94be1e3c988a9b83d2'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:43.524708 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbeefc-23a9-4aa4-b2a3-b0ce8e9f055b None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:43.527644 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbeefc-23a9-4aa4-b2a3-b0ce8e9f055b None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:43.528151 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbeefc-23a9-4aa4-b2a3-b0ce8e9f055b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:43.533090 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-ded62b45-4c59-4347-9003-cc501c4fa920 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c6282bb237b4a94be1e3c988a9b83d2'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:43.542422 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-ded62b45-4c59-4347-9003-cc501c4fa920 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c6282bb237b4a94be1e3c988a9b83d2'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:43.562839 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1099/2211] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:43 2022] DELETE /identity/v3/users/3c6282bb237b4a94be1e3c988a9b83d2 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:50:43.580773 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-a4cbeefc-23a9-4aa4-b2a3-b0ce8e9f055b None None] MFA Rules not processed for user `4c5e0313bfbe4f11972a56c65316b53f`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:43.582139 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-a4cbeefc-23a9-4aa4-b2a3-b0ce8e9f055b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:43.687023 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1113/2212] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:43.700535 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded62b45-4c59-4347-9003-cc501c4fa920 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:43.703689 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-ded62b45-4c59-4347-9003-cc501c4fa920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:43.780080 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded62b45-4c59-4347-9003-cc501c4fa920 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:43.783988 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd6c26-4bd8-4a34-b355-cf439c4500f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:43.784620 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd6c26-4bd8-4a34-b355-cf439c4500f4 service cinder] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:43.784904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd6c26-4bd8-4a34-b355-cf439c4500f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:43.785177 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd6c26-4bd8-4a34-b355-cf439c4500f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:43.795445 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd6c26-4bd8-4a34-b355-cf439c4500f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:43.796974 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd6c26-4bd8-4a34-b355-cf439c4500f4 service cinder] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:43.806909 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1100/2213] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:43.829734 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbeefc-23a9-4aa4-b2a3-b0ce8e9f055b None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:43.832648 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-a4cbeefc-23a9-4aa4-b2a3-b0ce8e9f055b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:43.913826 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd6c26-4bd8-4a34-b355-cf439c4500f4 service cinder] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:43.916755 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-cbfd6c26-4bd8-4a34-b355-cf439c4500f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:43.932935 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:43.965178 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbeefc-23a9-4aa4-b2a3-b0ce8e9f055b None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:43.970992 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbde2ce-5baa-40f5-8552-26763e7ee9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:43.972202 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbde2ce-5baa-40f5-8552-26763e7ee9ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:43.973259 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbde2ce-5baa-40f5-8552-26763e7ee9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:43.973399 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbde2ce-5baa-40f5-8552-26763e7ee9ab admin admin] PATH_INFO: `/v3/users/4c5e0313bfbe4f11972a56c65316b53f` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:43.975029 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbde2ce-5baa-40f5-8552-26763e7ee9ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c5e0313bfbe4f11972a56c65316b53f)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:43.977542 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbde2ce-5baa-40f5-8552-26763e7ee9ab admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:43.984439 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:44.017578 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd6c26-4bd8-4a34-b355-cf439c4500f4 service cinder] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:44.022801 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa9f6e6-26e7-414d-b622-5f88483da8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:44.023407 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9f6e6-26e7-414d-b622-5f88483da8d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:44.023728 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9f6e6-26e7-414d-b622-5f88483da8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:44.024003 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa9f6e6-26e7-414d-b622-5f88483da8d8 admin admin] PATH_INFO: `/v3/projects/ccd8bc7bd82f4df4b696274e282f3351` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:44.025147 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa9f6e6-26e7-414d-b622-5f88483da8d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccd8bc7bd82f4df4b696274e282f3351)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:44.027369 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa9f6e6-26e7-414d-b622-5f88483da8d8 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:44.036029 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-6bbde2ce-5baa-40f5-8552-26763e7ee9ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c5e0313bfbe4f11972a56c65316b53f'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:44.036728 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-6bbde2ce-5baa-40f5-8552-26763e7ee9ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c5e0313bfbe4f11972a56c65316b53f'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:44.037539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-6bbde2ce-5baa-40f5-8552-26763e7ee9ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c5e0313bfbe4f11972a56c65316b53f'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:44.050757 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-6bbde2ce-5baa-40f5-8552-26763e7ee9ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c5e0313bfbe4f11972a56c65316b53f'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:44.059824 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-6bbde2ce-5baa-40f5-8552-26763e7ee9ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c5e0313bfbe4f11972a56c65316b53f'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:44.073658 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1114/2214] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:43 2022] DELETE /identity/v3/users/4c5e0313bfbe4f11972a56c65316b53f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:44.078158 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5497e0-4495-4f04-b444-c58ad9b03a13 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:44.078443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-1aa9f6e6-26e7-414d-b622-5f88483da8d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccd8bc7bd82f4df4b696274e282f3351', 'request_id': 'req-1aa9f6e6-26e7-414d-b622-5f88483da8d8'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:44.078551 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5497e0-4495-4f04-b444-c58ad9b03a13 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:44.078759 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5497e0-4495-4f04-b444-c58ad9b03a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:44.086524 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-1aa9f6e6-26e7-414d-b622-5f88483da8d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccd8bc7bd82f4df4b696274e282f3351', 'request_id': 'req-1aa9f6e6-26e7-414d-b622-5f88483da8d8'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:44.093708 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-1aa9f6e6-26e7-414d-b622-5f88483da8d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccd8bc7bd82f4df4b696274e282f3351', 'request_id': 'req-1aa9f6e6-26e7-414d-b622-5f88483da8d8'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:44.099581 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-0f5497e0-4495-4f04-b444-c58ad9b03a13 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:44.100797 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-0f5497e0-4495-4f04-b444-c58ad9b03a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:44.104426 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-1aa9f6e6-26e7-414d-b622-5f88483da8d8 admin admin] The token cache is being invalidate because project ccd8bc7bd82f4df4b696274e282f3351 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:44.104815 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-1aa9f6e6-26e7-414d-b622-5f88483da8d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:44.105978 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-1aa9f6e6-26e7-414d-b622-5f88483da8d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:44.107511 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1101/2215] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:43 2022] DELETE /identity/v3/projects/ccd8bc7bd82f4df4b696274e282f3351 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:44.113236 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46971667-d06b-4d2d-9f7d-c5251ecce877 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:44.113638 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46971667-d06b-4d2d-9f7d-c5251ecce877 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:44.113919 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46971667-d06b-4d2d-9f7d-c5251ecce877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:44.135170 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-46971667-d06b-4d2d-9f7d-c5251ecce877 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:44.136809 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-46971667-d06b-4d2d-9f7d-c5251ecce877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:44.165134 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1115/2216] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:44.176508 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5497e0-4495-4f04-b444-c58ad9b03a13 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:44.178167 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-0f5497e0-4495-4f04-b444-c58ad9b03a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:44.205375 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1102/2217] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:50:44.212013 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d1129-8775-4bc2-af1a-e1380b7f5a92 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:44.212300 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d1129-8775-4bc2-af1a-e1380b7f5a92 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:44.212571 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d1129-8775-4bc2-af1a-e1380b7f5a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:44.232876 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-260d1129-8775-4bc2-af1a-e1380b7f5a92 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:44.234132 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-260d1129-8775-4bc2-af1a-e1380b7f5a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:44.238256 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5497e0-4495-4f04-b444-c58ad9b03a13 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:44.241976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43559cb8-08a1-4944-93fe-7492b7ec0779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:44.242341 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1103/2218] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:44.242582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43559cb8-08a1-4944-93fe-7492b7ec0779 service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:44.242856 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43559cb8-08a1-4944-93fe-7492b7ec0779 service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:44.243122 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43559cb8-08a1-4944-93fe-7492b7ec0779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:44.246444 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d1129-8775-4bc2-af1a-e1380b7f5a92 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:44.253133 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43559cb8-08a1-4944-93fe-7492b7ec0779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:44.254600 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43559cb8-08a1-4944-93fe-7492b7ec0779 service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:44.255798 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d1129-8775-4bc2-af1a-e1380b7f5a92 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:44.260587 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f7fe1-7aa0-410b-ad19-68990c518489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:44.261173 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f7fe1-7aa0-410b-ad19-68990c518489 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:44.261495 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f7fe1-7aa0-410b-ad19-68990c518489 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:44.261771 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f7fe1-7aa0-410b-ad19-68990c518489 admin admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:44.262420 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f7fe1-7aa0-410b-ad19-68990c518489 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:44.262982 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f7fe1-7aa0-410b-ad19-68990c518489 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:44.263984 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1116/2219] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:44.264609 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f7fe1-7aa0-410b-ad19-68990c518489 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:44.276955 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1104/2220] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:50:44.281527 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43559cb8-08a1-4944-93fe-7492b7ec0779 service neutron] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:44.291553 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43559cb8-08a1-4944-93fe-7492b7ec0779 service neutron] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:44.296287 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78fa48-afc2-46ef-b103-fa82374618c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:44.296933 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78fa48-afc2-46ef-b103-fa82374618c9 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:44.297145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78fa48-afc2-46ef-b103-fa82374618c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:44.297444 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78fa48-afc2-46ef-b103-fa82374618c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:44.298104 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e78fa48-afc2-46ef-b103-fa82374618c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:44.300143 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e78fa48-afc2-46ef-b103-fa82374618c9 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:44.329386 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1117/2221] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:44 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:44.331487 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f7fe1-7aa0-410b-ad19-68990c518489 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:44.341931 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f7fe1-7aa0-410b-ad19-68990c518489 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:44.360514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:44.405802 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be398b9d-7b2c-4170-8e8d-d84a91c83370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:44.406901 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be398b9d-7b2c-4170-8e8d-d84a91c83370 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:44.407198 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be398b9d-7b2c-4170-8e8d-d84a91c83370 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:44.407476 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be398b9d-7b2c-4170-8e8d-d84a91c83370 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:44.411201 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be398b9d-7b2c-4170-8e8d-d84a91c83370 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:44.411201 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be398b9d-7b2c-4170-8e8d-d84a91c83370 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:44.435213 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1105/2222] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:44 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:44.436867 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78fa48-afc2-46ef-b103-fa82374618c9 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:44.447585 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78fa48-afc2-46ef-b103-fa82374618c9 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:44.452947 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bb25e-1e39-43a5-9db1-bc06f4069191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:44.453607 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bb25e-1e39-43a5-9db1-bc06f4069191 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:44.453873 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bb25e-1e39-43a5-9db1-bc06f4069191 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:44.454163 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bb25e-1e39-43a5-9db1-bc06f4069191 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:44.454957 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828bb25e-1e39-43a5-9db1-bc06f4069191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:44.456597 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828bb25e-1e39-43a5-9db1-bc06f4069191 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:44.458247 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:44.472335 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1118/2223] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:44.473665 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be398b9d-7b2c-4170-8e8d-d84a91c83370 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:44.484601 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be398b9d-7b2c-4170-8e8d-d84a91c83370 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:44.491002 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b550e-0557-44ce-ba8c-c68bb22d6a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:44.491714 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b550e-0557-44ce-ba8c-c68bb22d6a13 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:44.492449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b550e-0557-44ce-ba8c-c68bb22d6a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:44.492934 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b550e-0557-44ce-ba8c-c68bb22d6a13 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:44.493966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48b550e-0557-44ce-ba8c-c68bb22d6a13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:44.495848 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48b550e-0557-44ce-ba8c-c68bb22d6a13 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:44.512702 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1106/2224] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:50:44.514094 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bb25e-1e39-43a5-9db1-bc06f4069191 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:44.529233 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bb25e-1e39-43a5-9db1-bc06f4069191 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:44.534432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0295c2ee-f7d1-47e9-a2c8-8293db6fde00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:44.535098 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295c2ee-f7d1-47e9-a2c8-8293db6fde00 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:44.535440 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295c2ee-f7d1-47e9-a2c8-8293db6fde00 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:44.535787 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0295c2ee-f7d1-47e9-a2c8-8293db6fde00 admin admin] PATH_INFO: `/v3/projects/c36ef093f14e493392b1c86c2ab4fab7/users/57b61065515d43208f5cb64c05ac36d1/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:44.547241 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b550e-0557-44ce-ba8c-c68bb22d6a13 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:44.549448 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-a48b550e-0557-44ce-ba8c-c68bb22d6a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:44.553721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0295c2ee-f7d1-47e9-a2c8-8293db6fde00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c36ef093f14e493392b1c86c2ab4fab7, user_id=57b61065515d43208f5cb64c05ac36d1, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:44.557372 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0295c2ee-f7d1-47e9-a2c8-8293db6fde00 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:44.564289 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b550e-0557-44ce-ba8c-c68bb22d6a13 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:44.569777 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82632dbc-dc7c-4e72-aeb2-afda37530841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:44.570491 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82632dbc-dc7c-4e72-aeb2-afda37530841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:44.570766 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82632dbc-dc7c-4e72-aeb2-afda37530841 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:44.571075 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82632dbc-dc7c-4e72-aeb2-afda37530841 admin admin] PATH_INFO: `/v3/projects/b76f64941c234d5783df705a61a8d9fb` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:44.572169 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82632dbc-dc7c-4e72-aeb2-afda37530841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b76f64941c234d5783df705a61a8d9fb)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:44.573189 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1119/2225] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:44 2022] PUT /identity/v3/projects/c36ef093f14e493392b1c86c2ab4fab7/users/57b61065515d43208f5cb64c05ac36d1/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:44.578362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82632dbc-dc7c-4e72-aeb2-afda37530841 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:44.587655 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee23834-982c-4e5b-81ae-ffa1a2f132c1 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:44.588029 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee23834-982c-4e5b-81ae-ffa1a2f132c1 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:44.588201 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee23834-982c-4e5b-81ae-ffa1a2f132c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:44.620586 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-8ee23834-982c-4e5b-81ae-ffa1a2f132c1 None None] MFA Rules not processed for user `57b61065515d43208f5cb64c05ac36d1`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:44.621802 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-8ee23834-982c-4e5b-81ae-ffa1a2f132c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:44.637277 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-82632dbc-dc7c-4e72-aeb2-afda37530841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b76f64941c234d5783df705a61a8d9fb', 'request_id': 'req-82632dbc-dc7c-4e72-aeb2-afda37530841'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:44.646344 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-82632dbc-dc7c-4e72-aeb2-afda37530841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b76f64941c234d5783df705a61a8d9fb', 'request_id': 'req-82632dbc-dc7c-4e72-aeb2-afda37530841'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:44.657818 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-82632dbc-dc7c-4e72-aeb2-afda37530841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b76f64941c234d5783df705a61a8d9fb', 'request_id': 'req-82632dbc-dc7c-4e72-aeb2-afda37530841'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:44.670883 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-82632dbc-dc7c-4e72-aeb2-afda37530841 admin admin] The token cache is being invalidate because project b76f64941c234d5783df705a61a8d9fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:44.671656 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-82632dbc-dc7c-4e72-aeb2-afda37530841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:44.671974 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-82632dbc-dc7c-4e72-aeb2-afda37530841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:44.673857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1107/2226] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:44 2022] DELETE /identity/v3/projects/b76f64941c234d5783df705a61a8d9fb => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:50:44.678825 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39387c11-cb72-41ef-a406-086be8f2e0ca None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:44.679239 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39387c11-cb72-41ef-a406-086be8f2e0ca None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:44.679514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39387c11-cb72-41ef-a406-086be8f2e0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:44.702991 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-39387c11-cb72-41ef-a406-086be8f2e0ca None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:44.704270 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-39387c11-cb72-41ef-a406-086be8f2e0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:44.719429 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1120/2227] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:44.724656 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee23834-982c-4e5b-81ae-ffa1a2f132c1 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:44.726960 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-8ee23834-982c-4e5b-81ae-ffa1a2f132c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:44.784853 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1108/2228] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:44.792730 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35006d2-6baa-4be5-8b36-e0104ce8cd69 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:44.793189 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35006d2-6baa-4be5-8b36-e0104ce8cd69 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:44.793506 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35006d2-6baa-4be5-8b36-e0104ce8cd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:44.818856 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-c35006d2-6baa-4be5-8b36-e0104ce8cd69 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:44.820209 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-c35006d2-6baa-4be5-8b36-e0104ce8cd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:44.830276 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1109/2229] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:44.834642 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35006d2-6baa-4be5-8b36-e0104ce8cd69 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:44.849905 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35006d2-6baa-4be5-8b36-e0104ce8cd69 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:44.850374 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee23834-982c-4e5b-81ae-ffa1a2f132c1 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:44.855772 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54820b-bf39-4b94-908d-8d441d646fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:44.856359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54820b-bf39-4b94-908d-8d441d646fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:44.856619 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54820b-bf39-4b94-908d-8d441d646fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:44.856918 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c54820b-bf39-4b94-908d-8d441d646fa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:44.857625 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54820b-bf39-4b94-908d-8d441d646fa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:44.857941 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54820b-bf39-4b94-908d-8d441d646fa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:44.858536 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f539a2-6cfc-4a34-abfd-50b92d2f3f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:44.859268 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f539a2-6cfc-4a34-abfd-50b92d2f3f04 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:44.859771 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c54820b-bf39-4b94-908d-8d441d646fa1 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:44.861180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f539a2-6cfc-4a34-abfd-50b92d2f3f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:44.861527 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f539a2-6cfc-4a34-abfd-50b92d2f3f04 admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:44.862244 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f539a2-6cfc-4a34-abfd-50b92d2f3f04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:44.864158 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f539a2-6cfc-4a34-abfd-50b92d2f3f04 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:44.876277 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1110/2230] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:44.878302 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54820b-bf39-4b94-908d-8d441d646fa1 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:44.883447 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:44.891033 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c54820b-bf39-4b94-908d-8d441d646fa1 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:44.901111 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1121/2231] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:44 2022] POST /identity/v3/projects => generated 387 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:44.905748 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f539a2-6cfc-4a34-abfd-50b92d2f3f04 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:44.906198 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c0d38-c5fb-49be-ba5c-deefc605b420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:44.907257 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c0d38-c5fb-49be-ba5c-deefc605b420 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:44.907495 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c0d38-c5fb-49be-ba5c-deefc605b420 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:44.908083 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c0d38-c5fb-49be-ba5c-deefc605b420 admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:44.908759 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166c0d38-c5fb-49be-ba5c-deefc605b420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:44.911349 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166c0d38-c5fb-49be-ba5c-deefc605b420 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:44.974685 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:44.982300 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1111/2232] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:44 2022] POST /identity/v3/projects => generated 359 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:50:44.992907 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f539a2-6cfc-4a34-abfd-50b92d2f3f04 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:45.004481 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c0d38-c5fb-49be-ba5c-deefc605b420 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:45.096947 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460a461-9a41-4b58-87e0-a1bda01a6799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:45.097889 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460a461-9a41-4b58-87e0-a1bda01a6799 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:45.098002 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460a461-9a41-4b58-87e0-a1bda01a6799 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:45.098327 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460a461-9a41-4b58-87e0-a1bda01a6799 admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:45.098965 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460a461-9a41-4b58-87e0-a1bda01a6799 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:45.101048 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0460a461-9a41-4b58-87e0-a1bda01a6799 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:45.115444 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c0d38-c5fb-49be-ba5c-deefc605b420 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:45.120924 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76993a3e-bf22-44e8-ab6b-b65501388797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:45.121747 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76993a3e-bf22-44e8-ab6b-b65501388797 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:45.122152 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76993a3e-bf22-44e8-ab6b-b65501388797 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:45.122526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76993a3e-bf22-44e8-ab6b-b65501388797 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:45.123236 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76993a3e-bf22-44e8-ab6b-b65501388797 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:45.125875 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76993a3e-bf22-44e8-ab6b-b65501388797 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:45.131508 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1122/2233] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:44 2022] POST /identity/v3/users => generated 300 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:50:45.139461 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460a461-9a41-4b58-87e0-a1bda01a6799 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:45.151623 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460a461-9a41-4b58-87e0-a1bda01a6799 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:45.156700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff517fa-e3ae-4a9b-88e7-6c426b8d61a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:45.157356 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff517fa-e3ae-4a9b-88e7-6c426b8d61a9 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:45.157622 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff517fa-e3ae-4a9b-88e7-6c426b8d61a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:45.157941 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff517fa-e3ae-4a9b-88e7-6c426b8d61a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:45.158601 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff517fa-e3ae-4a9b-88e7-6c426b8d61a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:45.160892 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff517fa-e3ae-4a9b-88e7-6c426b8d61a9 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:45.164719 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1112/2234] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:45 2022] POST /identity/v3/users => generated 280 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:45.166233 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76993a3e-bf22-44e8-ab6b-b65501388797 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:45.177702 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1123/2235] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:50:45.179324 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff517fa-e3ae-4a9b-88e7-6c426b8d61a9 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:45.180751 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76993a3e-bf22-44e8-ab6b-b65501388797 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:45.185853 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfe992-ccf4-4254-bb97-db37cccfaf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:45.186564 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfe992-ccf4-4254-bb97-db37cccfaf2b admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:45.186917 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfe992-ccf4-4254-bb97-db37cccfaf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:45.187256 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfe992-ccf4-4254-bb97-db37cccfaf2b admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:45.188098 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bfe992-ccf4-4254-bb97-db37cccfaf2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:45.189728 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bfe992-ccf4-4254-bb97-db37cccfaf2b admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:45.191422 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff517fa-e3ae-4a9b-88e7-6c426b8d61a9 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:45.198249 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb3ee0-def6-4fd8-98f9-340ab40be9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:45.199269 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb3ee0-def6-4fd8-98f9-340ab40be9ae admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:45.199695 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb3ee0-def6-4fd8-98f9-340ab40be9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:45.200108 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb3ee0-def6-4fd8-98f9-340ab40be9ae admin admin] PATH_INFO: `/v3/projects/fad8abb4b8aa4bf9b3c0ec90dd09d527/users/94a14473a0694ccc9dd59bbd536b63fd/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:45.201770 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1113/2236] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:45.205642 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfe992-ccf4-4254-bb97-db37cccfaf2b admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:45.217562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfe992-ccf4-4254-bb97-db37cccfaf2b admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:45.219117 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb3ee0-def6-4fd8-98f9-340ab40be9ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad8abb4b8aa4bf9b3c0ec90dd09d527, user_id=94a14473a0694ccc9dd59bbd536b63fd, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:45.222096 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb3ee0-def6-4fd8-98f9-340ab40be9ae admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:45.223749 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e1a4c-cd3c-4080-9765-33f892a94270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:45.224523 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e1a4c-cd3c-4080-9765-33f892a94270 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:45.224800 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e1a4c-cd3c-4080-9765-33f892a94270 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:45.225069 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e1a4c-cd3c-4080-9765-33f892a94270 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:45.225876 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e1a4c-cd3c-4080-9765-33f892a94270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:45.228018 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9e1a4c-cd3c-4080-9765-33f892a94270 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:45.240328 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1114/2237] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:50:45.240995 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1124/2238] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:45 2022] PUT /identity/v3/projects/fad8abb4b8aa4bf9b3c0ec90dd09d527/users/94a14473a0694ccc9dd59bbd536b63fd/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:45.244585 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e1a4c-cd3c-4080-9765-33f892a94270 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:45.246360 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb3ee0-def6-4fd8-98f9-340ab40be9ae admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:45.256549 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e1a4c-cd3c-4080-9765-33f892a94270 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:45.321841 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb3ee0-def6-4fd8-98f9-340ab40be9ae admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:45.327847 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a5756-a58f-47c9-b0e0-f64283906c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:45.328044 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadcaef-5fae-497e-a6d7-50e9ec001aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:45.328720 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a5756-a58f-47c9-b0e0-f64283906c86 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:45.328997 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a5756-a58f-47c9-b0e0-f64283906c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:45.329104 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadcaef-5fae-497e-a6d7-50e9ec001aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:45.329272 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a5756-a58f-47c9-b0e0-f64283906c86 admin admin] PATH_INFO: `/v3/projects/11695df20c0b4286a37d8e9beac747ef/users/a85e263136e64d8ea50c2b5dcfc84480/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:45.329900 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadcaef-5fae-497e-a6d7-50e9ec001aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:45.330351 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadcaef-5fae-497e-a6d7-50e9ec001aa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:45.331072 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dadcaef-5fae-497e-a6d7-50e9ec001aa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:45.333610 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dadcaef-5fae-497e-a6d7-50e9ec001aa0 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:45.347949 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1125/2239] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:45.348122 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a5756-a58f-47c9-b0e0-f64283906c86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11695df20c0b4286a37d8e9beac747ef, user_id=a85e263136e64d8ea50c2b5dcfc84480, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:45.348977 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadcaef-5fae-497e-a6d7-50e9ec001aa0 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:45.350053 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a5756-a58f-47c9-b0e0-f64283906c86 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:45.363825 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadcaef-5fae-497e-a6d7-50e9ec001aa0 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:45.369450 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71e8a8-a583-4493-9379-4c4a07e74f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:45.370397 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71e8a8-a583-4493-9379-4c4a07e74f4f admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:45.370830 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71e8a8-a583-4493-9379-4c4a07e74f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:45.371099 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71e8a8-a583-4493-9379-4c4a07e74f4f admin admin] PATH_INFO: `/v3/projects/fad8abb4b8aa4bf9b3c0ec90dd09d527/users/94a14473a0694ccc9dd59bbd536b63fd/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:45.373815 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71e8a8-a583-4493-9379-4c4a07e74f4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad8abb4b8aa4bf9b3c0ec90dd09d527, user_id=94a14473a0694ccc9dd59bbd536b63fd, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:45.376579 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71e8a8-a583-4493-9379-4c4a07e74f4f admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:45.383710 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1115/2240] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:45 2022] PUT /identity/v3/projects/11695df20c0b4286a37d8e9beac747ef/users/a85e263136e64d8ea50c2b5dcfc84480/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:50:45.395299 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d310e2-4cfc-4a8a-b564-f18a6ff52508 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:45.395673 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d310e2-4cfc-4a8a-b564-f18a6ff52508 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:45.396013 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d310e2-4cfc-4a8a-b564-f18a6ff52508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:45.396489 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1126/2241] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:45 2022] PUT /identity/v3/projects/fad8abb4b8aa4bf9b3c0ec90dd09d527/users/94a14473a0694ccc9dd59bbd536b63fd/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:45.409477 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b47f2a-08a5-414d-be7d-aae79354872e None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:45.409604 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b47f2a-08a5-414d-be7d-aae79354872e None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:45.409811 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b47f2a-08a5-414d-be7d-aae79354872e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:45.438613 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-e6d310e2-4cfc-4a8a-b564-f18a6ff52508 None None] MFA Rules not processed for user `a85e263136e64d8ea50c2b5dcfc84480`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:45.440206 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-e6d310e2-4cfc-4a8a-b564-f18a6ff52508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:45.445389 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-43b47f2a-08a5-414d-be7d-aae79354872e None None] MFA Rules not processed for user `94a14473a0694ccc9dd59bbd536b63fd`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:45.446745 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-43b47f2a-08a5-414d-be7d-aae79354872e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:45.464548 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:45.469023 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:45.520891 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1116/2242] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:45 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:45.529827 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1127/2243] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:45 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:50:45.543269 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d310e2-4cfc-4a8a-b564-f18a6ff52508 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:45.544772 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-e6d310e2-4cfc-4a8a-b564-f18a6ff52508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:45.580423 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b47f2a-08a5-414d-be7d-aae79354872e None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:45.581825 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-43b47f2a-08a5-414d-be7d-aae79354872e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:45.605565 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d310e2-4cfc-4a8a-b564-f18a6ff52508 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:45.609556 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4feced-f385-4c31-a299-1d42382c4559 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:45.610134 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4feced-f385-4c31-a299-1d42382c4559 service cinder] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:45.610410 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4feced-f385-4c31-a299-1d42382c4559 service cinder] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:45.610697 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4feced-f385-4c31-a299-1d42382c4559 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:45.620116 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4feced-f385-4c31-a299-1d42382c4559 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:45.621719 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4feced-f385-4c31-a299-1d42382c4559 service cinder] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:45.632549 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1117/2244] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:45 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:45.644921 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b47f2a-08a5-414d-be7d-aae79354872e None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:45.648517 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82aaa5a-064f-416d-b6ed-dd4a652b95c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:45.649131 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82aaa5a-064f-416d-b6ed-dd4a652b95c7 service cinder] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:45.649443 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82aaa5a-064f-416d-b6ed-dd4a652b95c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:45.649867 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82aaa5a-064f-416d-b6ed-dd4a652b95c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:45.659584 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82aaa5a-064f-416d-b6ed-dd4a652b95c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:45.661101 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82aaa5a-064f-416d-b6ed-dd4a652b95c7 service cinder] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:45.671281 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1128/2245] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:45 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:45.687874 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4feced-f385-4c31-a299-1d42382c4559 service cinder] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:45.712594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82aaa5a-064f-416d-b6ed-dd4a652b95c7 service cinder] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:45.784373 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82aaa5a-064f-416d-b6ed-dd4a652b95c7 service cinder] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:45.786454 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4feced-f385-4c31-a299-1d42382c4559 service cinder] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:45.788966 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb4f4b-d4c1-4bfc-8fe1-7b2c19a80ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:45.789744 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb4f4b-d4c1-4bfc-8fe1-7b2c19a80ee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:45.790078 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb4f4b-d4c1-4bfc-8fe1-7b2c19a80ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:45.790368 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb4f4b-d4c1-4bfc-8fe1-7b2c19a80ee9 admin admin] PATH_INFO: `/v3/users/57b61065515d43208f5cb64c05ac36d1` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:45.791230 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fc5f8-8c19-4bdb-aa10-c8502f73cb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:45.791761 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb4f4b-d4c1-4bfc-8fe1-7b2c19a80ee9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57b61065515d43208f5cb64c05ac36d1)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:45.791884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fc5f8-8c19-4bdb-aa10-c8502f73cb1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:45.792111 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fc5f8-8c19-4bdb-aa10-c8502f73cb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:45.792382 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fc5f8-8c19-4bdb-aa10-c8502f73cb1e admin admin] PATH_INFO: `/v3/users/a85e263136e64d8ea50c2b5dcfc84480` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:45.793526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2fc5f8-8c19-4bdb-aa10-c8502f73cb1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a85e263136e64d8ea50c2b5dcfc84480)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:45.794062 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb4f4b-d4c1-4bfc-8fe1-7b2c19a80ee9 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:45.795429 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2fc5f8-8c19-4bdb-aa10-c8502f73cb1e admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:45.852049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-25cb4f4b-d4c1-4bfc-8fe1-7b2c19a80ee9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57b61065515d43208f5cb64c05ac36d1'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:45.852723 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-25cb4f4b-d4c1-4bfc-8fe1-7b2c19a80ee9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57b61065515d43208f5cb64c05ac36d1'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:45.853368 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-25cb4f4b-d4c1-4bfc-8fe1-7b2c19a80ee9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57b61065515d43208f5cb64c05ac36d1'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:45.858770 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-8d2fc5f8-8c19-4bdb-aa10-c8502f73cb1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a85e263136e64d8ea50c2b5dcfc84480'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:45.859472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-8d2fc5f8-8c19-4bdb-aa10-c8502f73cb1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a85e263136e64d8ea50c2b5dcfc84480'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:45.860105 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-8d2fc5f8-8c19-4bdb-aa10-c8502f73cb1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a85e263136e64d8ea50c2b5dcfc84480'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:45.869351 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:45.871855 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-25cb4f4b-d4c1-4bfc-8fe1-7b2c19a80ee9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57b61065515d43208f5cb64c05ac36d1'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:45.881152 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-8d2fc5f8-8c19-4bdb-aa10-c8502f73cb1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a85e263136e64d8ea50c2b5dcfc84480'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:45.883385 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:45.884081 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-25cb4f4b-d4c1-4bfc-8fe1-7b2c19a80ee9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57b61065515d43208f5cb64c05ac36d1'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:45.894204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-8d2fc5f8-8c19-4bdb-aa10-c8502f73cb1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a85e263136e64d8ea50c2b5dcfc84480'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:45.903762 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1129/2246] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:45 2022] DELETE /identity/v3/users/57b61065515d43208f5cb64c05ac36d1 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:45.908798 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b83945-1c7e-4d38-989b-0960095a5375 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:45.909195 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b83945-1c7e-4d38-989b-0960095a5375 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:45.910243 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b83945-1c7e-4d38-989b-0960095a5375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:45.917994 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1118/2247] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:45 2022] DELETE /identity/v3/users/a85e263136e64d8ea50c2b5dcfc84480 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:45.922569 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ccc7b-8558-4df3-b567-93a112df7374 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:45.923058 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ccc7b-8558-4df3-b567-93a112df7374 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:45.923703 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8ccc7b-8558-4df3-b567-93a112df7374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:45.936030 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-e6b83945-1c7e-4d38-989b-0960095a5375 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:45.937639 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-e6b83945-1c7e-4d38-989b-0960095a5375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:45.951764 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-1f8ccc7b-8558-4df3-b567-93a112df7374 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:45.955412 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-1f8ccc7b-8558-4df3-b567-93a112df7374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:46.028932 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1119/2248] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:46.039417 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ccc7b-8558-4df3-b567-93a112df7374 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:46.041030 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-1f8ccc7b-8558-4df3-b567-93a112df7374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:46.044279 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1130/2249] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:46.067406 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b83945-1c7e-4d38-989b-0960095a5375 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:46.070696 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-e6b83945-1c7e-4d38-989b-0960095a5375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:46.149890 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8ccc7b-8558-4df3-b567-93a112df7374 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:46.149890 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabf39a-6d74-4c74-b7d6-7fab9ebbf5c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:46.149890 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabf39a-6d74-4c74-b7d6-7fab9ebbf5c9 service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:46.149890 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabf39a-6d74-4c74-b7d6-7fab9ebbf5c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:46.150321 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabf39a-6d74-4c74-b7d6-7fab9ebbf5c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:46.164439 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aabf39a-6d74-4c74-b7d6-7fab9ebbf5c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:46.171447 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aabf39a-6d74-4c74-b7d6-7fab9ebbf5c9 service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:46.197430 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1120/2250] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:50:46.207944 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b83945-1c7e-4d38-989b-0960095a5375 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:46.212875 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc2062-0752-47f3-9851-025c14ed843c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:46.213593 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc2062-0752-47f3-9851-025c14ed843c service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:46.213871 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc2062-0752-47f3-9851-025c14ed843c service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:46.214183 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc2062-0752-47f3-9851-025c14ed843c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:46.226925 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc2062-0752-47f3-9851-025c14ed843c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:46.228394 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc2062-0752-47f3-9851-025c14ed843c service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:46.240201 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1131/2251] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:46.583590 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabf39a-6d74-4c74-b7d6-7fab9ebbf5c9 service neutron] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:46.585436 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-9aabf39a-6d74-4c74-b7d6-7fab9ebbf5c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:46.594187 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc2062-0752-47f3-9851-025c14ed843c service neutron] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:46.595946 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-03fc2062-0752-47f3-9851-025c14ed843c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:46.615472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabf39a-6d74-4c74-b7d6-7fab9ebbf5c9 service neutron] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:46.631196 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6cc894-ccef-4956-8f0a-569a37ec7f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:46.632213 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cc894-ccef-4956-8f0a-569a37ec7f2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:46.632437 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cc894-ccef-4956-8f0a-569a37ec7f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:46.632848 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6cc894-ccef-4956-8f0a-569a37ec7f2d admin admin] PATH_INFO: `/v3/projects/11695df20c0b4286a37d8e9beac747ef` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:46.635129 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6cc894-ccef-4956-8f0a-569a37ec7f2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=11695df20c0b4286a37d8e9beac747ef)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:46.640703 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6cc894-ccef-4956-8f0a-569a37ec7f2d admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:46.664761 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc2062-0752-47f3-9851-025c14ed843c service neutron] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:46.673640 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5774714-8522-482b-89ad-e8a9d9fbdf30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:46.674316 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5774714-8522-482b-89ad-e8a9d9fbdf30 service cinder] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:46.674596 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5774714-8522-482b-89ad-e8a9d9fbdf30 service cinder] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:46.674869 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5774714-8522-482b-89ad-e8a9d9fbdf30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:46.677480 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-c5774714-8522-482b-89ad-e8a9d9fbdf30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:46.719085 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:46.719886 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-9b6cc894-ccef-4956-8f0a-569a37ec7f2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11695df20c0b4286a37d8e9beac747ef', 'request_id': 'req-9b6cc894-ccef-4956-8f0a-569a37ec7f2d'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:46.730019 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-9b6cc894-ccef-4956-8f0a-569a37ec7f2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11695df20c0b4286a37d8e9beac747ef', 'request_id': 'req-9b6cc894-ccef-4956-8f0a-569a37ec7f2d'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:46.740299 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-9b6cc894-ccef-4956-8f0a-569a37ec7f2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11695df20c0b4286a37d8e9beac747ef', 'request_id': 'req-9b6cc894-ccef-4956-8f0a-569a37ec7f2d'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:46.753261 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-9b6cc894-ccef-4956-8f0a-569a37ec7f2d admin admin] The token cache is being invalidate because project 11695df20c0b4286a37d8e9beac747ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:46.753641 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-9b6cc894-ccef-4956-8f0a-569a37ec7f2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:46.754334 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-9b6cc894-ccef-4956-8f0a-569a37ec7f2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:46.756297 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1121/2252] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:46 2022] DELETE /identity/v3/projects/11695df20c0b4286a37d8e9beac747ef => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:46.757108 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6cc894-ccef-4956-8f0a-569a37ec7f2d admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:46.759410 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-9b6cc894-ccef-4956-8f0a-569a37ec7f2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:46.760416 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5774714-8522-482b-89ad-e8a9d9fbdf30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:46.762070 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5774714-8522-482b-89ad-e8a9d9fbdf30 service cinder] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:46.770089 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:46.774521 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1132/2253] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:50:46.775646 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27d3d0-87f3-4f50-9b56-e2cd6485dd74 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:46.775920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27d3d0-87f3-4f50-9b56-e2cd6485dd74 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:46.776194 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27d3d0-87f3-4f50-9b56-e2cd6485dd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:46.807352 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-4b27d3d0-87f3-4f50-9b56-e2cd6485dd74 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:46.808564 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-4b27d3d0-87f3-4f50-9b56-e2cd6485dd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:46.847407 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6cc894-ccef-4956-8f0a-569a37ec7f2d admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:46.852294 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35ca6d-685d-4855-a46a-87d5b458497b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:46.852932 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35ca6d-685d-4855-a46a-87d5b458497b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:46.853212 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35ca6d-685d-4855-a46a-87d5b458497b admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:46.853562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35ca6d-685d-4855-a46a-87d5b458497b admin admin] PATH_INFO: `/v3/projects/c36ef093f14e493392b1c86c2ab4fab7` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:46.854790 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35ca6d-685d-4855-a46a-87d5b458497b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c36ef093f14e493392b1c86c2ab4fab7)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:46.856856 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35ca6d-685d-4855-a46a-87d5b458497b admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:46.905481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1133/2254] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:46.914321 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-fb35ca6d-685d-4855-a46a-87d5b458497b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c36ef093f14e493392b1c86c2ab4fab7', 'request_id': 'req-fb35ca6d-685d-4855-a46a-87d5b458497b'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:46.920686 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef3a8b-d35f-4b0a-be56-5d9783361eff None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:46.920686 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef3a8b-d35f-4b0a-be56-5d9783361eff None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:46.921402 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef3a8b-d35f-4b0a-be56-5d9783361eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:46.926854 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-fb35ca6d-685d-4855-a46a-87d5b458497b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c36ef093f14e493392b1c86c2ab4fab7', 'request_id': 'req-fb35ca6d-685d-4855-a46a-87d5b458497b'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:46.939982 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-fb35ca6d-685d-4855-a46a-87d5b458497b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c36ef093f14e493392b1c86c2ab4fab7', 'request_id': 'req-fb35ca6d-685d-4855-a46a-87d5b458497b'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:46.954946 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-bdef3a8b-d35f-4b0a-be56-5d9783361eff None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:46.957641 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-bdef3a8b-d35f-4b0a-be56-5d9783361eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:46.961299 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-fb35ca6d-685d-4855-a46a-87d5b458497b admin admin] The token cache is being invalidate because project c36ef093f14e493392b1c86c2ab4fab7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:46.961727 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-fb35ca6d-685d-4855-a46a-87d5b458497b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:46.962772 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-fb35ca6d-685d-4855-a46a-87d5b458497b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:46.968433 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1122/2255] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:46 2022] DELETE /identity/v3/projects/c36ef093f14e493392b1c86c2ab4fab7 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:46.969641 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35ca6d-685d-4855-a46a-87d5b458497b admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:46.971203 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-fb35ca6d-685d-4855-a46a-87d5b458497b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:47.039694 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1134/2256] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:47.043767 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef3a8b-d35f-4b0a-be56-5d9783361eff None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:47.051146 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35ca6d-685d-4855-a46a-87d5b458497b admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:47.056247 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef3a8b-d35f-4b0a-be56-5d9783361eff None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:47.056707 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5b554-228d-41cd-b484-c95d505d79b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:47.057476 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5b554-228d-41cd-b484-c95d505d79b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:47.057799 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5b554-228d-41cd-b484-c95d505d79b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:47.058079 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5b554-228d-41cd-b484-c95d505d79b7 admin admin] PATH_INFO: `/v3/users/94a14473a0694ccc9dd59bbd536b63fd` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:47.059445 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5b554-228d-41cd-b484-c95d505d79b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94a14473a0694ccc9dd59bbd536b63fd)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:47.061504 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5b554-228d-41cd-b484-c95d505d79b7 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:47.062187 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda174d3-b5e5-4e63-ad9a-61b67f1f3883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:47.062762 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda174d3-b5e5-4e63-ad9a-61b67f1f3883 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:47.063055 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda174d3-b5e5-4e63-ad9a-61b67f1f3883 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:47.063401 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda174d3-b5e5-4e63-ad9a-61b67f1f3883 admin admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:47.064149 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda174d3-b5e5-4e63-ad9a-61b67f1f3883 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:47.064862 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda174d3-b5e5-4e63-ad9a-61b67f1f3883 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:47.066997 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda174d3-b5e5-4e63-ad9a-61b67f1f3883 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:47.091251 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1135/2257] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:50:47.092702 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda174d3-b5e5-4e63-ad9a-61b67f1f3883 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:47.111055 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda174d3-b5e5-4e63-ad9a-61b67f1f3883 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:47.116943 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be720cf-0a54-400c-94d1-a63ad9343372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:47.117726 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be720cf-0a54-400c-94d1-a63ad9343372 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:47.118006 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be720cf-0a54-400c-94d1-a63ad9343372 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:47.118272 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be720cf-0a54-400c-94d1-a63ad9343372 admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:47.118896 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be720cf-0a54-400c-94d1-a63ad9343372 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:47.120769 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:47.121096 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be720cf-0a54-400c-94d1-a63ad9343372 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:47.137319 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-b3b5b554-228d-41cd-b484-c95d505d79b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94a14473a0694ccc9dd59bbd536b63fd'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:47.139456 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-b3b5b554-228d-41cd-b484-c95d505d79b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94a14473a0694ccc9dd59bbd536b63fd'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:47.142611 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-b3b5b554-228d-41cd-b484-c95d505d79b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94a14473a0694ccc9dd59bbd536b63fd'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:47.172457 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1136/2258] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:47 2022] POST /identity/v3/projects => generated 371 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:50:47.177276 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be720cf-0a54-400c-94d1-a63ad9343372 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:47.180596 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-4be720cf-0a54-400c-94d1-a63ad9343372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:47.198639 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-b3b5b554-228d-41cd-b484-c95d505d79b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94a14473a0694ccc9dd59bbd536b63fd'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:47.215315 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-b3b5b554-228d-41cd-b484-c95d505d79b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94a14473a0694ccc9dd59bbd536b63fd'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:47.238812 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1123/2259] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:46 2022] DELETE /identity/v3/users/94a14473a0694ccc9dd59bbd536b63fd => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:50:47.264254 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:47.300525 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be720cf-0a54-400c-94d1-a63ad9343372 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:47.397062 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e4188-a2be-4883-ac2a-e27268e98380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:47.397762 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e4188-a2be-4883-ac2a-e27268e98380 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:47.398046 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e4188-a2be-4883-ac2a-e27268e98380 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:47.398659 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e4188-a2be-4883-ac2a-e27268e98380 admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:47.398962 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e4188-a2be-4883-ac2a-e27268e98380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:47.400978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e4188-a2be-4883-ac2a-e27268e98380 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:47.426028 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1137/2260] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:47 2022] POST /identity/v3/users => generated 286 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:47.430493 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5b554-228d-41cd-b484-c95d505d79b7 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:47.445165 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5b554-228d-41cd-b484-c95d505d79b7 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:47.451137 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db315c5c-f2b4-46f1-9b59-fd4f402c5756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:47.451806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db315c5c-f2b4-46f1-9b59-fd4f402c5756 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:47.452212 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db315c5c-f2b4-46f1-9b59-fd4f402c5756 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:47.452452 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db315c5c-f2b4-46f1-9b59-fd4f402c5756 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:47.453236 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db315c5c-f2b4-46f1-9b59-fd4f402c5756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:47.455198 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db315c5c-f2b4-46f1-9b59-fd4f402c5756 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:47.471185 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1124/2261] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:50:47.475741 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e4188-a2be-4883-ac2a-e27268e98380 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:47.487853 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e4188-a2be-4883-ac2a-e27268e98380 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:47.494526 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa11d79-35ed-4383-89af-cd3f54964f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:47.495327 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa11d79-35ed-4383-89af-cd3f54964f9e admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:47.495759 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa11d79-35ed-4383-89af-cd3f54964f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:47.496150 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa11d79-35ed-4383-89af-cd3f54964f9e admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:47.496852 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa11d79-35ed-4383-89af-cd3f54964f9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:47.498716 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa11d79-35ed-4383-89af-cd3f54964f9e admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:47.519042 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db315c5c-f2b4-46f1-9b59-fd4f402c5756 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:47.520028 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1138/2262] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:47.530570 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db315c5c-f2b4-46f1-9b59-fd4f402c5756 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:47.537107 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470f306-8227-405e-b129-dae8fdd73aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:47.537952 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470f306-8227-405e-b129-dae8fdd73aa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:47.538204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470f306-8227-405e-b129-dae8fdd73aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:47.538485 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9470f306-8227-405e-b129-dae8fdd73aa9 admin admin] PATH_INFO: `/v3/projects/e08891a3d0534bb791a5c4d492b1598a/users/b5c9dc6172654ed393a63ce65519975a/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:47.560055 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470f306-8227-405e-b129-dae8fdd73aa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e08891a3d0534bb791a5c4d492b1598a, user_id=b5c9dc6172654ed393a63ce65519975a, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:47.562931 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9470f306-8227-405e-b129-dae8fdd73aa9 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:47.581991 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1125/2263] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:47 2022] PUT /identity/v3/projects/e08891a3d0534bb791a5c4d492b1598a/users/b5c9dc6172654ed393a63ce65519975a/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:50:47.587827 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827101c-77c7-411a-946f-00f7564f398d None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:47.588118 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827101c-77c7-411a-946f-00f7564f398d None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:47.588391 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827101c-77c7-411a-946f-00f7564f398d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:47.595018 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470f306-8227-405e-b129-dae8fdd73aa9 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:47.597031 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-9470f306-8227-405e-b129-dae8fdd73aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:47.609839 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-8827101c-77c7-411a-946f-00f7564f398d None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:47.611523 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-8827101c-77c7-411a-946f-00f7564f398d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:47.674613 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9470f306-8227-405e-b129-dae8fdd73aa9 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:47.677633 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1139/2264] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:47.681632 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a46b9-ad65-498a-8a3b-3516c0b45617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:47.682553 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a46b9-ad65-498a-8a3b-3516c0b45617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:47.682966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a46b9-ad65-498a-8a3b-3516c0b45617 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:47.683369 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a46b9-ad65-498a-8a3b-3516c0b45617 admin admin] PATH_INFO: `/v3/projects/fad8abb4b8aa4bf9b3c0ec90dd09d527` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:47.685251 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418a46b9-ad65-498a-8a3b-3516c0b45617 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fad8abb4b8aa4bf9b3c0ec90dd09d527)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:47.688103 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827101c-77c7-411a-946f-00f7564f398d None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:47.688542 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418a46b9-ad65-498a-8a3b-3516c0b45617 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:47.689552 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-8827101c-77c7-411a-946f-00f7564f398d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:47.751529 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-418a46b9-ad65-498a-8a3b-3516c0b45617 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fad8abb4b8aa4bf9b3c0ec90dd09d527', 'request_id': 'req-418a46b9-ad65-498a-8a3b-3516c0b45617'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:47.761613 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-418a46b9-ad65-498a-8a3b-3516c0b45617 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fad8abb4b8aa4bf9b3c0ec90dd09d527', 'request_id': 'req-418a46b9-ad65-498a-8a3b-3516c0b45617'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:47.762210 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827101c-77c7-411a-946f-00f7564f398d None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:47.768094 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-418a46b9-ad65-498a-8a3b-3516c0b45617 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fad8abb4b8aa4bf9b3c0ec90dd09d527', 'request_id': 'req-418a46b9-ad65-498a-8a3b-3516c0b45617'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:47.778141 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:47.778268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-418a46b9-ad65-498a-8a3b-3516c0b45617 admin admin] The token cache is being invalidate because project fad8abb4b8aa4bf9b3c0ec90dd09d527 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:47.778553 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-418a46b9-ad65-498a-8a3b-3516c0b45617 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:47.779239 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-418a46b9-ad65-498a-8a3b-3516c0b45617 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:47.781072 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1126/2265] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:47 2022] DELETE /identity/v3/projects/fad8abb4b8aa4bf9b3c0ec90dd09d527 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:47.785923 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8672b0-7b73-4e26-a5bb-32473963b766 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:47.786207 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8672b0-7b73-4e26-a5bb-32473963b766 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:47.786482 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8672b0-7b73-4e26-a5bb-32473963b766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:47.808395 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-9b8672b0-7b73-4e26-a5bb-32473963b766 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:47.809761 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-9b8672b0-7b73-4e26-a5bb-32473963b766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:47.811318 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24416032-b302-447e-a36a-97c5e9a41050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:47.811940 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24416032-b302-447e-a36a-97c5e9a41050 service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:47.812222 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24416032-b302-447e-a36a-97c5e9a41050 service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:47.812497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24416032-b302-447e-a36a-97c5e9a41050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:47.814251 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-24416032-b302-447e-a36a-97c5e9a41050 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:47.818420 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:47.873893 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1127/2266] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:50:47.879150 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24416032-b302-447e-a36a-97c5e9a41050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:47.880590 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24416032-b302-447e-a36a-97c5e9a41050 service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:47.881993 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446c7f3-327a-41fe-b94b-90b79ce64cf9 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:47.882275 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446c7f3-327a-41fe-b94b-90b79ce64cf9 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:47.882547 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446c7f3-327a-41fe-b94b-90b79ce64cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:47.890482 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1140/2267] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:50:47.905418 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-6446c7f3-327a-41fe-b94b-90b79ce64cf9 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:47.906649 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-6446c7f3-327a-41fe-b94b-90b79ce64cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:47.916594 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1128/2268] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:50:47.921046 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24416032-b302-447e-a36a-97c5e9a41050 service neutron] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:47.931102 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24416032-b302-447e-a36a-97c5e9a41050 service neutron] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:47.936662 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d950a-aacc-456a-9fbd-66bd6840bee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:47.937281 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d950a-aacc-456a-9fbd-66bd6840bee5 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:47.937588 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d950a-aacc-456a-9fbd-66bd6840bee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:47.937966 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d950a-aacc-456a-9fbd-66bd6840bee5 admin admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:47.938618 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d950a-aacc-456a-9fbd-66bd6840bee5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:47.938921 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d950a-aacc-456a-9fbd-66bd6840bee5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:47.940535 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d950a-aacc-456a-9fbd-66bd6840bee5 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:47.955772 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1141/2269] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:47.960111 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446c7f3-327a-41fe-b94b-90b79ce64cf9 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:47.969930 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446c7f3-327a-41fe-b94b-90b79ce64cf9 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:47.975514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec2a80-5cac-4e7a-b471-4091842fff6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:47.976156 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec2a80-5cac-4e7a-b471-4091842fff6a admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:47.976436 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec2a80-5cac-4e7a-b471-4091842fff6a admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:47.976755 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec2a80-5cac-4e7a-b471-4091842fff6a admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:47.977425 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec2a80-5cac-4e7a-b471-4091842fff6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:47.979353 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec2a80-5cac-4e7a-b471-4091842fff6a admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:48.019012 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1129/2270] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:47 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:48.024473 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d950a-aacc-456a-9fbd-66bd6840bee5 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:48.037369 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d950a-aacc-456a-9fbd-66bd6840bee5 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:48.114403 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ce293-3670-4b0f-86c6-aa3d2bd16c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:48.115285 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ce293-3670-4b0f-86c6-aa3d2bd16c97 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:48.115563 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ce293-3670-4b0f-86c6-aa3d2bd16c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:48.115836 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ce293-3670-4b0f-86c6-aa3d2bd16c97 admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:48.116521 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ce293-3670-4b0f-86c6-aa3d2bd16c97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:48.119082 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ce293-3670-4b0f-86c6-aa3d2bd16c97 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:48.143792 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1142/2271] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:48 2022] POST /identity/v3/users => generated 291 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:48.147980 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec2a80-5cac-4e7a-b471-4091842fff6a admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:48.162889 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec2a80-5cac-4e7a-b471-4091842fff6a admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:48.172604 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca546abd-29ee-4285-b5d7-d6f30748ea3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:48.173517 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca546abd-29ee-4285-b5d7-d6f30748ea3d admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:48.173879 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca546abd-29ee-4285-b5d7-d6f30748ea3d admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:48.174942 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca546abd-29ee-4285-b5d7-d6f30748ea3d admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:48.175306 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca546abd-29ee-4285-b5d7-d6f30748ea3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:48.177254 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca546abd-29ee-4285-b5d7-d6f30748ea3d admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:48.195327 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1130/2272] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:48.197009 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ce293-3670-4b0f-86c6-aa3d2bd16c97 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:48.209464 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ce293-3670-4b0f-86c6-aa3d2bd16c97 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:48.217441 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49005384-6b72-4c10-b80f-6a4d9c539460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:48.218574 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49005384-6b72-4c10-b80f-6a4d9c539460 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:48.219584 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49005384-6b72-4c10-b80f-6a4d9c539460 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:48.220054 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49005384-6b72-4c10-b80f-6a4d9c539460 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:48.221010 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49005384-6b72-4c10-b80f-6a4d9c539460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:48.223522 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49005384-6b72-4c10-b80f-6a4d9c539460 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:48.243886 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1143/2273] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:48.245252 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca546abd-29ee-4285-b5d7-d6f30748ea3d admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:48.258605 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca546abd-29ee-4285-b5d7-d6f30748ea3d admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:48.264321 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408c783-24e5-4414-b2f0-c24938ea0ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:48.265450 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408c783-24e5-4414-b2f0-c24938ea0ea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:48.265709 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408c783-24e5-4414-b2f0-c24938ea0ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:48.266158 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408c783-24e5-4414-b2f0-c24938ea0ea6 admin admin] PATH_INFO: `/v3/projects/8aa83c3d34b84270a21a758eacc41cf5/users/27ee0b097eb74e9dbd378da9817a0692/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:48.284133 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408c783-24e5-4414-b2f0-c24938ea0ea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aa83c3d34b84270a21a758eacc41cf5, user_id=27ee0b097eb74e9dbd378da9817a0692, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:48.287476 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408c783-24e5-4414-b2f0-c24938ea0ea6 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:48.318857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1131/2274] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:48 2022] PUT /identity/v3/projects/8aa83c3d34b84270a21a758eacc41cf5/users/27ee0b097eb74e9dbd378da9817a0692/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:48.330026 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb7767-8edb-42af-807a-dc647028ab77 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:48.330399 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb7767-8edb-42af-807a-dc647028ab77 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:48.330761 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb7767-8edb-42af-807a-dc647028ab77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:48.369926 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-f0bb7767-8edb-42af-807a-dc647028ab77 None None] MFA Rules not processed for user `27ee0b097eb74e9dbd378da9817a0692`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:48.371281 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-f0bb7767-8edb-42af-807a-dc647028ab77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:48.429537 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:48.493564 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1144/2275] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:48.498537 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408c783-24e5-4414-b2f0-c24938ea0ea6 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:48.647858 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408c783-24e5-4414-b2f0-c24938ea0ea6 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:48.658391 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371647c2-584b-4f07-b8b4-ba863a8b4e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:48.659072 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371647c2-584b-4f07-b8b4-ba863a8b4e9d admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:48.659507 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371647c2-584b-4f07-b8b4-ba863a8b4e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:48.659636 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371647c2-584b-4f07-b8b4-ba863a8b4e9d admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:48.660421 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371647c2-584b-4f07-b8b4-ba863a8b4e9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:48.662645 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371647c2-584b-4f07-b8b4-ba863a8b4e9d admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:48.704471 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c7671-1276-4388-b0ac-26793b09bdca None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:48.704921 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c7671-1276-4388-b0ac-26793b09bdca None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:48.705118 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c7671-1276-4388-b0ac-26793b09bdca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:48.727584 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1132/2276] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:48 2022] POST /identity/v3/projects => generated 379 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:50:48.729582 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371647c2-584b-4f07-b8b4-ba863a8b4e9d admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:48.749260 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-1b0c7671-1276-4388-b0ac-26793b09bdca None None] MFA Rules not processed for user `b5c9dc6172654ed393a63ce65519975a`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:48.751503 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-1b0c7671-1276-4388-b0ac-26793b09bdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:48.788679 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:48.829540 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371647c2-584b-4f07-b8b4-ba863a8b4e9d admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:48.837643 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350c4c6-90fc-490c-aec7-00a9b90a5162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:48.838597 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350c4c6-90fc-490c-aec7-00a9b90a5162 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:48.839045 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350c4c6-90fc-490c-aec7-00a9b90a5162 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:48.839337 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350c4c6-90fc-490c-aec7-00a9b90a5162 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:48.848790 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350c4c6-90fc-490c-aec7-00a9b90a5162 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:48.848790 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350c4c6-90fc-490c-aec7-00a9b90a5162 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:48.874423 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1145/2277] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:48.875751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c7671-1276-4388-b0ac-26793b09bdca None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:48.879948 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1133/2278] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:48 2022] POST /identity/v3/users => generated 296 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:50:48.881860 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-1b0c7671-1276-4388-b0ac-26793b09bdca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:48.882514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350c4c6-90fc-490c-aec7-00a9b90a5162 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:48.901502 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350c4c6-90fc-490c-aec7-00a9b90a5162 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:48.908304 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c85a3f-1681-4c1a-8377-8c19be08b9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:48.909202 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c85a3f-1681-4c1a-8377-8c19be08b9cd admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:48.909664 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c85a3f-1681-4c1a-8377-8c19be08b9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:48.910237 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c85a3f-1681-4c1a-8377-8c19be08b9cd admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:48.910904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c85a3f-1681-4c1a-8377-8c19be08b9cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:48.913047 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c85a3f-1681-4c1a-8377-8c19be08b9cd admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:48.928951 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1134/2279] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:50:48.930222 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c85a3f-1681-4c1a-8377-8c19be08b9cd admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:48.942045 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c85a3f-1681-4c1a-8377-8c19be08b9cd admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:48.947898 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63593c4e-8b2e-468d-87b8-38d70b97a9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:48.949627 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63593c4e-8b2e-468d-87b8-38d70b97a9a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:48.949840 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63593c4e-8b2e-468d-87b8-38d70b97a9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:48.951268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63593c4e-8b2e-468d-87b8-38d70b97a9a2 admin admin] PATH_INFO: `/v3/projects/1002689eff044f0191c16b157ce3d1bb/users/6ed4a5c865b9438f85aa16e2c5a70360/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:48.958628 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c7671-1276-4388-b0ac-26793b09bdca None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:48.964756 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784c650-b2d3-4142-8c52-065088c689e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:48.965447 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784c650-b2d3-4142-8c52-065088c689e9 service cinder] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:48.965685 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784c650-b2d3-4142-8c52-065088c689e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:48.965962 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784c650-b2d3-4142-8c52-065088c689e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:48.974770 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63593c4e-8b2e-468d-87b8-38d70b97a9a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1002689eff044f0191c16b157ce3d1bb, user_id=6ed4a5c865b9438f85aa16e2c5a70360, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:48.975077 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784c650-b2d3-4142-8c52-065088c689e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:48.976524 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784c650-b2d3-4142-8c52-065088c689e9 service cinder] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:48.978043 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63593c4e-8b2e-468d-87b8-38d70b97a9a2 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:48.988107 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1146/2280] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:49.001452 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1135/2281] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:48 2022] PUT /identity/v3/projects/1002689eff044f0191c16b157ce3d1bb/users/6ed4a5c865b9438f85aa16e2c5a70360/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:49.014590 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784c650-b2d3-4142-8c52-065088c689e9 service cinder] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:49.026659 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784c650-b2d3-4142-8c52-065088c689e9 service cinder] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:49.114343 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:49.121978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e76ac5-58d5-4596-b118-098bde01c104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:49.122585 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e76ac5-58d5-4596-b118-098bde01c104 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:49.123090 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e76ac5-58d5-4596-b118-098bde01c104 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:49.123363 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e76ac5-58d5-4596-b118-098bde01c104 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:49.124051 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e76ac5-58d5-4596-b118-098bde01c104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:49.125756 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e76ac5-58d5-4596-b118-098bde01c104 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:49.136531 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1147/2282] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:50:49.140763 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63593c4e-8b2e-468d-87b8-38d70b97a9a2 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:49.152165 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63593c4e-8b2e-468d-87b8-38d70b97a9a2 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:49.158719 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd62c60-a649-42fd-90c7-e5bcaf4d1720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:49.159595 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd62c60-a649-42fd-90c7-e5bcaf4d1720 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:49.159947 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd62c60-a649-42fd-90c7-e5bcaf4d1720 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:49.160296 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd62c60-a649-42fd-90c7-e5bcaf4d1720 admin admin] PATH_INFO: `/v3/projects/1002689eff044f0191c16b157ce3d1bb/users/6ed4a5c865b9438f85aa16e2c5a70360/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:49.163438 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd62c60-a649-42fd-90c7-e5bcaf4d1720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1002689eff044f0191c16b157ce3d1bb, user_id=6ed4a5c865b9438f85aa16e2c5a70360, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:49.166276 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd62c60-a649-42fd-90c7-e5bcaf4d1720 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:49.178097 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1136/2283] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:49 2022] PUT /identity/v3/projects/1002689eff044f0191c16b157ce3d1bb/users/6ed4a5c865b9438f85aa16e2c5a70360/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:50:49.190822 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac9eef-8b06-40ae-b46e-38f4a2e36e66 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:49.191137 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac9eef-8b06-40ae-b46e-38f4a2e36e66 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:49.191416 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac9eef-8b06-40ae-b46e-38f4a2e36e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:49.220810 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-28ac9eef-8b06-40ae-b46e-38f4a2e36e66 None None] MFA Rules not processed for user `6ed4a5c865b9438f85aa16e2c5a70360`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:49.222141 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-28ac9eef-8b06-40ae-b46e-38f4a2e36e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:49.301290 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1148/2284] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:49 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:49.314657 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd62c60-a649-42fd-90c7-e5bcaf4d1720 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:49.316701 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-7dd62c60-a649-42fd-90c7-e5bcaf4d1720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:49.387325 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd62c60-a649-42fd-90c7-e5bcaf4d1720 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:49.391962 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd0726-369e-4206-9aa7-52246fdb87b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:49.392717 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd0726-369e-4206-9aa7-52246fdb87b5 service cinder] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:49.392998 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd0726-369e-4206-9aa7-52246fdb87b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:49.393265 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd0726-369e-4206-9aa7-52246fdb87b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:49.403495 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd0726-369e-4206-9aa7-52246fdb87b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:49.404977 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dd0726-369e-4206-9aa7-52246fdb87b5 service cinder] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:49.417185 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1137/2285] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:49.816033 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac9eef-8b06-40ae-b46e-38f4a2e36e66 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:49.827046 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac9eef-8b06-40ae-b46e-38f4a2e36e66 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:49.832571 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb553b-8345-47e8-97ae-28435995ed6c tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4a5c865b9438f85aa16e2c5a70360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1002689eff044f0191c16b157ce3d1bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:49.833508 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb553b-8345-47e8-97ae-28435995ed6c tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:49.834144 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb553b-8345-47e8-97ae-28435995ed6c tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:49.834629 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bb553b-8345-47e8-97ae-28435995ed6c tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:49.837649 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb553b-8345-47e8-97ae-28435995ed6c tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:49.838109 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb553b-8345-47e8-97ae-28435995ed6c tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:49.839948 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bb553b-8345-47e8-97ae-28435995ed6c tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:49.853817 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1149/2286] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:49.858401 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd0726-369e-4206-9aa7-52246fdb87b5 service cinder] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:49.867952 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd0726-369e-4206-9aa7-52246fdb87b5 service cinder] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:49.873956 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08751ca-6b50-483c-955d-4aea19b80de2 tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4a5c865b9438f85aa16e2c5a70360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1002689eff044f0191c16b157ce3d1bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:49.874444 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08751ca-6b50-483c-955d-4aea19b80de2 tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:49.874728 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08751ca-6b50-483c-955d-4aea19b80de2 tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:49.874998 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08751ca-6b50-483c-955d-4aea19b80de2 tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:49.875634 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08751ca-6b50-483c-955d-4aea19b80de2 tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:49.878025 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08751ca-6b50-483c-955d-4aea19b80de2 tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:49.912270 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1138/2287] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:49 2022] POST /identity/v3/projects => generated 354 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:50:49.916481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb553b-8345-47e8-97ae-28435995ed6c tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:49.927137 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bb553b-8345-47e8-97ae-28435995ed6c tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:49.991313 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f97565-de34-453b-ae47-7d6c5f55c1c2 tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4a5c865b9438f85aa16e2c5a70360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1002689eff044f0191c16b157ce3d1bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:49.991926 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f97565-de34-453b-ae47-7d6c5f55c1c2 tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:49.992206 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f97565-de34-453b-ae47-7d6c5f55c1c2 tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:49.992480 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f97565-de34-453b-ae47-7d6c5f55c1c2 tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:49.993131 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f97565-de34-453b-ae47-7d6c5f55c1c2 tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:49.993469 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f97565-de34-453b-ae47-7d6c5f55c1c2 tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:49.995067 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f97565-de34-453b-ae47-7d6c5f55c1c2 tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:50.007233 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1150/2288] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:50:50.050585 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08751ca-6b50-483c-955d-4aea19b80de2 tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:50.062511 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08751ca-6b50-483c-955d-4aea19b80de2 tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:50.069005 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38cdbb-c27b-4959-9c39-04feee6b4566 tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ed4a5c865b9438f85aa16e2c5a70360', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1002689eff044f0191c16b157ce3d1bb', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:50.069764 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38cdbb-c27b-4959-9c39-04feee6b4566 tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:50.070085 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38cdbb-c27b-4959-9c39-04feee6b4566 tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:50.070333 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38cdbb-c27b-4959-9c39-04feee6b4566 tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] PATH_INFO: `/v3/projects/69b78b10ad304954ad2d4bec26688d78` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:50.071533 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38cdbb-c27b-4959-9c39-04feee6b4566 tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] RBAC: Authorizing `identity:delete_project(project_id=69b78b10ad304954ad2d4bec26688d78)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:50.073640 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38cdbb-c27b-4959-9c39-04feee6b4566 tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:50.146951 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-db38cdbb-c27b-4959-9c39-04feee6b4566 tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69b78b10ad304954ad2d4bec26688d78', 'request_id': 'req-db38cdbb-c27b-4959-9c39-04feee6b4566'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:50.149866 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=89,keystone:INSERT=7,keystone:DELETE=4 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:50.157452 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-db38cdbb-c27b-4959-9c39-04feee6b4566 tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69b78b10ad304954ad2d4bec26688d78', 'request_id': 'req-db38cdbb-c27b-4959-9c39-04feee6b4566'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:50.166470 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-db38cdbb-c27b-4959-9c39-04feee6b4566 tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69b78b10ad304954ad2d4bec26688d78', 'request_id': 'req-db38cdbb-c27b-4959-9c39-04feee6b4566'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:50.181455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-db38cdbb-c27b-4959-9c39-04feee6b4566 tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] The token cache is being invalidate because project 69b78b10ad304954ad2d4bec26688d78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:50.181777 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-db38cdbb-c27b-4959-9c39-04feee6b4566 tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:50.182410 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-db38cdbb-c27b-4959-9c39-04feee6b4566 tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:50.183952 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1139/2289] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:50 2022] DELETE /identity/v3/projects/69b78b10ad304954ad2d4bec26688d78 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:50.403128 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f97565-de34-453b-ae47-7d6c5f55c1c2 tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:50.404896 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-89f97565-de34-453b-ae47-7d6c5f55c1c2 tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:50.421928 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4828a01-536d-484e-a50d-7eddfe7659b8 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:50.422163 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4828a01-536d-484e-a50d-7eddfe7659b8 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:50.422442 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4828a01-536d-484e-a50d-7eddfe7659b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:50.441488 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-a4828a01-536d-484e-a50d-7eddfe7659b8 None None] MFA Rules not processed for user `b5c9dc6172654ed393a63ce65519975a`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:50.442715 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-a4828a01-536d-484e-a50d-7eddfe7659b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:50.489555 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f97565-de34-453b-ae47-7d6c5f55c1c2 tempest-VolumeQuotaClassesTest-340873406 tempest-VolumeQuotaClassesTest-340873406-project-admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:50.495110 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:50.518860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1140/2290] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:50.519763 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4828a01-536d-484e-a50d-7eddfe7659b8 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:50.521103 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-a4828a01-536d-484e-a50d-7eddfe7659b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:50.567618 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d752a823-d861-4706-b52c-cb4acd8e0fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:50.568521 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752a823-d861-4706-b52c-cb4acd8e0fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:50.568805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752a823-d861-4706-b52c-cb4acd8e0fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:50.569117 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752a823-d861-4706-b52c-cb4acd8e0fe2 admin admin] PATH_INFO: `/v3/users/27ee0b097eb74e9dbd378da9817a0692` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:50.570334 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d752a823-d861-4706-b52c-cb4acd8e0fe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27ee0b097eb74e9dbd378da9817a0692)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:50.572278 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d752a823-d861-4706-b52c-cb4acd8e0fe2 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:50.601518 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4828a01-536d-484e-a50d-7eddfe7659b8 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:50.609027 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fadea00-23f5-400c-9997-5df2c7d753f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:50.609724 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadea00-23f5-400c-9997-5df2c7d753f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:50.610063 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadea00-23f5-400c-9997-5df2c7d753f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:50.610366 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadea00-23f5-400c-9997-5df2c7d753f9 admin admin] PATH_INFO: `/v3/users/2a2f0128458b4807af771d5ae2ca8694` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:50.613600 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fadea00-23f5-400c-9997-5df2c7d753f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a2f0128458b4807af771d5ae2ca8694)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:50.619632 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fadea00-23f5-400c-9997-5df2c7d753f9 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:50.640345 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-d752a823-d861-4706-b52c-cb4acd8e0fe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27ee0b097eb74e9dbd378da9817a0692'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:50.641465 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-d752a823-d861-4706-b52c-cb4acd8e0fe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27ee0b097eb74e9dbd378da9817a0692'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:50.642805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-d752a823-d861-4706-b52c-cb4acd8e0fe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27ee0b097eb74e9dbd378da9817a0692'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:50.666094 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-d752a823-d861-4706-b52c-cb4acd8e0fe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27ee0b097eb74e9dbd378da9817a0692'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:50.675775 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-d752a823-d861-4706-b52c-cb4acd8e0fe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27ee0b097eb74e9dbd378da9817a0692'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:50.687006 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-4fadea00-23f5-400c-9997-5df2c7d753f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a2f0128458b4807af771d5ae2ca8694'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:50.687749 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-4fadea00-23f5-400c-9997-5df2c7d753f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a2f0128458b4807af771d5ae2ca8694'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:50.688393 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-4fadea00-23f5-400c-9997-5df2c7d753f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a2f0128458b4807af771d5ae2ca8694'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:50.688992 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1151/2291] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:50 2022] DELETE /identity/v3/users/27ee0b097eb74e9dbd378da9817a0692 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:50:50.693687 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5507c2-9692-420d-864d-703707f4efba None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:50.693998 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5507c2-9692-420d-864d-703707f4efba None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:50.694311 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5507c2-9692-420d-864d-703707f4efba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:50.707381 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-4fadea00-23f5-400c-9997-5df2c7d753f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a2f0128458b4807af771d5ae2ca8694'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:50.716598 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-4fadea00-23f5-400c-9997-5df2c7d753f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a2f0128458b4807af771d5ae2ca8694'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:50.717303 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-3c5507c2-9692-420d-864d-703707f4efba None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:50.718564 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-3c5507c2-9692-420d-864d-703707f4efba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:50.731223 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1141/2292] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:50 2022] DELETE /identity/v3/users/2a2f0128458b4807af771d5ae2ca8694 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:50.795890 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1152/2293] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:50:50.814157 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fadea00-23f5-400c-9997-5df2c7d753f9 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:50.815641 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-4fadea00-23f5-400c-9997-5df2c7d753f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:50.822516 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:50.901477 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fadea00-23f5-400c-9997-5df2c7d753f9 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:50.907291 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980f718-26bd-4a53-8869-fa66956647f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:50.908027 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980f718-26bd-4a53-8869-fa66956647f0 service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:50.908467 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980f718-26bd-4a53-8869-fa66956647f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:50.908837 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980f718-26bd-4a53-8869-fa66956647f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:50.986978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5507c2-9692-420d-864d-703707f4efba None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:50.998387 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-3c5507c2-9692-420d-864d-703707f4efba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:51.018879 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980f718-26bd-4a53-8869-fa66956647f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:51.020656 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980f718-26bd-4a53-8869-fa66956647f0 service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:51.033058 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1142/2294] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:51.048115 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5507c2-9692-420d-864d-703707f4efba None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:51.054570 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a8b441-0dea-4e80-b28c-62905919dce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:51.055223 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8b441-0dea-4e80-b28c-62905919dce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:51.055524 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8b441-0dea-4e80-b28c-62905919dce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:51.056474 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8b441-0dea-4e80-b28c-62905919dce7 admin admin] PATH_INFO: `/v3/projects/d0d39424aef74199960476ab0058c0a9` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:51.058249 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a8b441-0dea-4e80-b28c-62905919dce7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0d39424aef74199960476ab0058c0a9)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:51.062065 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a8b441-0dea-4e80-b28c-62905919dce7 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:51.096800 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:51.167129 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b0a8b441-0dea-4e80-b28c-62905919dce7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0d39424aef74199960476ab0058c0a9', 'request_id': 'req-b0a8b441-0dea-4e80-b28c-62905919dce7'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:51.187633 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b0a8b441-0dea-4e80-b28c-62905919dce7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0d39424aef74199960476ab0058c0a9', 'request_id': 'req-b0a8b441-0dea-4e80-b28c-62905919dce7'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:51.199499 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b0a8b441-0dea-4e80-b28c-62905919dce7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0d39424aef74199960476ab0058c0a9', 'request_id': 'req-b0a8b441-0dea-4e80-b28c-62905919dce7'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:51.214930 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b0a8b441-0dea-4e80-b28c-62905919dce7 admin admin] The token cache is being invalidate because project d0d39424aef74199960476ab0058c0a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:51.215203 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b0a8b441-0dea-4e80-b28c-62905919dce7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:51.216378 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b0a8b441-0dea-4e80-b28c-62905919dce7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:51.224342 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1153/2295] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:50 2022] DELETE /identity/v3/projects/d0d39424aef74199960476ab0058c0a9 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:51.230407 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980f718-26bd-4a53-8869-fa66956647f0 service neutron] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:51.254879 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980f718-26bd-4a53-8869-fa66956647f0 service neutron] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:51.357432 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d6c17-ed07-46c7-aa9b-fbd40946c230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:51.358134 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d6c17-ed07-46c7-aa9b-fbd40946c230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:51.358413 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d6c17-ed07-46c7-aa9b-fbd40946c230 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:51.358680 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d6c17-ed07-46c7-aa9b-fbd40946c230 admin admin] PATH_INFO: `/v3/users/cab591d907b54cb8b2cbdb13627a242b` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:51.361588 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d6c17-ed07-46c7-aa9b-fbd40946c230 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cab591d907b54cb8b2cbdb13627a242b)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:51.364764 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d6c17-ed07-46c7-aa9b-fbd40946c230 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:51.458047 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-879d6c17-ed07-46c7-aa9b-fbd40946c230 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cab591d907b54cb8b2cbdb13627a242b'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:51.458846 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-879d6c17-ed07-46c7-aa9b-fbd40946c230 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cab591d907b54cb8b2cbdb13627a242b'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:51.459624 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-879d6c17-ed07-46c7-aa9b-fbd40946c230 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cab591d907b54cb8b2cbdb13627a242b'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:51.465511 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a8b441-0dea-4e80-b28c-62905919dce7 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:51.467053 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-b0a8b441-0dea-4e80-b28c-62905919dce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:51.481015 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:51.486421 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a8b441-0dea-4e80-b28c-62905919dce7 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:51.495411 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d836bc-77cc-47d7-8d3b-2a753374605e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:51.496169 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d836bc-77cc-47d7-8d3b-2a753374605e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:51.496532 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d836bc-77cc-47d7-8d3b-2a753374605e admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:51.496908 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d836bc-77cc-47d7-8d3b-2a753374605e admin admin] PATH_INFO: `/v3/projects/8aa83c3d34b84270a21a758eacc41cf5` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:51.498204 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d836bc-77cc-47d7-8d3b-2a753374605e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aa83c3d34b84270a21a758eacc41cf5)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:51.506043 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d836bc-77cc-47d7-8d3b-2a753374605e admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:51.506150 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-879d6c17-ed07-46c7-aa9b-fbd40946c230 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cab591d907b54cb8b2cbdb13627a242b'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:51.521373 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-879d6c17-ed07-46c7-aa9b-fbd40946c230 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cab591d907b54cb8b2cbdb13627a242b'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:51.540593 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1143/2296] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:51 2022] DELETE /identity/v3/users/cab591d907b54cb8b2cbdb13627a242b => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:51.577922 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-84d836bc-77cc-47d7-8d3b-2a753374605e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aa83c3d34b84270a21a758eacc41cf5', 'request_id': 'req-84d836bc-77cc-47d7-8d3b-2a753374605e'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:51.586288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-84d836bc-77cc-47d7-8d3b-2a753374605e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aa83c3d34b84270a21a758eacc41cf5', 'request_id': 'req-84d836bc-77cc-47d7-8d3b-2a753374605e'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:51.597154 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-84d836bc-77cc-47d7-8d3b-2a753374605e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aa83c3d34b84270a21a758eacc41cf5', 'request_id': 'req-84d836bc-77cc-47d7-8d3b-2a753374605e'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:51.612582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-84d836bc-77cc-47d7-8d3b-2a753374605e admin admin] The token cache is being invalidate because project 8aa83c3d34b84270a21a758eacc41cf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:51.612867 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-84d836bc-77cc-47d7-8d3b-2a753374605e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:51.613553 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-84d836bc-77cc-47d7-8d3b-2a753374605e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:51.615404 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1154/2297] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:51 2022] DELETE /identity/v3/projects/8aa83c3d34b84270a21a758eacc41cf5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:51.619416 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d6c17-ed07-46c7-aa9b-fbd40946c230 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:51.621525 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-879d6c17-ed07-46c7-aa9b-fbd40946c230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:51.711948 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d6c17-ed07-46c7-aa9b-fbd40946c230 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:51.756193 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d836bc-77cc-47d7-8d3b-2a753374605e admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:51.758645 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-84d836bc-77cc-47d7-8d3b-2a753374605e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:51.816026 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8adcb0d-e2d2-4cdb-a07d-d326f2a40dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:51.817215 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adcb0d-e2d2-4cdb-a07d-d326f2a40dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:51.817624 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adcb0d-e2d2-4cdb-a07d-d326f2a40dda admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:51.818025 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8adcb0d-e2d2-4cdb-a07d-d326f2a40dda admin admin] PATH_INFO: `/v3/users/6ed4a5c865b9438f85aa16e2c5a70360` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:51.819997 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8adcb0d-e2d2-4cdb-a07d-d326f2a40dda admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ed4a5c865b9438f85aa16e2c5a70360)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:51.822507 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8adcb0d-e2d2-4cdb-a07d-d326f2a40dda admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:51.860775 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d836bc-77cc-47d7-8d3b-2a753374605e admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:51.866532 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4662f70-46d4-4731-b2ca-ddb298c4058c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:51.867691 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4662f70-46d4-4731-b2ca-ddb298c4058c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:51.868350 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4662f70-46d4-4731-b2ca-ddb298c4058c admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:51.868661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4662f70-46d4-4731-b2ca-ddb298c4058c admin admin] PATH_INFO: `/v3/projects/dcd8377e7d4542fd9c55b771fb3d26b8` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:51.870015 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4662f70-46d4-4731-b2ca-ddb298c4058c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcd8377e7d4542fd9c55b771fb3d26b8)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:51.871944 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4662f70-46d4-4731-b2ca-ddb298c4058c admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:51.875397 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-e8adcb0d-e2d2-4cdb-a07d-d326f2a40dda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ed4a5c865b9438f85aa16e2c5a70360'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:51.876069 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-e8adcb0d-e2d2-4cdb-a07d-d326f2a40dda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ed4a5c865b9438f85aa16e2c5a70360'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:51.876689 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-e8adcb0d-e2d2-4cdb-a07d-d326f2a40dda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ed4a5c865b9438f85aa16e2c5a70360'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:51.891234 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-e8adcb0d-e2d2-4cdb-a07d-d326f2a40dda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ed4a5c865b9438f85aa16e2c5a70360'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:51.902223 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-e8adcb0d-e2d2-4cdb-a07d-d326f2a40dda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ed4a5c865b9438f85aa16e2c5a70360'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:51.915265 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:51.919211 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:51.926125 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1144/2298] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:51 2022] DELETE /identity/v3/users/6ed4a5c865b9438f85aa16e2c5a70360 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:51.942420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-d4662f70-46d4-4731-b2ca-ddb298c4058c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcd8377e7d4542fd9c55b771fb3d26b8', 'request_id': 'req-d4662f70-46d4-4731-b2ca-ddb298c4058c'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:51.950773 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-d4662f70-46d4-4731-b2ca-ddb298c4058c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcd8377e7d4542fd9c55b771fb3d26b8', 'request_id': 'req-d4662f70-46d4-4731-b2ca-ddb298c4058c'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:51.960570 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-d4662f70-46d4-4731-b2ca-ddb298c4058c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcd8377e7d4542fd9c55b771fb3d26b8', 'request_id': 'req-d4662f70-46d4-4731-b2ca-ddb298c4058c'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:51.977016 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-d4662f70-46d4-4731-b2ca-ddb298c4058c admin admin] The token cache is being invalidate because project dcd8377e7d4542fd9c55b771fb3d26b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:51.977960 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-d4662f70-46d4-4731-b2ca-ddb298c4058c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:51.978729 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-d4662f70-46d4-4731-b2ca-ddb298c4058c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:51.980968 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1155/2299] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:51 2022] DELETE /identity/v3/projects/dcd8377e7d4542fd9c55b771fb3d26b8 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:51.987559 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37819412-7d69-4847-ba11-744c977b9f60 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:51.987855 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37819412-7d69-4847-ba11-744c977b9f60 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:51.988131 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37819412-7d69-4847-ba11-744c977b9f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:52.011219 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-37819412-7d69-4847-ba11-744c977b9f60 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:52.012780 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-37819412-7d69-4847-ba11-744c977b9f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:52.098144 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1145/2300] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:52.106926 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af8363-bf73-4513-b0a9-a9c876652232 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:52.107492 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af8363-bf73-4513-b0a9-a9c876652232 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:52.107605 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af8363-bf73-4513-b0a9-a9c876652232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:52.130238 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37819412-7d69-4847-ba11-744c977b9f60 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:52.134040 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-37819412-7d69-4847-ba11-744c977b9f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:52.151313 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37819412-7d69-4847-ba11-744c977b9f60 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:52.159795 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-e2af8363-bf73-4513-b0a9-a9c876652232 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:52.161126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-e2af8363-bf73-4513-b0a9-a9c876652232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:52.164823 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e6df6-a473-4446-af5c-934313ffa6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:52.165593 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e6df6-a473-4446-af5c-934313ffa6e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:52.165946 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e6df6-a473-4446-af5c-934313ffa6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:52.166286 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e6df6-a473-4446-af5c-934313ffa6e3 admin admin] PATH_INFO: `/v3/users/40bfccde5f2a447d8fdf8cc1d4c7ffbc` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:52.167888 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e6df6-a473-4446-af5c-934313ffa6e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40bfccde5f2a447d8fdf8cc1d4c7ffbc)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:52.170117 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e6df6-a473-4446-af5c-934313ffa6e3 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:52.172205 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1156/2301] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:52.177701 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af8363-bf73-4513-b0a9-a9c876652232 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:52.192547 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af8363-bf73-4513-b0a9-a9c876652232 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:52.200683 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b83bc0-a5b6-4ac3-9b9a-3b3210511123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:52.201493 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b83bc0-a5b6-4ac3-9b9a-3b3210511123 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:52.201838 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b83bc0-a5b6-4ac3-9b9a-3b3210511123 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:52.202172 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b83bc0-a5b6-4ac3-9b9a-3b3210511123 admin admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:52.202899 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b83bc0-a5b6-4ac3-9b9a-3b3210511123 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:52.203771 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b83bc0-a5b6-4ac3-9b9a-3b3210511123 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:52.210001 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b83bc0-a5b6-4ac3-9b9a-3b3210511123 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:52.233063 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1157/2302] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:52.234054 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b83bc0-a5b6-4ac3-9b9a-3b3210511123 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:52.244416 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-561e6df6-a473-4446-af5c-934313ffa6e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40bfccde5f2a447d8fdf8cc1d4c7ffbc'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:52.245608 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-561e6df6-a473-4446-af5c-934313ffa6e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40bfccde5f2a447d8fdf8cc1d4c7ffbc'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:52.246334 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-561e6df6-a473-4446-af5c-934313ffa6e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40bfccde5f2a447d8fdf8cc1d4c7ffbc'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:52.247624 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b83bc0-a5b6-4ac3-9b9a-3b3210511123 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:52.254755 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82a5db-9cee-4a2d-89d8-c18dc3c0f99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:52.255476 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82a5db-9cee-4a2d-89d8-c18dc3c0f99c admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:52.255760 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82a5db-9cee-4a2d-89d8-c18dc3c0f99c admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:52.256034 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82a5db-9cee-4a2d-89d8-c18dc3c0f99c admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:52.256679 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82a5db-9cee-4a2d-89d8-c18dc3c0f99c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:52.258838 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82a5db-9cee-4a2d-89d8-c18dc3c0f99c admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:52.263027 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-561e6df6-a473-4446-af5c-934313ffa6e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40bfccde5f2a447d8fdf8cc1d4c7ffbc'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:52.273668 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-561e6df6-a473-4446-af5c-934313ffa6e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40bfccde5f2a447d8fdf8cc1d4c7ffbc'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:52.294631 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1146/2303] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:52 2022] DELETE /identity/v3/users/40bfccde5f2a447d8fdf8cc1d4c7ffbc => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:52.298416 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1158/2304] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:52 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:52.300286 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170d0eb-9c38-4762-bf76-334464c67d03 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:52.300753 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170d0eb-9c38-4762-bf76-334464c67d03 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:52.301033 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170d0eb-9c38-4762-bf76-334464c67d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:52.305460 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82a5db-9cee-4a2d-89d8-c18dc3c0f99c admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:52.317844 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-0e82a5db-9cee-4a2d-89d8-c18dc3c0f99c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:52.324622 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-f170d0eb-9c38-4762-bf76-334464c67d03 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:52.325839 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-f170d0eb-9c38-4762-bf76-334464c67d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:52.409886 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1147/2305] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:52.410996 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170d0eb-9c38-4762-bf76-334464c67d03 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:52.412902 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-f170d0eb-9c38-4762-bf76-334464c67d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:52.415708 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82a5db-9cee-4a2d-89d8-c18dc3c0f99c admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:52.421368 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e58a3-4521-492c-b774-0c7932f0d3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:52.422817 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e58a3-4521-492c-b774-0c7932f0d3eb admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:52.423093 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e58a3-4521-492c-b774-0c7932f0d3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:52.423371 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e58a3-4521-492c-b774-0c7932f0d3eb admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:52.424251 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e58a3-4521-492c-b774-0c7932f0d3eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:52.426217 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170d0eb-9c38-4762-bf76-334464c67d03 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:52.426358 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e58a3-4521-492c-b774-0c7932f0d3eb admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:52.436712 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54679b-8c70-4260-bcec-f6507ef3b34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:52.437482 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54679b-8c70-4260-bcec-f6507ef3b34e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:52.437725 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54679b-8c70-4260-bcec-f6507ef3b34e admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:52.437996 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54679b-8c70-4260-bcec-f6507ef3b34e admin admin] PATH_INFO: `/v3/projects/1002689eff044f0191c16b157ce3d1bb` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:52.439117 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54679b-8c70-4260-bcec-f6507ef3b34e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1002689eff044f0191c16b157ce3d1bb)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:52.441243 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54679b-8c70-4260-bcec-f6507ef3b34e admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:52.451023 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:52.455940 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1159/2306] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:52 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:52.455940 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e58a3-4521-492c-b774-0c7932f0d3eb admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:52.457581 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-5c0e58a3-4521-492c-b774-0c7932f0d3eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:52.514558 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-7e54679b-8c70-4260-bcec-f6507ef3b34e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1002689eff044f0191c16b157ce3d1bb', 'request_id': 'req-7e54679b-8c70-4260-bcec-f6507ef3b34e'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:52.527506 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-7e54679b-8c70-4260-bcec-f6507ef3b34e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1002689eff044f0191c16b157ce3d1bb', 'request_id': 'req-7e54679b-8c70-4260-bcec-f6507ef3b34e'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:52.534701 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-7e54679b-8c70-4260-bcec-f6507ef3b34e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1002689eff044f0191c16b157ce3d1bb', 'request_id': 'req-7e54679b-8c70-4260-bcec-f6507ef3b34e'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:52.544027 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e58a3-4521-492c-b774-0c7932f0d3eb admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:52.561768 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-7e54679b-8c70-4260-bcec-f6507ef3b34e admin admin] The token cache is being invalidate because project 1002689eff044f0191c16b157ce3d1bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:52.565785 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-7e54679b-8c70-4260-bcec-f6507ef3b34e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:52.567451 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-7e54679b-8c70-4260-bcec-f6507ef3b34e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:52.570052 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1148/2307] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:52 2022] DELETE /identity/v3/projects/1002689eff044f0191c16b157ce3d1bb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:52.571097 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54679b-8c70-4260-bcec-f6507ef3b34e admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:52.573960 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-7e54679b-8c70-4260-bcec-f6507ef3b34e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:52.577728 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:52.616501 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac5181-41c6-46c8-8fc2-b828d64833f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:52.617216 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac5181-41c6-46c8-8fc2-b828d64833f9 service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:52.617528 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac5181-41c6-46c8-8fc2-b828d64833f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:52.617804 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac5181-41c6-46c8-8fc2-b828d64833f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:52.620220 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-65ac5181-41c6-46c8-8fc2-b828d64833f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:52.701655 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54679b-8c70-4260-bcec-f6507ef3b34e admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:52.708520 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35001194-bf7c-4f2e-bbbd-14a9ae011d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:52.709968 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35001194-bf7c-4f2e-bbbd-14a9ae011d0f admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:52.710365 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35001194-bf7c-4f2e-bbbd-14a9ae011d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:52.710908 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35001194-bf7c-4f2e-bbbd-14a9ae011d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:52.711762 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35001194-bf7c-4f2e-bbbd-14a9ae011d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:52.714624 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35001194-bf7c-4f2e-bbbd-14a9ae011d0f admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:52.731237 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1149/2308] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:52 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:52.733022 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b099072-f96e-4a4f-9524-bb0d28b43641 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:52.733397 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b099072-f96e-4a4f-9524-bb0d28b43641 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:52.733758 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b099072-f96e-4a4f-9524-bb0d28b43641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:52.744561 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac5181-41c6-46c8-8fc2-b828d64833f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:52.746810 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac5181-41c6-46c8-8fc2-b828d64833f9 service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:52.764281 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1160/2309] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:52.765133 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac5181-41c6-46c8-8fc2-b828d64833f9 service neutron] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:52.768383 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-0b099072-f96e-4a4f-9524-bb0d28b43641 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:52.770330 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-0b099072-f96e-4a4f-9524-bb0d28b43641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:52.781192 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1150/2310] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:52.786335 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac5181-41c6-46c8-8fc2-b828d64833f9 service neutron] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:52.788514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58924b76-8492-4100-aa18-98ad6421899b None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:52.788789 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58924b76-8492-4100-aa18-98ad6421899b None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:52.789063 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58924b76-8492-4100-aa18-98ad6421899b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:52.801852 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b454b-3a4c-401a-a65d-5f12625aaff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:52.802045 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b454b-3a4c-401a-a65d-5f12625aaff1 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:52.802237 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b454b-3a4c-401a-a65d-5f12625aaff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:52.807280 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b454b-3a4c-401a-a65d-5f12625aaff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:52.807718 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b454b-3a4c-401a-a65d-5f12625aaff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:52.809585 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b454b-3a4c-401a-a65d-5f12625aaff1 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:52.817101 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-58924b76-8492-4100-aa18-98ad6421899b None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:52.818474 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-58924b76-8492-4100-aa18-98ad6421899b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:52.828590 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1151/2311] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:50:52.832699 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58924b76-8492-4100-aa18-98ad6421899b None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:52.836898 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1161/2312] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:52 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:52.838031 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b454b-3a4c-401a-a65d-5f12625aaff1 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:52.842652 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58924b76-8492-4100-aa18-98ad6421899b None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:52.847893 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b708dc2-d534-4f2d-97c7-48d089163543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:52.848651 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b708dc2-d534-4f2d-97c7-48d089163543 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:52.848966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b708dc2-d534-4f2d-97c7-48d089163543 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:52.849468 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b708dc2-d534-4f2d-97c7-48d089163543 admin admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:52.850188 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b708dc2-d534-4f2d-97c7-48d089163543 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:52.850489 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b708dc2-d534-4f2d-97c7-48d089163543 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:52.852287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b708dc2-d534-4f2d-97c7-48d089163543 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:52.869496 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b454b-3a4c-401a-a65d-5f12625aaff1 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:52.872659 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1152/2313] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:52.875312 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3abe84-5ef7-4262-a83d-cb8027604123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:52.876078 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3abe84-5ef7-4262-a83d-cb8027604123 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:52.876365 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3abe84-5ef7-4262-a83d-cb8027604123 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:52.876642 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3abe84-5ef7-4262-a83d-cb8027604123 admin admin] PATH_INFO: `/v3/projects/a22f0b08e8bf494bb451b4d6a4d191c1/users/3893f9ab86d949008e9c6b11f1eacf7c/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:52.878979 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b708dc2-d534-4f2d-97c7-48d089163543 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:52.895887 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3abe84-5ef7-4262-a83d-cb8027604123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a22f0b08e8bf494bb451b4d6a4d191c1, user_id=3893f9ab86d949008e9c6b11f1eacf7c, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:52.897873 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b708dc2-d534-4f2d-97c7-48d089163543 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:52.898742 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3abe84-5ef7-4262-a83d-cb8027604123 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:52.904303 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66cb87b-2938-4613-8146-cc9fa15925cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:52.905515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cb87b-2938-4613-8146-cc9fa15925cb admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:52.905900 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cb87b-2938-4613-8146-cc9fa15925cb admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:52.906380 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cb87b-2938-4613-8146-cc9fa15925cb admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:52.907286 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66cb87b-2938-4613-8146-cc9fa15925cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:52.909677 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66cb87b-2938-4613-8146-cc9fa15925cb admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:52.916518 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1162/2314] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:52 2022] PUT /identity/v3/projects/a22f0b08e8bf494bb451b4d6a4d191c1/users/3893f9ab86d949008e9c6b11f1eacf7c/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:52.927927 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eace4d-8aee-4d7b-8111-00be0caf243f None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:52.927927 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eace4d-8aee-4d7b-8111-00be0caf243f None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:52.927927 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eace4d-8aee-4d7b-8111-00be0caf243f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:52.949796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1153/2315] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:52 2022] POST /identity/v3/projects => generated 399 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:52.955690 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66cb87b-2938-4613-8146-cc9fa15925cb admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:52.964881 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-d4eace4d-8aee-4d7b-8111-00be0caf243f None None] MFA Rules not processed for user `3893f9ab86d949008e9c6b11f1eacf7c`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:52.966245 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-d4eace4d-8aee-4d7b-8111-00be0caf243f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:53.025471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:53.048198 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66cb87b-2938-4613-8146-cc9fa15925cb admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:53.052582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1163/2316] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:53.059223 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80cf26-490d-4359-b9d6-702214d3284f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:53.060093 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80cf26-490d-4359-b9d6-702214d3284f admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:53.060588 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80cf26-490d-4359-b9d6-702214d3284f admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:53.060963 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80cf26-490d-4359-b9d6-702214d3284f admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:53.061699 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d80cf26-490d-4359-b9d6-702214d3284f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:53.064089 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d80cf26-490d-4359-b9d6-702214d3284f admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:53.064407 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eace4d-8aee-4d7b-8111-00be0caf243f None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:53.066338 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-d4eace4d-8aee-4d7b-8111-00be0caf243f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:53.100403 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1154/2317] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:52 2022] POST /identity/v3/users => generated 300 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:53.101537 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80cf26-490d-4359-b9d6-702214d3284f admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:53.113486 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:53.114419 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80cf26-490d-4359-b9d6-702214d3284f admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:53.120862 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad79e2e4-72f9-4896-9da9-e62a408cb053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:53.121513 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79e2e4-72f9-4896-9da9-e62a408cb053 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:53.121796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79e2e4-72f9-4896-9da9-e62a408cb053 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:53.122069 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79e2e4-72f9-4896-9da9-e62a408cb053 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:53.122723 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad79e2e4-72f9-4896-9da9-e62a408cb053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:53.125479 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad79e2e4-72f9-4896-9da9-e62a408cb053 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:53.148142 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1155/2318] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:50:53.152575 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad79e2e4-72f9-4896-9da9-e62a408cb053 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:53.156465 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eace4d-8aee-4d7b-8111-00be0caf243f None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:53.162967 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37673913-649a-45bc-9212-d3a26a80acc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:53.163607 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37673913-649a-45bc-9212-d3a26a80acc1 service cinder] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:53.164025 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37673913-649a-45bc-9212-d3a26a80acc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:53.164328 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37673913-649a-45bc-9212-d3a26a80acc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:53.166026 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad79e2e4-72f9-4896-9da9-e62a408cb053 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:53.174053 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37673913-649a-45bc-9212-d3a26a80acc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:53.175576 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37673913-649a-45bc-9212-d3a26a80acc1 service cinder] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:53.176403 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec0bd1-9f55-492e-b781-94f387268b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:53.177051 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec0bd1-9f55-492e-b781-94f387268b86 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:53.177359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec0bd1-9f55-492e-b781-94f387268b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:53.177646 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec0bd1-9f55-492e-b781-94f387268b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:53.178291 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec0bd1-9f55-492e-b781-94f387268b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:53.179909 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec0bd1-9f55-492e-b781-94f387268b86 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:53.186045 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1164/2319] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:50:53.193090 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1156/2320] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:53.197829 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37673913-649a-45bc-9212-d3a26a80acc1 service cinder] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:53.209652 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37673913-649a-45bc-9212-d3a26a80acc1 service cinder] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:53.215906 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9896156-c9e9-46f7-bbfb-669064be6b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:53.217000 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9896156-c9e9-46f7-bbfb-669064be6b96 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:53.217224 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9896156-c9e9-46f7-bbfb-669064be6b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:53.217912 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9896156-c9e9-46f7-bbfb-669064be6b96 admin admin] PATH_INFO: `/v3/projects/809a7c25963b4b0dae812a0cd13de4ba/users/7381c538d17c480388a946938df09e96/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:53.241121 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9896156-c9e9-46f7-bbfb-669064be6b96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=809a7c25963b4b0dae812a0cd13de4ba, user_id=7381c538d17c480388a946938df09e96, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:53.243889 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9896156-c9e9-46f7-bbfb-669064be6b96 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:53.260622 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1165/2321] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:53 2022] PUT /identity/v3/projects/809a7c25963b4b0dae812a0cd13de4ba/users/7381c538d17c480388a946938df09e96/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:50:53.272804 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508d004-6b4b-4a18-af1c-9552e89bfa35 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:53.273128 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508d004-6b4b-4a18-af1c-9552e89bfa35 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:53.274060 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508d004-6b4b-4a18-af1c-9552e89bfa35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:53.305799 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-f508d004-6b4b-4a18-af1c-9552e89bfa35 None None] MFA Rules not processed for user `7381c538d17c480388a946938df09e96`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:53.307230 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-f508d004-6b4b-4a18-af1c-9552e89bfa35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:53.400044 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1157/2322] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:53 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:50:53.404728 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9896156-c9e9-46f7-bbfb-669064be6b96 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:53.515453 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9896156-c9e9-46f7-bbfb-669064be6b96 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:53.521272 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed8fb4-20d4-41a7-bee7-f5258d989614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:53.521951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed8fb4-20d4-41a7-bee7-f5258d989614 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:53.522286 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed8fb4-20d4-41a7-bee7-f5258d989614 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:53.522559 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed8fb4-20d4-41a7-bee7-f5258d989614 admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:53.523250 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed8fb4-20d4-41a7-bee7-f5258d989614 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:53.526434 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed8fb4-20d4-41a7-bee7-f5258d989614 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:53.606533 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1166/2323] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:53 2022] POST /identity/v3/projects => generated 401 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:53.610762 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f508d004-6b4b-4a18-af1c-9552e89bfa35 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:53.627201 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f508d004-6b4b-4a18-af1c-9552e89bfa35 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:53.758085 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ce6d4-70cd-4570-b510-100a116e7dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:53.758905 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ce6d4-70cd-4570-b510-100a116e7dbb admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:53.759216 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ce6d4-70cd-4570-b510-100a116e7dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:53.759499 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ce6d4-70cd-4570-b510-100a116e7dbb admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:53.760145 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ce6d4-70cd-4570-b510-100a116e7dbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:53.762121 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ce6d4-70cd-4570-b510-100a116e7dbb admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:53.801144 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1158/2324] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:53 2022] POST /identity/v3/users => generated 307 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:53.802172 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed8fb4-20d4-41a7-bee7-f5258d989614 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:53.813489 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed8fb4-20d4-41a7-bee7-f5258d989614 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:53.820581 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5e5ec-b43a-404e-ad48-77608bfb484e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:53.821568 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5e5ec-b43a-404e-ad48-77608bfb484e admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:53.822152 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5e5ec-b43a-404e-ad48-77608bfb484e admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:53.822583 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5e5ec-b43a-404e-ad48-77608bfb484e admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:53.823250 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da5e5ec-b43a-404e-ad48-77608bfb484e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:53.825035 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da5e5ec-b43a-404e-ad48-77608bfb484e admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:53.853203 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1167/2325] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:53.857771 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ce6d4-70cd-4570-b510-100a116e7dbb admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:53.865915 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5e5ec-b43a-404e-ad48-77608bfb484e admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:53.870389 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-3da5e5ec-b43a-404e-ad48-77608bfb484e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:53.880246 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ce6d4-70cd-4570-b510-100a116e7dbb admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:53.897944 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5e5ec-b43a-404e-ad48-77608bfb484e admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:53.903740 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d339ddd5-0fc3-4523-a69b-3bd123dafcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:53.904489 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339ddd5-0fc3-4523-a69b-3bd123dafcf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:53.904777 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339ddd5-0fc3-4523-a69b-3bd123dafcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:53.905099 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d339ddd5-0fc3-4523-a69b-3bd123dafcf3 admin admin] PATH_INFO: `/v3/projects/2772cc9d06a54742910f38532782de17` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:53.906406 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d339ddd5-0fc3-4523-a69b-3bd123dafcf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2772cc9d06a54742910f38532782de17)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:53.906633 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864657e-349c-4034-8640-d85041d03e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:53.908164 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864657e-349c-4034-8640-d85041d03e47 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:53.908950 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d339ddd5-0fc3-4523-a69b-3bd123dafcf3 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:53.910348 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864657e-349c-4034-8640-d85041d03e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:53.910827 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864657e-349c-4034-8640-d85041d03e47 admin admin] PATH_INFO: `/v3/projects/ff7db88acfd0471b94ba01a8d1300530/users/8625d9e933ae4ceea52cd577f1fe2343/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:53.939218 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9864657e-349c-4034-8640-d85041d03e47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff7db88acfd0471b94ba01a8d1300530, user_id=8625d9e933ae4ceea52cd577f1fe2343, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:53.943472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9864657e-349c-4034-8640-d85041d03e47 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:53.980921 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1159/2326] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:53 2022] PUT /identity/v3/projects/ff7db88acfd0471b94ba01a8d1300530/users/8625d9e933ae4ceea52cd577f1fe2343/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:53.985491 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864657e-349c-4034-8640-d85041d03e47 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:53.991500 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-d339ddd5-0fc3-4523-a69b-3bd123dafcf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2772cc9d06a54742910f38532782de17', 'request_id': 'req-d339ddd5-0fc3-4523-a69b-3bd123dafcf3'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:53.998543 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:54.005539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-d339ddd5-0fc3-4523-a69b-3bd123dafcf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2772cc9d06a54742910f38532782de17', 'request_id': 'req-d339ddd5-0fc3-4523-a69b-3bd123dafcf3'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:54.022469 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-d339ddd5-0fc3-4523-a69b-3bd123dafcf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2772cc9d06a54742910f38532782de17', 'request_id': 'req-d339ddd5-0fc3-4523-a69b-3bd123dafcf3'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:54.039204 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-d339ddd5-0fc3-4523-a69b-3bd123dafcf3 admin admin] The token cache is being invalidate because project 2772cc9d06a54742910f38532782de17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:54.039484 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-d339ddd5-0fc3-4523-a69b-3bd123dafcf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:54.040308 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-d339ddd5-0fc3-4523-a69b-3bd123dafcf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:54.042341 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1168/2327] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:53 2022] DELETE /identity/v3/projects/2772cc9d06a54742910f38532782de17 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:54.046237 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d339ddd5-0fc3-4523-a69b-3bd123dafcf3 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:54.047913 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-d339ddd5-0fc3-4523-a69b-3bd123dafcf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:54.060063 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:54.068559 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864657e-349c-4034-8640-d85041d03e47 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:54.074791 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3919d-7676-429b-8d40-6e547cbd8dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:54.075540 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3919d-7676-429b-8d40-6e547cbd8dae admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:54.076335 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3919d-7676-429b-8d40-6e547cbd8dae admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:54.076710 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3919d-7676-429b-8d40-6e547cbd8dae admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:54.077529 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3919d-7676-429b-8d40-6e547cbd8dae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:54.079559 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3919d-7676-429b-8d40-6e547cbd8dae admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:54.093404 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1160/2328] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:50:54.095216 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3919d-7676-429b-8d40-6e547cbd8dae admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:54.097039 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-dbf3919d-7676-429b-8d40-6e547cbd8dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:54.112737 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3919d-7676-429b-8d40-6e547cbd8dae admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:54.118154 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d00c7e-e485-4105-b8ff-0f60583748a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:54.119292 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d00c7e-e485-4105-b8ff-0f60583748a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:54.119292 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d00c7e-e485-4105-b8ff-0f60583748a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:54.119516 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d00c7e-e485-4105-b8ff-0f60583748a7 admin admin] PATH_INFO: `/v3/users/f868e514695c4b3480ea49cac7b88ca1` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:54.120609 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d00c7e-e485-4105-b8ff-0f60583748a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f868e514695c4b3480ea49cac7b88ca1)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:54.122781 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d00c7e-e485-4105-b8ff-0f60583748a7 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:54.129504 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d339ddd5-0fc3-4523-a69b-3bd123dafcf3 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:54.135741 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f08b9c-f452-4873-a11f-77e5bc2282b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:54.136864 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f08b9c-f452-4873-a11f-77e5bc2282b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:54.136864 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f08b9c-f452-4873-a11f-77e5bc2282b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:54.137062 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f08b9c-f452-4873-a11f-77e5bc2282b6 admin admin] PATH_INFO: `/v3/users/65b3692786294198b84c55cca680dbcf` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:54.138130 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f08b9c-f452-4873-a11f-77e5bc2282b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65b3692786294198b84c55cca680dbcf)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:54.140180 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f08b9c-f452-4873-a11f-77e5bc2282b6 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:54.214598 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-e0d00c7e-e485-4105-b8ff-0f60583748a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f868e514695c4b3480ea49cac7b88ca1'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:54.215500 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-e0d00c7e-e485-4105-b8ff-0f60583748a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f868e514695c4b3480ea49cac7b88ca1'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:54.216373 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-e0d00c7e-e485-4105-b8ff-0f60583748a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f868e514695c4b3480ea49cac7b88ca1'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:54.230538 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-51f08b9c-f452-4873-a11f-77e5bc2282b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65b3692786294198b84c55cca680dbcf'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:54.231342 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-51f08b9c-f452-4873-a11f-77e5bc2282b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65b3692786294198b84c55cca680dbcf'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:54.232004 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-51f08b9c-f452-4873-a11f-77e5bc2282b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65b3692786294198b84c55cca680dbcf'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:54.235059 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-e0d00c7e-e485-4105-b8ff-0f60583748a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f868e514695c4b3480ea49cac7b88ca1'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:54.245527 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-e0d00c7e-e485-4105-b8ff-0f60583748a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f868e514695c4b3480ea49cac7b88ca1'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:54.250385 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-51f08b9c-f452-4873-a11f-77e5bc2282b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65b3692786294198b84c55cca680dbcf'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:54.263516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-51f08b9c-f452-4873-a11f-77e5bc2282b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65b3692786294198b84c55cca680dbcf'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:54.265198 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1161/2329] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:54 2022] DELETE /identity/v3/users/f868e514695c4b3480ea49cac7b88ca1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:54.266863 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d00c7e-e485-4105-b8ff-0f60583748a7 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:54.268843 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-e0d00c7e-e485-4105-b8ff-0f60583748a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:54.291194 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1169/2330] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:54 2022] DELETE /identity/v3/users/65b3692786294198b84c55cca680dbcf => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:54.298558 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a1097-2e4d-4f07-8abd-a472d957bc61 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:54.298856 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a1097-2e4d-4f07-8abd-a472d957bc61 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:54.299137 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a1097-2e4d-4f07-8abd-a472d957bc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:54.337077 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-ca7a1097-2e4d-4f07-8abd-a472d957bc61 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:54.339703 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-ca7a1097-2e4d-4f07-8abd-a472d957bc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:54.387771 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d00c7e-e485-4105-b8ff-0f60583748a7 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:54.409712 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:54.468431 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1170/2331] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:54.493284 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b19b2-c6a9-4607-a2e3-d771ca25b4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:54.494070 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b19b2-c6a9-4607-a2e3-d771ca25b4ad admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:54.494355 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b19b2-c6a9-4607-a2e3-d771ca25b4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:54.494762 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b19b2-c6a9-4607-a2e3-d771ca25b4ad admin admin] PATH_INFO: `/v3/projects/ff7db88acfd0471b94ba01a8d1300530/users/8625d9e933ae4ceea52cd577f1fe2343/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:54.499969 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b19b2-c6a9-4607-a2e3-d771ca25b4ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff7db88acfd0471b94ba01a8d1300530, user_id=8625d9e933ae4ceea52cd577f1fe2343, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:54.500674 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a1097-2e4d-4f07-8abd-a472d957bc61 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:54.502361 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-ca7a1097-2e4d-4f07-8abd-a472d957bc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:54.503546 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b19b2-c6a9-4607-a2e3-d771ca25b4ad admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:54.524734 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1162/2332] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:54 2022] PUT /identity/v3/projects/ff7db88acfd0471b94ba01a8d1300530/users/8625d9e933ae4ceea52cd577f1fe2343/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:54.535064 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e98161-b891-45e0-81cb-7f638f9d04c3 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:54.535968 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e98161-b891-45e0-81cb-7f638f9d04c3 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:54.535968 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e98161-b891-45e0-81cb-7f638f9d04c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:54.553709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:54.589906 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a1097-2e4d-4f07-8abd-a472d957bc61 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:54.593281 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-b9e98161-b891-45e0-81cb-7f638f9d04c3 None None] MFA Rules not processed for user `8625d9e933ae4ceea52cd577f1fe2343`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:54.594877 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-b9e98161-b891-45e0-81cb-7f638f9d04c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:54.670069 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981398e-689f-4fa5-9806-e3c24ddce203 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:54.670708 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981398e-689f-4fa5-9806-e3c24ddce203 service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:54.671735 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981398e-689f-4fa5-9806-e3c24ddce203 service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:54.672011 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981398e-689f-4fa5-9806-e3c24ddce203 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:54.720133 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1163/2333] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:54 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:54.721049 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e98161-b891-45e0-81cb-7f638f9d04c3 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:54.725161 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-b9e98161-b891-45e0-81cb-7f638f9d04c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:54.782433 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981398e-689f-4fa5-9806-e3c24ddce203 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:54.784951 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981398e-689f-4fa5-9806-e3c24ddce203 service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:54.803976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1171/2334] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:54.821955 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981398e-689f-4fa5-9806-e3c24ddce203 service neutron] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:54.826865 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-f981398e-689f-4fa5-9806-e3c24ddce203 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:54.843845 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e98161-b891-45e0-81cb-7f638f9d04c3 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:54.849651 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7fb84-dd8e-4e4e-aca9-aa30f579ef86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:54.850650 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7fb84-dd8e-4e4e-aca9-aa30f579ef86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:54.851009 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7fb84-dd8e-4e4e-aca9-aa30f579ef86 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:54.853561 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7fb84-dd8e-4e4e-aca9-aa30f579ef86 admin admin] PATH_INFO: `/v3/projects/824539686f45410bb097c6c1aca5ecc0` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:54.854687 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae7fb84-dd8e-4e4e-aca9-aa30f579ef86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=824539686f45410bb097c6c1aca5ecc0)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:54.857395 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae7fb84-dd8e-4e4e-aca9-aa30f579ef86 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:54.944527 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:54.951544 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-4ae7fb84-dd8e-4e4e-aca9-aa30f579ef86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '824539686f45410bb097c6c1aca5ecc0', 'request_id': 'req-4ae7fb84-dd8e-4e4e-aca9-aa30f579ef86'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:54.969542 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-4ae7fb84-dd8e-4e4e-aca9-aa30f579ef86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '824539686f45410bb097c6c1aca5ecc0', 'request_id': 'req-4ae7fb84-dd8e-4e4e-aca9-aa30f579ef86'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:54.979758 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-4ae7fb84-dd8e-4e4e-aca9-aa30f579ef86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '824539686f45410bb097c6c1aca5ecc0', 'request_id': 'req-4ae7fb84-dd8e-4e4e-aca9-aa30f579ef86'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:54.995965 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-4ae7fb84-dd8e-4e4e-aca9-aa30f579ef86 admin admin] The token cache is being invalidate because project 824539686f45410bb097c6c1aca5ecc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:54.996860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-4ae7fb84-dd8e-4e4e-aca9-aa30f579ef86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:54.998287 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-4ae7fb84-dd8e-4e4e-aca9-aa30f579ef86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:54.999565 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1164/2335] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:54 2022] DELETE /identity/v3/projects/824539686f45410bb097c6c1aca5ecc0 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:55.008589 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f770d-1fbe-4c61-92f4-e3fe7f2f053f None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:55.008589 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f770d-1fbe-4c61-92f4-e3fe7f2f053f None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:55.008589 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f770d-1fbe-4c61-92f4-e3fe7f2f053f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:55.037097 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981398e-689f-4fa5-9806-e3c24ddce203 service neutron] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:55.050086 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-852f770d-1fbe-4c61-92f4-e3fe7f2f053f None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:55.051316 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-852f770d-1fbe-4c61-92f4-e3fe7f2f053f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:55.126883 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:55.135701 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4aa5d6-e75a-4788-a59b-4c68d11c26b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:55.137099 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4aa5d6-e75a-4788-a59b-4c68d11c26b4 service cinder] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:55.137425 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4aa5d6-e75a-4788-a59b-4c68d11c26b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:55.137866 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4aa5d6-e75a-4788-a59b-4c68d11c26b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:55.139780 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-ca4aa5d6-e75a-4788-a59b-4c68d11c26b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:55.181321 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1165/2336] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:50:55.190137 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351e476-46e6-47d9-b06d-91f9e037f39d None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:55.190956 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351e476-46e6-47d9-b06d-91f9e037f39d None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:55.190956 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351e476-46e6-47d9-b06d-91f9e037f39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:55.221202 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-c351e476-46e6-47d9-b06d-91f9e037f39d None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:55.225406 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-c351e476-46e6-47d9-b06d-91f9e037f39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:55.239872 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1166/2337] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:55.241668 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4aa5d6-e75a-4788-a59b-4c68d11c26b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:55.242288 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351e476-46e6-47d9-b06d-91f9e037f39d None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:55.244209 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4aa5d6-e75a-4788-a59b-4c68d11c26b4 service cinder] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:55.254985 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351e476-46e6-47d9-b06d-91f9e037f39d None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:55.257175 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1172/2338] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:54 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:55.264718 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773758f2-5288-490b-8247-a895795cd8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:55.266007 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773758f2-5288-490b-8247-a895795cd8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:55.266757 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773758f2-5288-490b-8247-a895795cd8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:55.266757 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773758f2-5288-490b-8247-a895795cd8c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:55.267737 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773758f2-5288-490b-8247-a895795cd8c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:50:55.268236 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773758f2-5288-490b-8247-a895795cd8c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:55.271831 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773758f2-5288-490b-8247-a895795cd8c8 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:55.338716 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1167/2339] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:50:55.343703 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4aa5d6-e75a-4788-a59b-4c68d11c26b4 service cinder] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:55.367995 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4aa5d6-e75a-4788-a59b-4c68d11c26b4 service cinder] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:55.373899 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885a061-c7e6-4a10-bfdf-3f74bd94f577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:55.374979 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885a061-c7e6-4a10-bfdf-3f74bd94f577 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:55.375331 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885a061-c7e6-4a10-bfdf-3f74bd94f577 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:55.375685 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885a061-c7e6-4a10-bfdf-3f74bd94f577 admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:55.376407 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885a061-c7e6-4a10-bfdf-3f74bd94f577 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:55.378936 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885a061-c7e6-4a10-bfdf-3f74bd94f577 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:55.392210 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773758f2-5288-490b-8247-a895795cd8c8 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:55.394485 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-773758f2-5288-490b-8247-a895795cd8c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:55.408406 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773758f2-5288-490b-8247-a895795cd8c8 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:55.413362 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1173/2340] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:50:55 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:55.413536 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af74b75-dbf4-4cb5-905d-8905e1eb4e0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:55.413536 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af74b75-dbf4-4cb5-905d-8905e1eb4e0c service cinder] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:55.413536 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af74b75-dbf4-4cb5-905d-8905e1eb4e0c service cinder] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:55.413536 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af74b75-dbf4-4cb5-905d-8905e1eb4e0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:55.416516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885a061-c7e6-4a10-bfdf-3f74bd94f577 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:55.419659 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-8af74b75-dbf4-4cb5-905d-8905e1eb4e0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:55.491420 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af74b75-dbf4-4cb5-905d-8905e1eb4e0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:55.493145 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af74b75-dbf4-4cb5-905d-8905e1eb4e0c service cinder] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:55.501809 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885a061-c7e6-4a10-bfdf-3f74bd94f577 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:55.504902 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1168/2341] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:55 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:55.505866 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af74b75-dbf4-4cb5-905d-8905e1eb4e0c service cinder] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:55.507241 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-8af74b75-dbf4-4cb5-905d-8905e1eb4e0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:55.507730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9f91a-4e4c-42b6-92c2-a5fb4e466cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:55.508416 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9f91a-4e4c-42b6-92c2-a5fb4e466cc2 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:55.508766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9f91a-4e4c-42b6-92c2-a5fb4e466cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:55.509099 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9f91a-4e4c-42b6-92c2-a5fb4e466cc2 admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:55.509851 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9f91a-4e4c-42b6-92c2-a5fb4e466cc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:55.513802 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9f91a-4e4c-42b6-92c2-a5fb4e466cc2 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:55.525786 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af74b75-dbf4-4cb5-905d-8905e1eb4e0c service cinder] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:55.531006 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a96e1-3811-4096-b33e-dc6e94263b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:55.531645 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a96e1-3811-4096-b33e-dc6e94263b10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:55.531930 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a96e1-3811-4096-b33e-dc6e94263b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:55.532207 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a96e1-3811-4096-b33e-dc6e94263b10 admin admin] PATH_INFO: `/v3/projects/ca5b72a7e0d34535a9f7a277e4ab98a6` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:55.533369 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a96e1-3811-4096-b33e-dc6e94263b10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca5b72a7e0d34535a9f7a277e4ab98a6)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:55.534964 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1174/2342] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:50:55 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:50:55.538089 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a96e1-3811-4096-b33e-dc6e94263b10 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:55.538932 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9f91a-4e4c-42b6-92c2-a5fb4e466cc2 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:55.549552 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9f91a-4e4c-42b6-92c2-a5fb4e466cc2 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:55.555841 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073433c-4fe9-4fee-a130-69de16bcab07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:55.556756 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073433c-4fe9-4fee-a130-69de16bcab07 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:55.557045 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073433c-4fe9-4fee-a130-69de16bcab07 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:55.557328 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073433c-4fe9-4fee-a130-69de16bcab07 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:55.558194 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6073433c-4fe9-4fee-a130-69de16bcab07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:55.560123 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6073433c-4fe9-4fee-a130-69de16bcab07 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:55.576218 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1175/2343] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:50:55.580366 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073433c-4fe9-4fee-a130-69de16bcab07 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:55.590906 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6073433c-4fe9-4fee-a130-69de16bcab07 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:55.605160 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:55.609719 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-877a96e1-3811-4096-b33e-dc6e94263b10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca5b72a7e0d34535a9f7a277e4ab98a6', 'request_id': 'req-877a96e1-3811-4096-b33e-dc6e94263b10'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:55.621592 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-877a96e1-3811-4096-b33e-dc6e94263b10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca5b72a7e0d34535a9f7a277e4ab98a6', 'request_id': 'req-877a96e1-3811-4096-b33e-dc6e94263b10'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:55.636931 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-877a96e1-3811-4096-b33e-dc6e94263b10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca5b72a7e0d34535a9f7a277e4ab98a6', 'request_id': 'req-877a96e1-3811-4096-b33e-dc6e94263b10'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:55.653112 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-877a96e1-3811-4096-b33e-dc6e94263b10 admin admin] The token cache is being invalidate because project ca5b72a7e0d34535a9f7a277e4ab98a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:50:55.653554 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-877a96e1-3811-4096-b33e-dc6e94263b10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:55.654498 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-877a96e1-3811-4096-b33e-dc6e94263b10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:55.656035 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1169/2344] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:55 2022] DELETE /identity/v3/projects/ca5b72a7e0d34535a9f7a277e4ab98a6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:55.669611 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:55.670160 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630d6a7-04da-473b-a7bc-c65fe3129306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:55.670819 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630d6a7-04da-473b-a7bc-c65fe3129306 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:55.671163 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630d6a7-04da-473b-a7bc-c65fe3129306 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:55.671521 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630d6a7-04da-473b-a7bc-c65fe3129306 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:55.672260 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1630d6a7-04da-473b-a7bc-c65fe3129306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:55.674044 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1630d6a7-04da-473b-a7bc-c65fe3129306 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:55.689565 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1176/2345] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:50:55.691698 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a96e1-3811-4096-b33e-dc6e94263b10 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:55.693379 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-877a96e1-3811-4096-b33e-dc6e94263b10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:55.710641 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a96e1-3811-4096-b33e-dc6e94263b10 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:55.716466 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613812c-f746-4319-b0f4-7249cc333adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:55.717315 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613812c-f746-4319-b0f4-7249cc333adc admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:55.717710 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613812c-f746-4319-b0f4-7249cc333adc admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:55.718078 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613812c-f746-4319-b0f4-7249cc333adc admin admin] PATH_INFO: `/v3/projects/4963735764d24eb1ab596a6b9e537b6f/users/017082290b6b4db1813036a043672474/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:55.737162 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613812c-f746-4319-b0f4-7249cc333adc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4963735764d24eb1ab596a6b9e537b6f, user_id=017082290b6b4db1813036a043672474, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:55.740200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613812c-f746-4319-b0f4-7249cc333adc admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:55.766995 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1170/2346] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:50:55 2022] PUT /identity/v3/projects/4963735764d24eb1ab596a6b9e537b6f/users/017082290b6b4db1813036a043672474/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:55.781584 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc35ce-cfaa-4825-a54b-61cc9d6dd80e None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:55.781992 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc35ce-cfaa-4825-a54b-61cc9d6dd80e None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:55.782378 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc35ce-cfaa-4825-a54b-61cc9d6dd80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:55.821169 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-fabc35ce-cfaa-4825-a54b-61cc9d6dd80e None None] MFA Rules not processed for user `017082290b6b4db1813036a043672474`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:55.821512 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-fabc35ce-cfaa-4825-a54b-61cc9d6dd80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:55.947040 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1177/2347] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:55.960433 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613812c-f746-4319-b0f4-7249cc333adc admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:55.962638 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-5613812c-f746-4319-b0f4-7249cc333adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:56.029186 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613812c-f746-4319-b0f4-7249cc333adc admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:56.034228 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd7dca-2284-45a4-98e6-4cc24a84ecc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:56.035076 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd7dca-2284-45a4-98e6-4cc24a84ecc2 service cinder] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:56.035531 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd7dca-2284-45a4-98e6-4cc24a84ecc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:56.035961 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd7dca-2284-45a4-98e6-4cc24a84ecc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:56.047850 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd7dca-2284-45a4-98e6-4cc24a84ecc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:56.049373 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd7dca-2284-45a4-98e6-4cc24a84ecc2 service cinder] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:56.060613 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1171/2348] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:59.082985 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc35ce-cfaa-4825-a54b-61cc9d6dd80e None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:59.084426 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-fabc35ce-cfaa-4825-a54b-61cc9d6dd80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:59.163945 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc35ce-cfaa-4825-a54b-61cc9d6dd80e None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:59.168640 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a005cc9-7fe5-403b-a88a-2e0a46a9b726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:59.169313 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a005cc9-7fe5-403b-a88a-2e0a46a9b726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:59.169722 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a005cc9-7fe5-403b-a88a-2e0a46a9b726 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:59.170053 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a005cc9-7fe5-403b-a88a-2e0a46a9b726 admin admin] PATH_INFO: `/v3/users/3893f9ab86d949008e9c6b11f1eacf7c` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:59.171232 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a005cc9-7fe5-403b-a88a-2e0a46a9b726 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3893f9ab86d949008e9c6b11f1eacf7c)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:59.173233 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a005cc9-7fe5-403b-a88a-2e0a46a9b726 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:59.225061 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-1a005cc9-7fe5-403b-a88a-2e0a46a9b726 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3893f9ab86d949008e9c6b11f1eacf7c'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:59.225917 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-1a005cc9-7fe5-403b-a88a-2e0a46a9b726 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3893f9ab86d949008e9c6b11f1eacf7c'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:59.226680 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-1a005cc9-7fe5-403b-a88a-2e0a46a9b726 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3893f9ab86d949008e9c6b11f1eacf7c'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:59.241034 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-1a005cc9-7fe5-403b-a88a-2e0a46a9b726 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3893f9ab86d949008e9c6b11f1eacf7c'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:59.251729 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-1a005cc9-7fe5-403b-a88a-2e0a46a9b726 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3893f9ab86d949008e9c6b11f1eacf7c'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:59.261582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:59.267221 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1178/2349] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:59 2022] DELETE /identity/v3/users/3893f9ab86d949008e9c6b11f1eacf7c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:59.272583 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82d3ad-fa91-4ee3-bec3-ee9f1125901f None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:59.273054 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82d3ad-fa91-4ee3-bec3-ee9f1125901f None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:59.273212 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82d3ad-fa91-4ee3-bec3-ee9f1125901f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:59.294628 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a005cc9-7fe5-403b-a88a-2e0a46a9b726 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:59.295324 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-7e82d3ad-fa91-4ee3-bec3-ee9f1125901f None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:59.296288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-1a005cc9-7fe5-403b-a88a-2e0a46a9b726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:59.296817 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-7e82d3ad-fa91-4ee3-bec3-ee9f1125901f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:59.361446 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1172/2350] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:50:59.366045 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a005cc9-7fe5-403b-a88a-2e0a46a9b726 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:59.370863 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7873d9b-6194-4855-bc15-58641ec13b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:59.371497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7873d9b-6194-4855-bc15-58641ec13b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:59.371600 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82d3ad-fa91-4ee3-bec3-ee9f1125901f None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:59.371777 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7873d9b-6194-4855-bc15-58641ec13b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:59.372050 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7873d9b-6194-4855-bc15-58641ec13b95 admin admin] PATH_INFO: `/v3/users/017082290b6b4db1813036a043672474` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:59.372916 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-7e82d3ad-fa91-4ee3-bec3-ee9f1125901f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:59.373194 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7873d9b-6194-4855-bc15-58641ec13b95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=017082290b6b4db1813036a043672474)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:59.375169 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7873d9b-6194-4855-bc15-58641ec13b95 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:59.425708 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-e7873d9b-6194-4855-bc15-58641ec13b95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '017082290b6b4db1813036a043672474'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:59.426387 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-e7873d9b-6194-4855-bc15-58641ec13b95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '017082290b6b4db1813036a043672474'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:59.427017 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-e7873d9b-6194-4855-bc15-58641ec13b95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '017082290b6b4db1813036a043672474'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:59.433003 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82d3ad-fa91-4ee3-bec3-ee9f1125901f None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:59.437107 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff633fc2-455d-4cfe-b0fc-a7e02174db46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:59.437777 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff633fc2-455d-4cfe-b0fc-a7e02174db46 service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:59.438081 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff633fc2-455d-4cfe-b0fc-a7e02174db46 service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:59.438349 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff633fc2-455d-4cfe-b0fc-a7e02174db46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:59.440103 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-ff633fc2-455d-4cfe-b0fc-a7e02174db46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:59.440839 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-e7873d9b-6194-4855-bc15-58641ec13b95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '017082290b6b4db1813036a043672474'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:59.448706 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-e7873d9b-6194-4855-bc15-58641ec13b95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '017082290b6b4db1813036a043672474'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:59.451928 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:59.455064 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff633fc2-455d-4cfe-b0fc-a7e02174db46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:59.457355 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff633fc2-455d-4cfe-b0fc-a7e02174db46 service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:59.466620 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1179/2351] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:59 2022] DELETE /identity/v3/users/017082290b6b4db1813036a043672474 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:59.468226 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51549106-f568-4443-90eb-2f750f4294b2 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:59.468647 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1173/2352] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:50:59.469020 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51549106-f568-4443-90eb-2f750f4294b2 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:59.469303 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51549106-f568-4443-90eb-2f750f4294b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:59.489682 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-51549106-f568-4443-90eb-2f750f4294b2 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:50:59.491153 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-51549106-f568-4443-90eb-2f750f4294b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:59.564226 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1180/2353] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:50:59.575132 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff633fc2-455d-4cfe-b0fc-a7e02174db46 service neutron] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:59.576959 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-ff633fc2-455d-4cfe-b0fc-a7e02174db46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:59.591724 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff633fc2-455d-4cfe-b0fc-a7e02174db46 service neutron] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:59.686620 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e85227-00b7-4676-883f-bb4896733134 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:59.687651 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e85227-00b7-4676-883f-bb4896733134 service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:59.688017 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e85227-00b7-4676-883f-bb4896733134 service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:59.688402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e85227-00b7-4676-883f-bb4896733134 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:59.700848 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e85227-00b7-4676-883f-bb4896733134 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:59.703992 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e85227-00b7-4676-883f-bb4896733134 service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:59.719243 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1174/2354] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:50:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:50:59.786050 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51549106-f568-4443-90eb-2f750f4294b2 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:59.787438 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-51549106-f568-4443-90eb-2f750f4294b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:59.800798 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51549106-f568-4443-90eb-2f750f4294b2 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:59.806248 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df789a-3ef2-4c2a-862b-6c2a831257d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:59.806895 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df789a-3ef2-4c2a-862b-6c2a831257d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:59.807168 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df789a-3ef2-4c2a-862b-6c2a831257d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:59.807434 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df789a-3ef2-4c2a-862b-6c2a831257d7 admin admin] PATH_INFO: `/v3/users/7381c538d17c480388a946938df09e96` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:59.808558 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df789a-3ef2-4c2a-862b-6c2a831257d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7381c538d17c480388a946938df09e96)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:59.822673 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df789a-3ef2-4c2a-862b-6c2a831257d7 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:59.850150 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:59.880193 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e85227-00b7-4676-883f-bb4896733134 service neutron] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:50:59.881723 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-59e85227-00b7-4676-883f-bb4896733134 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:50:59.912599 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-67df789a-3ef2-4c2a-862b-6c2a831257d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7381c538d17c480388a946938df09e96'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:59.913446 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-67df789a-3ef2-4c2a-862b-6c2a831257d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7381c538d17c480388a946938df09e96'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:59.914312 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-67df789a-3ef2-4c2a-862b-6c2a831257d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7381c538d17c480388a946938df09e96'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:59.918223 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e85227-00b7-4676-883f-bb4896733134 service neutron] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:50:59.935887 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9f2c6-ae9f-40f9-aaac-1757e3f6304f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:50:59.936089 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9f2c6-ae9f-40f9-aaac-1757e3f6304f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:59.936322 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9f2c6-ae9f-40f9-aaac-1757e3f6304f admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:59.936576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9f2c6-ae9f-40f9-aaac-1757e3f6304f admin admin] PATH_INFO: `/v3/projects/a22f0b08e8bf494bb451b4d6a4d191c1` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:50:59.940170 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d9f2c6-ae9f-40f9-aaac-1757e3f6304f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a22f0b08e8bf494bb451b4d6a4d191c1)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:50:59.942266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-67df789a-3ef2-4c2a-862b-6c2a831257d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7381c538d17c480388a946938df09e96'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:59.944688 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d9f2c6-ae9f-40f9-aaac-1757e3f6304f admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:50:59.961525 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-67df789a-3ef2-4c2a-862b-6c2a831257d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7381c538d17c480388a946938df09e96'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:50:59.981228 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1181/2355] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:50:59 2022] DELETE /identity/v3/users/7381c538d17c480388a946938df09e96 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:59.986389 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a9419-c055-42b1-98d3-d7c1bf17e69d None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:50:59.986751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a9419-c055-42b1-98d3-d7c1bf17e69d None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:50:59.987090 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a9419-c055-42b1-98d3-d7c1bf17e69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:00.015323 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-18d9f2c6-ae9f-40f9-aaac-1757e3f6304f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a22f0b08e8bf494bb451b4d6a4d191c1', 'request_id': 'req-18d9f2c6-ae9f-40f9-aaac-1757e3f6304f'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:00.016777 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-349a9419-c055-42b1-98d3-d7c1bf17e69d None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:00.018254 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-349a9419-c055-42b1-98d3-d7c1bf17e69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:00.027671 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-18d9f2c6-ae9f-40f9-aaac-1757e3f6304f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a22f0b08e8bf494bb451b4d6a4d191c1', 'request_id': 'req-18d9f2c6-ae9f-40f9-aaac-1757e3f6304f'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:00.046014 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-18d9f2c6-ae9f-40f9-aaac-1757e3f6304f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a22f0b08e8bf494bb451b4d6a4d191c1', 'request_id': 'req-18d9f2c6-ae9f-40f9-aaac-1757e3f6304f'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:00.059281 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-18d9f2c6-ae9f-40f9-aaac-1757e3f6304f admin admin] The token cache is being invalidate because project a22f0b08e8bf494bb451b4d6a4d191c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:00.059377 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-18d9f2c6-ae9f-40f9-aaac-1757e3f6304f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:00.060309 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-18d9f2c6-ae9f-40f9-aaac-1757e3f6304f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:00.067828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1175/2356] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:50:59 2022] DELETE /identity/v3/projects/a22f0b08e8bf494bb451b4d6a4d191c1 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:00.067828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17ad0f-d99e-4e25-8e98-6b7e867eae72 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:00.067828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17ad0f-d99e-4e25-8e98-6b7e867eae72 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:00.067828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17ad0f-d99e-4e25-8e98-6b7e867eae72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:00.096724 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-0b17ad0f-d99e-4e25-8e98-6b7e867eae72 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:00.098052 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-0b17ad0f-d99e-4e25-8e98-6b7e867eae72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:00.101372 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1182/2357] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:00.108629 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1176/2358] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:00.116649 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f79697-3e3e-424e-9d19-32ce5e5626dc None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:00.116932 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f79697-3e3e-424e-9d19-32ce5e5626dc None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:00.117203 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f79697-3e3e-424e-9d19-32ce5e5626dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:00.144854 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17ad0f-d99e-4e25-8e98-6b7e867eae72 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:00.147386 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-0b17ad0f-d99e-4e25-8e98-6b7e867eae72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:00.165555 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-79f79697-3e3e-424e-9d19-32ce5e5626dc None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:00.166954 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-79f79697-3e3e-424e-9d19-32ce5e5626dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:00.182585 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1183/2359] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:00.192799 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f79697-3e3e-424e-9d19-32ce5e5626dc None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:00.211217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f79697-3e3e-424e-9d19-32ce5e5626dc None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:00.235090 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591cf91-de2e-43d3-9ae1-66d3efc50c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:00.235803 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591cf91-de2e-43d3-9ae1-66d3efc50c75 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:00.236153 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591cf91-de2e-43d3-9ae1-66d3efc50c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:00.236510 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591cf91-de2e-43d3-9ae1-66d3efc50c75 admin admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:00.237273 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b591cf91-de2e-43d3-9ae1-66d3efc50c75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:51:00.237766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b591cf91-de2e-43d3-9ae1-66d3efc50c75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:00.239542 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b591cf91-de2e-43d3-9ae1-66d3efc50c75 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:00.250301 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17ad0f-d99e-4e25-8e98-6b7e867eae72 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:00.254513 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a5ce7-9112-4504-af29-b29b5ebfedb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:00.255205 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a5ce7-9112-4504-af29-b29b5ebfedb3 service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:00.255554 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a5ce7-9112-4504-af29-b29b5ebfedb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:00.255894 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a5ce7-9112-4504-af29-b29b5ebfedb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:00.256654 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1184/2360] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:51:00.262114 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591cf91-de2e-43d3-9ae1-66d3efc50c75 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:00.270428 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a5ce7-9112-4504-af29-b29b5ebfedb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:00.271908 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a5ce7-9112-4504-af29-b29b5ebfedb3 service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:00.273323 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591cf91-de2e-43d3-9ae1-66d3efc50c75 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:00.278261 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4196e-6fe8-44f3-9061-e1cb510dc727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:00.278815 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4196e-6fe8-44f3-9061-e1cb510dc727 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:00.279091 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4196e-6fe8-44f3-9061-e1cb510dc727 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:00.279361 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4196e-6fe8-44f3-9061-e1cb510dc727 admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:00.279987 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4196e-6fe8-44f3-9061-e1cb510dc727 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:00.282182 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4196e-6fe8-44f3-9061-e1cb510dc727 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:00.282312 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1177/2361] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:51:00.331125 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1185/2362] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:00 2022] POST /identity/v3/projects => generated 367 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:00.335116 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a5ce7-9112-4504-af29-b29b5ebfedb3 service neutron] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:00.344231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a5ce7-9112-4504-af29-b29b5ebfedb3 service neutron] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:00.359315 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:00.424979 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd1a43-4fc5-46f0-b3b7-fdfe82c4fd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:00.425619 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd1a43-4fc5-46f0-b3b7-fdfe82c4fd06 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:00.425897 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd1a43-4fc5-46f0-b3b7-fdfe82c4fd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:00.426169 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd1a43-4fc5-46f0-b3b7-fdfe82c4fd06 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:00.426792 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd1a43-4fc5-46f0-b3b7-fdfe82c4fd06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:00.428744 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd1a43-4fc5-46f0-b3b7-fdfe82c4fd06 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:00.445794 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4196e-6fe8-44f3-9061-e1cb510dc727 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:00.447718 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-b9f4196e-6fe8-44f3-9061-e1cb510dc727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:00.463629 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4196e-6fe8-44f3-9061-e1cb510dc727 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:00.467776 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1178/2363] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:00 2022] POST /identity/v3/users => generated 284 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:00.469388 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d66e2-85ff-4d74-8909-84bd9d9e0d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:00.470233 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d66e2-85ff-4d74-8909-84bd9d9e0d54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:00.470343 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d66e2-85ff-4d74-8909-84bd9d9e0d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:00.471093 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d66e2-85ff-4d74-8909-84bd9d9e0d54 admin admin] PATH_INFO: `/v3/projects/4963735764d24eb1ab596a6b9e537b6f` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:00.472136 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d66e2-85ff-4d74-8909-84bd9d9e0d54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4963735764d24eb1ab596a6b9e537b6f)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:00.472852 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd1a43-4fc5-46f0-b3b7-fdfe82c4fd06 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:00.474076 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d66e2-85ff-4d74-8909-84bd9d9e0d54 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:00.489145 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd1a43-4fc5-46f0-b3b7-fdfe82c4fd06 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:00.502704 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f75496-cbe6-4c99-9c29-09218a4f0ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:00.503327 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f75496-cbe6-4c99-9c29-09218a4f0ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:00.503974 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f75496-cbe6-4c99-9c29-09218a4f0ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:00.504245 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f75496-cbe6-4c99-9c29-09218a4f0ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:00.504907 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f75496-cbe6-4c99-9c29-09218a4f0ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:00.507137 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f75496-cbe6-4c99-9c29-09218a4f0ae6 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:00.524498 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1179/2364] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:51:00.526427 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f75496-cbe6-4c99-9c29-09218a4f0ae6 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:00.542021 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f75496-cbe6-4c99-9c29-09218a4f0ae6 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:00.548130 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:00.551788 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-c03d66e2-85ff-4d74-8909-84bd9d9e0d54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4963735764d24eb1ab596a6b9e537b6f', 'request_id': 'req-c03d66e2-85ff-4d74-8909-84bd9d9e0d54'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:00.560497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-c03d66e2-85ff-4d74-8909-84bd9d9e0d54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4963735764d24eb1ab596a6b9e537b6f', 'request_id': 'req-c03d66e2-85ff-4d74-8909-84bd9d9e0d54'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:00.570162 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-c03d66e2-85ff-4d74-8909-84bd9d9e0d54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4963735764d24eb1ab596a6b9e537b6f', 'request_id': 'req-c03d66e2-85ff-4d74-8909-84bd9d9e0d54'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:00.586415 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-c03d66e2-85ff-4d74-8909-84bd9d9e0d54 admin admin] The token cache is being invalidate because project 4963735764d24eb1ab596a6b9e537b6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:00.586762 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-c03d66e2-85ff-4d74-8909-84bd9d9e0d54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:00.587888 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-c03d66e2-85ff-4d74-8909-84bd9d9e0d54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:00.589759 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1186/2365] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:00 2022] DELETE /identity/v3/projects/4963735764d24eb1ab596a6b9e537b6f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:00.594920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e893d-38c2-4d7e-b49d-c35d86ab29d6 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:00.595207 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e893d-38c2-4d7e-b49d-c35d86ab29d6 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:00.595482 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e893d-38c2-4d7e-b49d-c35d86ab29d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:00.618070 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-393e893d-38c2-4d7e-b49d-c35d86ab29d6 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:00.619291 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-393e893d-38c2-4d7e-b49d-c35d86ab29d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:00.638821 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d373666b-34a9-4225-bec4-8a9d10979d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:00.639845 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373666b-34a9-4225-bec4-8a9d10979d5e admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:00.640673 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373666b-34a9-4225-bec4-8a9d10979d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:00.641011 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373666b-34a9-4225-bec4-8a9d10979d5e admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:00.642203 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d373666b-34a9-4225-bec4-8a9d10979d5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:00.644294 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d373666b-34a9-4225-bec4-8a9d10979d5e admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:00.664431 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1180/2366] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:00.668473 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d373666b-34a9-4225-bec4-8a9d10979d5e admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:00.674121 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-d373666b-34a9-4225-bec4-8a9d10979d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:00.696288 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d373666b-34a9-4225-bec4-8a9d10979d5e admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:00.707015 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8bec7-857d-4fd0-85c1-144b18f318d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:00.710176 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8bec7-857d-4fd0-85c1-144b18f318d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:00.710475 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8bec7-857d-4fd0-85c1-144b18f318d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:00.710750 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8bec7-857d-4fd0-85c1-144b18f318d6 admin admin] PATH_INFO: `/v3/projects/03503ef5958149a6af3e169ad36cb359/users/be5ca6726e7841219d5924c71dcb9c01/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:00.726260 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1187/2367] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:51:00.736228 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20bd77f-a684-4d49-b929-6ee6b2048447 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:00.736519 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20bd77f-a684-4d49-b929-6ee6b2048447 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:00.736789 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20bd77f-a684-4d49-b929-6ee6b2048447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:00.752576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8bec7-857d-4fd0-85c1-144b18f318d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03503ef5958149a6af3e169ad36cb359, user_id=be5ca6726e7841219d5924c71dcb9c01, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:00.755734 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8bec7-857d-4fd0-85c1-144b18f318d6 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:00.781153 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-b20bd77f-a684-4d49-b929-6ee6b2048447 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:00.782428 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-b20bd77f-a684-4d49-b929-6ee6b2048447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:00.785712 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1181/2368] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:00 2022] PUT /identity/v3/projects/03503ef5958149a6af3e169ad36cb359/users/be5ca6726e7841219d5924c71dcb9c01/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:51:00.797161 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8c00f-574a-45ab-9412-f6d3837a2c88 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:00.797499 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8c00f-574a-45ab-9412-f6d3837a2c88 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:00.797726 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8c00f-574a-45ab-9412-f6d3837a2c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:00.830480 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-50f8c00f-574a-45ab-9412-f6d3837a2c88 None None] MFA Rules not processed for user `be5ca6726e7841219d5924c71dcb9c01`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:00.831742 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-50f8c00f-574a-45ab-9412-f6d3837a2c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:00.907576 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1188/2369] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:00.908519 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20bd77f-a684-4d49-b929-6ee6b2048447 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:00.910281 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-b20bd77f-a684-4d49-b929-6ee6b2048447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:00.931668 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20bd77f-a684-4d49-b929-6ee6b2048447 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:00.941741 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab94e23-4640-452f-9fd9-b1acfb2fbcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:00.942418 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab94e23-4640-452f-9fd9-b1acfb2fbcbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:00.942622 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab94e23-4640-452f-9fd9-b1acfb2fbcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:00.942893 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab94e23-4640-452f-9fd9-b1acfb2fbcbc admin admin] PATH_INFO: `/v3/projects/809a7c25963b4b0dae812a0cd13de4ba` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:00.944031 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab94e23-4640-452f-9fd9-b1acfb2fbcbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=809a7c25963b4b0dae812a0cd13de4ba)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:00.945986 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab94e23-4640-452f-9fd9-b1acfb2fbcbc admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:00.949734 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:00.960225 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1182/2370] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:51:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:00.960225 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8c00f-574a-45ab-9412-f6d3837a2c88 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:00.972597 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8c00f-574a-45ab-9412-f6d3837a2c88 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:00.978452 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c91c84-ef2a-4560-93bd-467b723dd740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:00.979224 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c91c84-ef2a-4560-93bd-467b723dd740 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:00.979650 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c91c84-ef2a-4560-93bd-467b723dd740 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:00.980114 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c91c84-ef2a-4560-93bd-467b723dd740 admin admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:00.980951 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c91c84-ef2a-4560-93bd-467b723dd740 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:51:00.981299 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c91c84-ef2a-4560-93bd-467b723dd740 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:00.983063 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c91c84-ef2a-4560-93bd-467b723dd740 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:00.996184 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1183/2371] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:51:00.998440 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c91c84-ef2a-4560-93bd-467b723dd740 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:01.000570 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-41c91c84-ef2a-4560-93bd-467b723dd740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:01.021725 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-cab94e23-4640-452f-9fd9-b1acfb2fbcbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '809a7c25963b4b0dae812a0cd13de4ba', 'request_id': 'req-cab94e23-4640-452f-9fd9-b1acfb2fbcbc'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:01.030780 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-cab94e23-4640-452f-9fd9-b1acfb2fbcbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '809a7c25963b4b0dae812a0cd13de4ba', 'request_id': 'req-cab94e23-4640-452f-9fd9-b1acfb2fbcbc'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:01.045616 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-cab94e23-4640-452f-9fd9-b1acfb2fbcbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '809a7c25963b4b0dae812a0cd13de4ba', 'request_id': 'req-cab94e23-4640-452f-9fd9-b1acfb2fbcbc'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:01.061398 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:01.069022 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-cab94e23-4640-452f-9fd9-b1acfb2fbcbc admin admin] The token cache is being invalidate because project 809a7c25963b4b0dae812a0cd13de4ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:01.069022 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-cab94e23-4640-452f-9fd9-b1acfb2fbcbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:01.070040 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-cab94e23-4640-452f-9fd9-b1acfb2fbcbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:01.071703 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c91c84-ef2a-4560-93bd-467b723dd740 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:01.071978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1189/2372] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:00 2022] DELETE /identity/v3/projects/809a7c25963b4b0dae812a0cd13de4ba => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:01.074490 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab94e23-4640-452f-9fd9-b1acfb2fbcbc admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:01.079007 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-cab94e23-4640-452f-9fd9-b1acfb2fbcbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:01.149571 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e071fd-47d3-445b-a718-e7c56c4e362d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be44ea93247420d994e24912a9ac32e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:01.150199 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e071fd-47d3-445b-a718-e7c56c4e362d service glance] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:01.150479 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e071fd-47d3-445b-a718-e7c56c4e362d service glance] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:01.150753 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e071fd-47d3-445b-a718-e7c56c4e362d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:01.153384 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab94e23-4640-452f-9fd9-b1acfb2fbcbc admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:01.153817 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-60e071fd-47d3-445b-a718-e7c56c4e362d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:01.157730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc957d79-f1e0-4939-9071-657d99dbaa99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:01.161139 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc957d79-f1e0-4939-9071-657d99dbaa99 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:01.161451 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc957d79-f1e0-4939-9071-657d99dbaa99 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:01.161935 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc957d79-f1e0-4939-9071-657d99dbaa99 admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:01.162714 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc957d79-f1e0-4939-9071-657d99dbaa99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:01.164649 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc957d79-f1e0-4939-9071-657d99dbaa99 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:01.197939 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1190/2373] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:01 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:01.198985 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc957d79-f1e0-4939-9071-657d99dbaa99 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:01.202978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-cc957d79-f1e0-4939-9071-657d99dbaa99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:01.222608 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e071fd-47d3-445b-a718-e7c56c4e362d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:01.224305 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e071fd-47d3-445b-a718-e7c56c4e362d service glance] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:01.234083 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1184/2374] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:01.240947 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e071fd-47d3-445b-a718-e7c56c4e362d service glance] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:01.252247 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e071fd-47d3-445b-a718-e7c56c4e362d service glance] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:01.306672 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc957d79-f1e0-4939-9071-657d99dbaa99 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:01.315094 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27554e2e-9670-41d1-9f4b-bd82dd63ac61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:01.315779 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27554e2e-9670-41d1-9f4b-bd82dd63ac61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:01.316060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27554e2e-9670-41d1-9f4b-bd82dd63ac61 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:01.316337 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27554e2e-9670-41d1-9f4b-bd82dd63ac61 admin admin] PATH_INFO: `/v3/users/8625d9e933ae4ceea52cd577f1fe2343` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:01.317523 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27554e2e-9670-41d1-9f4b-bd82dd63ac61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8625d9e933ae4ceea52cd577f1fe2343)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:01.319623 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27554e2e-9670-41d1-9f4b-bd82dd63ac61 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:01.330853 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:01.345839 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f938b7-53b9-4df7-82ce-4efe6fe44e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:01.346474 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f938b7-53b9-4df7-82ce-4efe6fe44e73 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:01.349633 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f938b7-53b9-4df7-82ce-4efe6fe44e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:01.350019 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f938b7-53b9-4df7-82ce-4efe6fe44e73 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:01.351121 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f938b7-53b9-4df7-82ce-4efe6fe44e73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:01.355536 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f938b7-53b9-4df7-82ce-4efe6fe44e73 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:01.382174 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1185/2375] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:01 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:01.386707 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f938b7-53b9-4df7-82ce-4efe6fe44e73 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:01.404343 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f938b7-53b9-4df7-82ce-4efe6fe44e73 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:01.411298 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-27554e2e-9670-41d1-9f4b-bd82dd63ac61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8625d9e933ae4ceea52cd577f1fe2343'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:01.411553 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083bff7-acc0-4810-8165-57f46a038108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:01.412165 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-27554e2e-9670-41d1-9f4b-bd82dd63ac61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8625d9e933ae4ceea52cd577f1fe2343'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:01.412861 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083bff7-acc0-4810-8165-57f46a038108 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:01.412986 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-27554e2e-9670-41d1-9f4b-bd82dd63ac61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8625d9e933ae4ceea52cd577f1fe2343'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:01.413760 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083bff7-acc0-4810-8165-57f46a038108 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:01.414488 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083bff7-acc0-4810-8165-57f46a038108 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:01.415663 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083bff7-acc0-4810-8165-57f46a038108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:01.417795 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083bff7-acc0-4810-8165-57f46a038108 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:01.439188 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1186/2376] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:51:01.441861 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-27554e2e-9670-41d1-9f4b-bd82dd63ac61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8625d9e933ae4ceea52cd577f1fe2343'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:01.445138 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083bff7-acc0-4810-8165-57f46a038108 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:01.448813 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-3083bff7-acc0-4810-8165-57f46a038108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:01.455259 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-27554e2e-9670-41d1-9f4b-bd82dd63ac61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8625d9e933ae4ceea52cd577f1fe2343'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:01.493106 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083bff7-acc0-4810-8165-57f46a038108 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:01.494468 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1191/2377] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:01 2022] DELETE /identity/v3/users/8625d9e933ae4ceea52cd577f1fe2343 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:01.582116 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d017c87-9bcf-4063-91f5-1df1cbce9798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:01.582809 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d017c87-9bcf-4063-91f5-1df1cbce9798 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:01.583178 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d017c87-9bcf-4063-91f5-1df1cbce9798 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:01.583514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d017c87-9bcf-4063-91f5-1df1cbce9798 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:01.584230 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d017c87-9bcf-4063-91f5-1df1cbce9798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:01.585963 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d017c87-9bcf-4063-91f5-1df1cbce9798 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:01.599875 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1187/2378] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:51:01.603874 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27554e2e-9670-41d1-9f4b-bd82dd63ac61 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:01.612663 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:01.622789 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27554e2e-9670-41d1-9f4b-bd82dd63ac61 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:01.631355 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c324dae-9a15-48f4-a98d-50ad2d6cce56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:01.632009 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c324dae-9a15-48f4-a98d-50ad2d6cce56 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:01.632516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c324dae-9a15-48f4-a98d-50ad2d6cce56 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:01.633447 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c324dae-9a15-48f4-a98d-50ad2d6cce56 admin admin] PATH_INFO: `/v3/projects/ff35d0db02e74a168243c2016ef2d787/users/67598b37f1aa49fe97dd37960a90d83e/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:01.652678 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c324dae-9a15-48f4-a98d-50ad2d6cce56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff35d0db02e74a168243c2016ef2d787, user_id=67598b37f1aa49fe97dd37960a90d83e, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:01.656559 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c324dae-9a15-48f4-a98d-50ad2d6cce56 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:01.674644 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1192/2379] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:01 2022] PUT /identity/v3/projects/ff35d0db02e74a168243c2016ef2d787/users/67598b37f1aa49fe97dd37960a90d83e/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:01.685680 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86d19e-5d36-4d8e-99df-b17eeee7ac3d None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:01.686511 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86d19e-5d36-4d8e-99df-b17eeee7ac3d None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:01.686837 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86d19e-5d36-4d8e-99df-b17eeee7ac3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:01.725442 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-bc86d19e-5d36-4d8e-99df-b17eeee7ac3d None None] MFA Rules not processed for user `67598b37f1aa49fe97dd37960a90d83e`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:01.726694 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-bc86d19e-5d36-4d8e-99df-b17eeee7ac3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:01.814645 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1188/2380] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:51:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:01.816213 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c324dae-9a15-48f4-a98d-50ad2d6cce56 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:01.898918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c324dae-9a15-48f4-a98d-50ad2d6cce56 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:01.901529 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86d19e-5d36-4d8e-99df-b17eeee7ac3d None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:01.903363 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-bc86d19e-5d36-4d8e-99df-b17eeee7ac3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:01.905130 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac49609-4b8d-4d54-bc69-3bab5e59ac38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:01.906079 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac49609-4b8d-4d54-bc69-3bab5e59ac38 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:01.906401 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac49609-4b8d-4d54-bc69-3bab5e59ac38 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:01.906725 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac49609-4b8d-4d54-bc69-3bab5e59ac38 admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:01.907554 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac49609-4b8d-4d54-bc69-3bab5e59ac38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:01.909785 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac49609-4b8d-4d54-bc69-3bab5e59ac38 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:01.918743 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc86d19e-5d36-4d8e-99df-b17eeee7ac3d None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:01.924028 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ddcb4a-01ec-4051-bd21-4ab86d022845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:01.925220 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddcb4a-01ec-4051-bd21-4ab86d022845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:01.925220 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddcb4a-01ec-4051-bd21-4ab86d022845 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:01.925381 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddcb4a-01ec-4051-bd21-4ab86d022845 admin admin] PATH_INFO: `/v3/projects/ff7db88acfd0471b94ba01a8d1300530` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:01.926599 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ddcb4a-01ec-4051-bd21-4ab86d022845 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff7db88acfd0471b94ba01a8d1300530)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:01.928698 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ddcb4a-01ec-4051-bd21-4ab86d022845 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:01.953219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1193/2381] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:01 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:01.957382 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac49609-4b8d-4d54-bc69-3bab5e59ac38 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:01.988311 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-50ddcb4a-01ec-4051-bd21-4ab86d022845 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff7db88acfd0471b94ba01a8d1300530', 'request_id': 'req-50ddcb4a-01ec-4051-bd21-4ab86d022845'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:01.992029 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:01.997246 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-50ddcb4a-01ec-4051-bd21-4ab86d022845 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff7db88acfd0471b94ba01a8d1300530', 'request_id': 'req-50ddcb4a-01ec-4051-bd21-4ab86d022845'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:02.005787 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-50ddcb4a-01ec-4051-bd21-4ab86d022845 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff7db88acfd0471b94ba01a8d1300530', 'request_id': 'req-50ddcb4a-01ec-4051-bd21-4ab86d022845'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:02.019446 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-50ddcb4a-01ec-4051-bd21-4ab86d022845 admin admin] The token cache is being invalidate because project ff7db88acfd0471b94ba01a8d1300530 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:02.019806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-50ddcb4a-01ec-4051-bd21-4ab86d022845 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:02.020546 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-50ddcb4a-01ec-4051-bd21-4ab86d022845 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:02.022371 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1189/2382] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:01 2022] DELETE /identity/v3/projects/ff7db88acfd0471b94ba01a8d1300530 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:02.025710 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac49609-4b8d-4d54-bc69-3bab5e59ac38 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:02.026883 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2f2a2-7865-4720-979b-673dbedb68e9 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:02.027173 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2f2a2-7865-4720-979b-673dbedb68e9 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:02.027450 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2f2a2-7865-4720-979b-673dbedb68e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:02.046508 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-70d2f2a2-7865-4720-979b-673dbedb68e9 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:02.047717 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-70d2f2a2-7865-4720-979b-673dbedb68e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:02.081878 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5592b2-8e4a-4cc2-a684-5bc0b5f0e8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:02.082498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5592b2-8e4a-4cc2-a684-5bc0b5f0e8bb admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:02.082778 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5592b2-8e4a-4cc2-a684-5bc0b5f0e8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:02.083050 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5592b2-8e4a-4cc2-a684-5bc0b5f0e8bb admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:02.083678 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5592b2-8e4a-4cc2-a684-5bc0b5f0e8bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:02.085677 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5592b2-8e4a-4cc2-a684-5bc0b5f0e8bb admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:02.102782 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:02.109026 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1194/2383] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:01 2022] POST /identity/v3/users => generated 287 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:51:02.111422 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1190/2384] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:51:02.112400 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5592b2-8e4a-4cc2-a684-5bc0b5f0e8bb admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:02.114056 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-8d5592b2-8e4a-4cc2-a684-5bc0b5f0e8bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:02.118982 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc15d0e-37dd-4b6e-b95f-1fb9daea9ae2 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:02.119275 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc15d0e-37dd-4b6e-b95f-1fb9daea9ae2 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:02.119587 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc15d0e-37dd-4b6e-b95f-1fb9daea9ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:02.125985 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5592b2-8e4a-4cc2-a684-5bc0b5f0e8bb admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:02.136549 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde83b38-b9f3-4c9d-b8d9-7d804586ad78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:02.137171 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde83b38-b9f3-4c9d-b8d9-7d804586ad78 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:02.137475 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde83b38-b9f3-4c9d-b8d9-7d804586ad78 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:02.137782 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde83b38-b9f3-4c9d-b8d9-7d804586ad78 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:02.138428 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde83b38-b9f3-4c9d-b8d9-7d804586ad78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:02.140034 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde83b38-b9f3-4c9d-b8d9-7d804586ad78 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:02.142612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-4dc15d0e-37dd-4b6e-b95f-1fb9daea9ae2 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:02.143882 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-4dc15d0e-37dd-4b6e-b95f-1fb9daea9ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:02.150532 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1195/2385] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:02.152443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1191/2386] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:51:02.156378 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc15d0e-37dd-4b6e-b95f-1fb9daea9ae2 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:02.156500 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde83b38-b9f3-4c9d-b8d9-7d804586ad78 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:02.167083 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc15d0e-37dd-4b6e-b95f-1fb9daea9ae2 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:02.168126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde83b38-b9f3-4c9d-b8d9-7d804586ad78 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:02.172114 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159a7ab-3fb9-4ce7-9dda-dd5eb91a289b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:02.172712 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159a7ab-3fb9-4ce7-9dda-dd5eb91a289b admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:02.172843 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec1281-1b9d-486e-992f-602d2a73c5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:02.172988 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159a7ab-3fb9-4ce7-9dda-dd5eb91a289b admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:02.173255 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159a7ab-3fb9-4ce7-9dda-dd5eb91a289b admin admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:02.173373 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec1281-1b9d-486e-992f-602d2a73c5ad admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:02.173622 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec1281-1b9d-486e-992f-602d2a73c5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:02.173899 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec1281-1b9d-486e-992f-602d2a73c5ad admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:02.174060 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159a7ab-3fb9-4ce7-9dda-dd5eb91a289b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:51:02.174371 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159a7ab-3fb9-4ce7-9dda-dd5eb91a289b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:02.174538 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec1281-1b9d-486e-992f-602d2a73c5ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:02.176016 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159a7ab-3fb9-4ce7-9dda-dd5eb91a289b admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:02.176218 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec1281-1b9d-486e-992f-602d2a73c5ad admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:02.190394 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1196/2387] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:02.190592 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1192/2388] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:51:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:51:02.192887 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159a7ab-3fb9-4ce7-9dda-dd5eb91a289b admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:02.193012 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec1281-1b9d-486e-992f-602d2a73c5ad admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:02.204256 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159a7ab-3fb9-4ce7-9dda-dd5eb91a289b admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:02.204549 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec1281-1b9d-486e-992f-602d2a73c5ad admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:02.209578 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921e416-d22e-449c-8a8b-fd118f2c66f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:02.209769 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb5b16-5c84-478e-99d2-3c02c808c8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:02.210234 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921e416-d22e-449c-8a8b-fd118f2c66f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:02.210365 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb5b16-5c84-478e-99d2-3c02c808c8f7 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:02.210513 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921e416-d22e-449c-8a8b-fd118f2c66f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:02.210642 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb5b16-5c84-478e-99d2-3c02c808c8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:02.210789 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921e416-d22e-449c-8a8b-fd118f2c66f8 admin admin] PATH_INFO: `/v3/projects/e6e898aa76734c2c87fb2c3fbcda40d0/users/e568b440a0144e3381b68e8639f0104c/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:02.210912 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb5b16-5c84-478e-99d2-3c02c808c8f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:02.211534 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb5b16-5c84-478e-99d2-3c02c808c8f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:02.213488 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb5b16-5c84-478e-99d2-3c02c808c8f7 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:02.225615 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921e416-d22e-449c-8a8b-fd118f2c66f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6e898aa76734c2c87fb2c3fbcda40d0, user_id=e568b440a0144e3381b68e8639f0104c, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:02.228290 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921e416-d22e-449c-8a8b-fd118f2c66f8 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:02.243330 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1197/2389] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:02 2022] PUT /identity/v3/projects/e6e898aa76734c2c87fb2c3fbcda40d0/users/e568b440a0144e3381b68e8639f0104c/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:02.246694 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1193/2390] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:02 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:02.254338 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921e416-d22e-449c-8a8b-fd118f2c66f8 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:02.254876 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce47b63-cc3d-497f-84d4-4c4daedc0e47 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:02.255212 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce47b63-cc3d-497f-84d4-4c4daedc0e47 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:02.255429 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce47b63-cc3d-497f-84d4-4c4daedc0e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:02.295395 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-9ce47b63-cc3d-497f-84d4-4c4daedc0e47 None None] MFA Rules not processed for user `e568b440a0144e3381b68e8639f0104c`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:02.296623 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-9ce47b63-cc3d-497f-84d4-4c4daedc0e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:02.338424 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921e416-d22e-449c-8a8b-fd118f2c66f8 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:02.383347 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1194/2391] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:51:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:02.387867 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce47b63-cc3d-497f-84d4-4c4daedc0e47 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:02.414636 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30406777-0d5a-4304-b6b2-721151a8ae6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:02.415256 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30406777-0d5a-4304-b6b2-721151a8ae6f admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:02.415529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30406777-0d5a-4304-b6b2-721151a8ae6f admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:02.415802 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30406777-0d5a-4304-b6b2-721151a8ae6f admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:02.416506 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30406777-0d5a-4304-b6b2-721151a8ae6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:02.418504 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30406777-0d5a-4304-b6b2-721151a8ae6f admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:02.433011 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:02.448693 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1198/2392] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:02 2022] POST /identity/v3/users => generated 285 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:02.453082 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30406777-0d5a-4304-b6b2-721151a8ae6f admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:02.464409 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30406777-0d5a-4304-b6b2-721151a8ae6f admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:02.468583 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce47b63-cc3d-497f-84d4-4c4daedc0e47 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:02.469122 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec8943-6e20-4d31-bb33-246d0fac65e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:02.469760 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec8943-6e20-4d31-bb33-246d0fac65e3 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:02.470038 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec8943-6e20-4d31-bb33-246d0fac65e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:02.470311 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec8943-6e20-4d31-bb33-246d0fac65e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:02.471047 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec8943-6e20-4d31-bb33-246d0fac65e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:02.472697 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec8943-6e20-4d31-bb33-246d0fac65e3 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:02.473778 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afcefc-e5f7-4a90-b614-afe218e7924b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:02.474584 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afcefc-e5f7-4a90-b614-afe218e7924b admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:02.474870 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afcefc-e5f7-4a90-b614-afe218e7924b admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:02.475146 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afcefc-e5f7-4a90-b614-afe218e7924b admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:02.475778 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afcefc-e5f7-4a90-b614-afe218e7924b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:02.477718 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afcefc-e5f7-4a90-b614-afe218e7924b admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:02.483426 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1199/2393] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:51:02.487204 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec8943-6e20-4d31-bb33-246d0fac65e3 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:02.497143 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec8943-6e20-4d31-bb33-246d0fac65e3 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:02.502393 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f674eda-c89d-4fc0-8165-5b2a614a0d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:02.503011 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f674eda-c89d-4fc0-8165-5b2a614a0d8b admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:02.503321 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f674eda-c89d-4fc0-8165-5b2a614a0d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:02.503598 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f674eda-c89d-4fc0-8165-5b2a614a0d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:02.504634 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f674eda-c89d-4fc0-8165-5b2a614a0d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:02.506366 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f674eda-c89d-4fc0-8165-5b2a614a0d8b admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:02.510735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1195/2394] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:02 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:02.515022 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afcefc-e5f7-4a90-b614-afe218e7924b admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:02.521122 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1200/2395] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:51:02.522026 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f674eda-c89d-4fc0-8165-5b2a614a0d8b admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:02.531557 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f674eda-c89d-4fc0-8165-5b2a614a0d8b admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:02.558521 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:02.580969 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afcefc-e5f7-4a90-b614-afe218e7924b admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:02.587110 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2da2ec-7636-48fe-ab39-90cf6c7189b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:02.587843 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2da2ec-7636-48fe-ab39-90cf6c7189b7 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:02.588123 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2da2ec-7636-48fe-ab39-90cf6c7189b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:02.588372 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2da2ec-7636-48fe-ab39-90cf6c7189b7 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:02.589056 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2da2ec-7636-48fe-ab39-90cf6c7189b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:02.592430 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2da2ec-7636-48fe-ab39-90cf6c7189b7 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:02.594015 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dce849-17ff-454f-8d4e-1582f8d73d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:02.594780 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dce849-17ff-454f-8d4e-1582f8d73d3e admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:02.595153 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dce849-17ff-454f-8d4e-1582f8d73d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:02.595493 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dce849-17ff-454f-8d4e-1582f8d73d3e admin admin] PATH_INFO: `/v3/projects/8eef2cf129084a66bec8ec2f64df0512/users/8ab0bcee008946ff87db3048e1864753/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:02.625422 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1196/2396] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:02 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:51:02.630578 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2da2ec-7636-48fe-ab39-90cf6c7189b7 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:02.645770 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2da2ec-7636-48fe-ab39-90cf6c7189b7 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:02.650920 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b18b6e4-db46-46da-9717-45fe4d8ddb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:02.651562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18b6e4-db46-46da-9717-45fe4d8ddb3a admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:02.651845 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18b6e4-db46-46da-9717-45fe4d8ddb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:02.652122 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18b6e4-db46-46da-9717-45fe4d8ddb3a admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:02.652817 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b18b6e4-db46-46da-9717-45fe4d8ddb3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:02.654732 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b18b6e4-db46-46da-9717-45fe4d8ddb3a admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:02.673452 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1197/2397] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:02.675412 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b18b6e4-db46-46da-9717-45fe4d8ddb3a admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:02.691415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b18b6e4-db46-46da-9717-45fe4d8ddb3a admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:02.698111 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6ef49-046d-4ad1-92c0-cbc6c11dd0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:02.699198 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6ef49-046d-4ad1-92c0-cbc6c11dd0bb admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:02.699698 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6ef49-046d-4ad1-92c0-cbc6c11dd0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:02.700164 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6ef49-046d-4ad1-92c0-cbc6c11dd0bb admin admin] PATH_INFO: `/v3/projects/bf94efa7d5e44073b54524d86dde0642/users/76141293e3ac47cf8b4b4642d28a7c58/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:02.720704 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6ef49-046d-4ad1-92c0-cbc6c11dd0bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf94efa7d5e44073b54524d86dde0642, user_id=76141293e3ac47cf8b4b4642d28a7c58, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:02.723625 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6ef49-046d-4ad1-92c0-cbc6c11dd0bb admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:02.744182 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1198/2398] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:02 2022] PUT /identity/v3/projects/bf94efa7d5e44073b54524d86dde0642/users/76141293e3ac47cf8b4b4642d28a7c58/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:02.748448 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6ef49-046d-4ad1-92c0-cbc6c11dd0bb admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:02.768438 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dce849-17ff-454f-8d4e-1582f8d73d3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eef2cf129084a66bec8ec2f64df0512, user_id=8ab0bcee008946ff87db3048e1864753, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:02.771892 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dce849-17ff-454f-8d4e-1582f8d73d3e admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:02.792106 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1201/2399] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:02 2022] PUT /identity/v3/projects/8eef2cf129084a66bec8ec2f64df0512/users/8ab0bcee008946ff87db3048e1864753/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:02.805619 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdee851-561a-48a9-be36-208712757207 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:02.805882 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdee851-561a-48a9-be36-208712757207 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:02.806211 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdee851-561a-48a9-be36-208712757207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:02.850453 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-3fdee851-561a-48a9-be36-208712757207 None None] MFA Rules not processed for user `8ab0bcee008946ff87db3048e1864753`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:02.851765 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-3fdee851-561a-48a9-be36-208712757207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:02.862791 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6ef49-046d-4ad1-92c0-cbc6c11dd0bb admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:02.882863 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:02.957090 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd221aa-aa91-4075-b1cf-d7c2dc1dac0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:02.957775 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd221aa-aa91-4075-b1cf-d7c2dc1dac0d admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:02.958054 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd221aa-aa91-4075-b1cf-d7c2dc1dac0d admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:02.958323 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd221aa-aa91-4075-b1cf-d7c2dc1dac0d admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:02.959314 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd221aa-aa91-4075-b1cf-d7c2dc1dac0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:02.960915 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd221aa-aa91-4075-b1cf-d7c2dc1dac0d admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:02.975498 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1199/2400] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:02.975706 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1202/2401] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:51:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:51:02.976933 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd221aa-aa91-4075-b1cf-d7c2dc1dac0d admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:02.986453 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdee851-561a-48a9-be36-208712757207 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:02.987517 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd221aa-aa91-4075-b1cf-d7c2dc1dac0d admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:02.988627 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-3fdee851-561a-48a9-be36-208712757207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:02.995655 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7167dc0-ff78-4bea-bf15-ae2979be09e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:02.996485 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7167dc0-ff78-4bea-bf15-ae2979be09e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:02.996765 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7167dc0-ff78-4bea-bf15-ae2979be09e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:02.997037 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7167dc0-ff78-4bea-bf15-ae2979be09e4 admin admin] PATH_INFO: `/v3/projects/bf94efa7d5e44073b54524d86dde0642/users/76141293e3ac47cf8b4b4642d28a7c58/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:03.000086 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7167dc0-ff78-4bea-bf15-ae2979be09e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf94efa7d5e44073b54524d86dde0642, user_id=76141293e3ac47cf8b4b4642d28a7c58, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:03.002853 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7167dc0-ff78-4bea-bf15-ae2979be09e4 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:03.013905 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1200/2402] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:02 2022] PUT /identity/v3/projects/bf94efa7d5e44073b54524d86dde0642/users/76141293e3ac47cf8b4b4642d28a7c58/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:51:03.027185 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483dcf56-a3e0-4712-b999-952085ce3b4d None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:03.027471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483dcf56-a3e0-4712-b999-952085ce3b4d None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:03.027773 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483dcf56-a3e0-4712-b999-952085ce3b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:03.055767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-483dcf56-a3e0-4712-b999-952085ce3b4d None None] MFA Rules not processed for user `76141293e3ac47cf8b4b4642d28a7c58`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:03.056986 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-483dcf56-a3e0-4712-b999-952085ce3b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:03.057527 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdee851-561a-48a9-be36-208712757207 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:03.115159 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff8410-ebd6-447a-aa64-064e85a304a5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be44ea93247420d994e24912a9ac32e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:03.115920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff8410-ebd6-447a-aa64-064e85a304a5 service glance] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:03.116272 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff8410-ebd6-447a-aa64-064e85a304a5 service glance] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:03.116644 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff8410-ebd6-447a-aa64-064e85a304a5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:03.127711 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:03.143992 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1201/2403] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:51:03 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:03.155592 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483dcf56-a3e0-4712-b999-952085ce3b4d None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:03.157909 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-483dcf56-a3e0-4712-b999-952085ce3b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:03.194287 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff8410-ebd6-447a-aa64-064e85a304a5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:03.197266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff8410-ebd6-447a-aa64-064e85a304a5 service glance] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:03.212371 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1203/2404] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:51:03.231651 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483dcf56-a3e0-4712-b999-952085ce3b4d None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:03.239706 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53dcef-59bf-40de-9759-416c1e53b1b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:03.239706 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53dcef-59bf-40de-9759-416c1e53b1b1 service cinder] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:03.239706 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53dcef-59bf-40de-9759-416c1e53b1b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:03.239706 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53dcef-59bf-40de-9759-416c1e53b1b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:03.240018 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-fc53dcef-59bf-40de-9759-416c1e53b1b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:03.291009 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:03.315478 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53dcef-59bf-40de-9759-416c1e53b1b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:03.316960 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53dcef-59bf-40de-9759-416c1e53b1b1 service cinder] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:03.326283 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1202/2405] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:51:04.962813 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff8410-ebd6-447a-aa64-064e85a304a5 service glance] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:04.974197 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff8410-ebd6-447a-aa64-064e85a304a5 service glance] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:04.979597 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921c865-d98d-44f9-9089-0b8a0e8d339e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:04.980215 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921c865-d98d-44f9-9089-0b8a0e8d339e service cinder] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:04.980841 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921c865-d98d-44f9-9089-0b8a0e8d339e service cinder] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:04.980841 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921c865-d98d-44f9-9089-0b8a0e8d339e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:05.070825 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921c865-d98d-44f9-9089-0b8a0e8d339e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:05.073077 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921c865-d98d-44f9-9089-0b8a0e8d339e service cinder] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:05.083278 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1204/2406] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:51:05.703084 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53dcef-59bf-40de-9759-416c1e53b1b1 service cinder] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:05.712688 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53dcef-59bf-40de-9759-416c1e53b1b1 service cinder] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:05.716629 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8331d26-1d66-4eb2-86fb-4e8336a6b451 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:05.717257 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8331d26-1d66-4eb2-86fb-4e8336a6b451 service cinder] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:05.717585 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8331d26-1d66-4eb2-86fb-4e8336a6b451 service cinder] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:05.717862 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8331d26-1d66-4eb2-86fb-4e8336a6b451 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:05.729007 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8331d26-1d66-4eb2-86fb-4e8336a6b451 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:05.730483 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8331d26-1d66-4eb2-86fb-4e8336a6b451 service cinder] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:05.742119 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1203/2407] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:07.260876 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921c865-d98d-44f9-9089-0b8a0e8d339e service cinder] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:07.263234 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-c921c865-d98d-44f9-9089-0b8a0e8d339e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:07.340255 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921c865-d98d-44f9-9089-0b8a0e8d339e service cinder] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:07.346981 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08004081-5a4b-48ea-b03e-03578f925c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:07.347657 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08004081-5a4b-48ea-b03e-03578f925c4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:07.347944 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08004081-5a4b-48ea-b03e-03578f925c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:07.348216 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08004081-5a4b-48ea-b03e-03578f925c4b admin admin] PATH_INFO: `/v3/users/2f15f3fa87c54edc833d933457104c96` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:07.349417 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08004081-5a4b-48ea-b03e-03578f925c4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f15f3fa87c54edc833d933457104c96)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:07.351369 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08004081-5a4b-48ea-b03e-03578f925c4b admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:07.403074 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-08004081-5a4b-48ea-b03e-03578f925c4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f15f3fa87c54edc833d933457104c96'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:07.403955 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-08004081-5a4b-48ea-b03e-03578f925c4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f15f3fa87c54edc833d933457104c96'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:07.404554 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-08004081-5a4b-48ea-b03e-03578f925c4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f15f3fa87c54edc833d933457104c96'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:07.409137 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:07.418508 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-08004081-5a4b-48ea-b03e-03578f925c4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f15f3fa87c54edc833d933457104c96'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:07.426880 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-08004081-5a4b-48ea-b03e-03578f925c4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f15f3fa87c54edc833d933457104c96'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:07.439952 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1205/2408] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:07 2022] DELETE /identity/v3/users/2f15f3fa87c54edc833d933457104c96 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:07.444618 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccf613-03a5-4244-b068-65bfff4d4822 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:07.445097 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccf613-03a5-4244-b068-65bfff4d4822 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:07.445298 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ccf613-03a5-4244-b068-65bfff4d4822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:07.465295 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-42ccf613-03a5-4244-b068-65bfff4d4822 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:07.466575 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-42ccf613-03a5-4244-b068-65bfff4d4822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:07.530461 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1204/2409] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:51:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:51:07.542109 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08004081-5a4b-48ea-b03e-03578f925c4b admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:07.543740 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-08004081-5a4b-48ea-b03e-03578f925c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:07.604814 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08004081-5a4b-48ea-b03e-03578f925c4b admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:07.609054 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c82715d-e9b6-4a20-98f9-25c575de278b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:07.609687 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82715d-e9b6-4a20-98f9-25c575de278b service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:07.609962 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82715d-e9b6-4a20-98f9-25c575de278b service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:07.610233 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c82715d-e9b6-4a20-98f9-25c575de278b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:07.621794 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c82715d-e9b6-4a20-98f9-25c575de278b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:07.623938 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c82715d-e9b6-4a20-98f9-25c575de278b service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:07.636245 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1206/2410] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:07.930603 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ccf613-03a5-4244-b068-65bfff4d4822 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:07.932065 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-42ccf613-03a5-4244-b068-65bfff4d4822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:07.949532 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ccf613-03a5-4244-b068-65bfff4d4822 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:07.954502 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828aaaff-15e5-43ce-9e56-b6ed7cd01ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:07.955369 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828aaaff-15e5-43ce-9e56-b6ed7cd01ef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:07.955606 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828aaaff-15e5-43ce-9e56-b6ed7cd01ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:07.956036 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828aaaff-15e5-43ce-9e56-b6ed7cd01ef2 admin admin] PATH_INFO: `/v3/projects/9aa07466fa7b4d60b7386c05060c1817` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:07.957506 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828aaaff-15e5-43ce-9e56-b6ed7cd01ef2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aa07466fa7b4d60b7386c05060c1817)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:07.959647 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828aaaff-15e5-43ce-9e56-b6ed7cd01ef2 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:08.023569 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-828aaaff-15e5-43ce-9e56-b6ed7cd01ef2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aa07466fa7b4d60b7386c05060c1817', 'request_id': 'req-828aaaff-15e5-43ce-9e56-b6ed7cd01ef2'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:08.046213 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-828aaaff-15e5-43ce-9e56-b6ed7cd01ef2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aa07466fa7b4d60b7386c05060c1817', 'request_id': 'req-828aaaff-15e5-43ce-9e56-b6ed7cd01ef2'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:08.046213 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-828aaaff-15e5-43ce-9e56-b6ed7cd01ef2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aa07466fa7b4d60b7386c05060c1817', 'request_id': 'req-828aaaff-15e5-43ce-9e56-b6ed7cd01ef2'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:08.056487 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-828aaaff-15e5-43ce-9e56-b6ed7cd01ef2 admin admin] The token cache is being invalidate because project 9aa07466fa7b4d60b7386c05060c1817 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:08.056845 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-828aaaff-15e5-43ce-9e56-b6ed7cd01ef2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:08.057613 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-828aaaff-15e5-43ce-9e56-b6ed7cd01ef2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:08.059193 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1205/2411] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:07 2022] DELETE /identity/v3/projects/9aa07466fa7b4d60b7386c05060c1817 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:51:08.065037 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6a246-de7b-49d4-95f9-03a8f6fbdf4b None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:08.065504 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6a246-de7b-49d4-95f9-03a8f6fbdf4b None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:08.065875 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6a246-de7b-49d4-95f9-03a8f6fbdf4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:08.085952 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-82c6a246-de7b-49d4-95f9-03a8f6fbdf4b None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:08.087242 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-82c6a246-de7b-49d4-95f9-03a8f6fbdf4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:08.159496 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1207/2412] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:51:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:08.167272 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77486525-620a-4758-b176-caab46d1faad None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:08.167636 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77486525-620a-4758-b176-caab46d1faad None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:08.167978 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77486525-620a-4758-b176-caab46d1faad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:08.193924 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-77486525-620a-4758-b176-caab46d1faad None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:08.195352 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-77486525-620a-4758-b176-caab46d1faad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:08.205829 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1206/2413] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:51:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:08.209371 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6a246-de7b-49d4-95f9-03a8f6fbdf4b None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:08.218994 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6a246-de7b-49d4-95f9-03a8f6fbdf4b None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:08.224963 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97fe58-8c7c-4061-aa8c-bf3ab16f161f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:08.229756 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97fe58-8c7c-4061-aa8c-bf3ab16f161f admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:08.230330 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97fe58-8c7c-4061-aa8c-bf3ab16f161f admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:08.230867 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97fe58-8c7c-4061-aa8c-bf3ab16f161f admin admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:08.231868 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d97fe58-8c7c-4061-aa8c-bf3ab16f161f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:51:08.232171 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d97fe58-8c7c-4061-aa8c-bf3ab16f161f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:08.233816 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d97fe58-8c7c-4061-aa8c-bf3ab16f161f admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:08.249545 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1208/2414] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:51:08.250876 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77486525-620a-4758-b176-caab46d1faad None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:08.261839 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77486525-620a-4758-b176-caab46d1faad None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:08.267090 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc499c9-2228-458b-b71d-cba595af6328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:08.267781 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc499c9-2228-458b-b71d-cba595af6328 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:08.268070 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc499c9-2228-458b-b71d-cba595af6328 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:08.268341 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc499c9-2228-458b-b71d-cba595af6328 admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:08.268969 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc499c9-2228-458b-b71d-cba595af6328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:08.271059 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc499c9-2228-458b-b71d-cba595af6328 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:08.317063 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1207/2415] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:08 2022] POST /identity/v3/projects => generated 371 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:08.321433 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97fe58-8c7c-4061-aa8c-bf3ab16f161f admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:08.334572 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97fe58-8c7c-4061-aa8c-bf3ab16f161f admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:08.443665 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec55cf-2f57-4def-9c90-d97a14d6be0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:08.444283 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec55cf-2f57-4def-9c90-d97a14d6be0c admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:08.444556 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec55cf-2f57-4def-9c90-d97a14d6be0c admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:08.444890 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec55cf-2f57-4def-9c90-d97a14d6be0c admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:08.445469 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec55cf-2f57-4def-9c90-d97a14d6be0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:08.447417 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfec55cf-2f57-4def-9c90-d97a14d6be0c admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:08.455963 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:08.477440 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1209/2416] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:08 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:08.481619 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc499c9-2228-458b-b71d-cba595af6328 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:08.496448 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc499c9-2228-458b-b71d-cba595af6328 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:08.503614 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6598c61-b041-45c0-bbb2-5304cf8da9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:08.504324 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6598c61-b041-45c0-bbb2-5304cf8da9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:08.504981 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6598c61-b041-45c0-bbb2-5304cf8da9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:08.505523 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6598c61-b041-45c0-bbb2-5304cf8da9b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:08.506641 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6598c61-b041-45c0-bbb2-5304cf8da9b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:08.508449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6598c61-b041-45c0-bbb2-5304cf8da9b8 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:08.524725 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1208/2417] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:51:08.531338 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec55cf-2f57-4def-9c90-d97a14d6be0c admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:08.550540 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfec55cf-2f57-4def-9c90-d97a14d6be0c admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:08.562530 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05926b6e-b751-43b4-b9ce-1b366a639f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:08.563957 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05926b6e-b751-43b4-b9ce-1b366a639f09 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:08.564232 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05926b6e-b751-43b4-b9ce-1b366a639f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:08.564494 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05926b6e-b751-43b4-b9ce-1b366a639f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:08.565141 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05926b6e-b751-43b4-b9ce-1b366a639f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:08.567179 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05926b6e-b751-43b4-b9ce-1b366a639f09 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:08.585377 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1210/2418] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:08.589749 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6598c61-b041-45c0-bbb2-5304cf8da9b8 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:08.605922 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6598c61-b041-45c0-bbb2-5304cf8da9b8 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:08.612284 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce39364-29af-4a41-9589-949741b6784d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:08.613225 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce39364-29af-4a41-9589-949741b6784d admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:08.613685 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce39364-29af-4a41-9589-949741b6784d admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:08.614120 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce39364-29af-4a41-9589-949741b6784d admin admin] PATH_INFO: `/v3/projects/6a6cd201986143a19c3be1f20d3055d3/users/d6b8d76952d14f329e10a53f55f30e11/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:08.628875 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:08.652737 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce39364-29af-4a41-9589-949741b6784d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a6cd201986143a19c3be1f20d3055d3, user_id=d6b8d76952d14f329e10a53f55f30e11, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:08.655483 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce39364-29af-4a41-9589-949741b6784d admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:08.674933 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1209/2419] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:08 2022] PUT /identity/v3/projects/6a6cd201986143a19c3be1f20d3055d3/users/d6b8d76952d14f329e10a53f55f30e11/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:08.685872 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45115a-411e-472d-8928-43676aa35a82 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:08.686153 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45115a-411e-472d-8928-43676aa35a82 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:08.686432 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45115a-411e-472d-8928-43676aa35a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:08.728109 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-eb45115a-411e-472d-8928-43676aa35a82 None None] MFA Rules not processed for user `d6b8d76952d14f329e10a53f55f30e11`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:08.729316 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-eb45115a-411e-472d-8928-43676aa35a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:08.803603 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1211/2420] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:51:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:51:08.815379 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce39364-29af-4a41-9589-949741b6784d admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:08.817261 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-8ce39364-29af-4a41-9589-949741b6784d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:08.879084 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce39364-29af-4a41-9589-949741b6784d admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:08.886177 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2bf07b-e368-434c-a238-d3f9ddd1c810 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:08.886953 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bf07b-e368-434c-a238-d3f9ddd1c810 service cinder] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:08.887325 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bf07b-e368-434c-a238-d3f9ddd1c810 service cinder] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:08.887718 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2bf07b-e368-434c-a238-d3f9ddd1c810 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:08.899588 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2bf07b-e368-434c-a238-d3f9ddd1c810 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:08.901219 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2bf07b-e368-434c-a238-d3f9ddd1c810 service cinder] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:08.910820 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1210/2421] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:08.936047 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45115a-411e-472d-8928-43676aa35a82 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:09.014467 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45115a-411e-472d-8928-43676aa35a82 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:09.020209 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f5aae-32a9-4dcf-aa15-b61dfe6dd8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:09.020835 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f5aae-32a9-4dcf-aa15-b61dfe6dd8c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:09.021225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f5aae-32a9-4dcf-aa15-b61dfe6dd8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:09.021556 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f5aae-32a9-4dcf-aa15-b61dfe6dd8c7 admin admin] PATH_INFO: `/v3/users/d6b8d76952d14f329e10a53f55f30e11` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:09.022658 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f5aae-32a9-4dcf-aa15-b61dfe6dd8c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6b8d76952d14f329e10a53f55f30e11)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:09.024652 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f5aae-32a9-4dcf-aa15-b61dfe6dd8c7 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:09.088934 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-a53f5aae-32a9-4dcf-aa15-b61dfe6dd8c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6b8d76952d14f329e10a53f55f30e11'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:09.090088 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-a53f5aae-32a9-4dcf-aa15-b61dfe6dd8c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6b8d76952d14f329e10a53f55f30e11'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:09.090849 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-a53f5aae-32a9-4dcf-aa15-b61dfe6dd8c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6b8d76952d14f329e10a53f55f30e11'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:09.112716 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-a53f5aae-32a9-4dcf-aa15-b61dfe6dd8c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6b8d76952d14f329e10a53f55f30e11'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:09.116832 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:09.121814 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-a53f5aae-32a9-4dcf-aa15-b61dfe6dd8c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6b8d76952d14f329e10a53f55f30e11'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:09.145170 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1212/2422] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:08 2022] DELETE /identity/v3/users/d6b8d76952d14f329e10a53f55f30e11 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:09.147291 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac5cfa-34b8-4c36-87f6-c880c0b0a0cf None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:09.147973 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac5cfa-34b8-4c36-87f6-c880c0b0a0cf None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:09.148465 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac5cfa-34b8-4c36-87f6-c880c0b0a0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:09.179952 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-36ac5cfa-34b8-4c36-87f6-c880c0b0a0cf None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:09.183336 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-36ac5cfa-34b8-4c36-87f6-c880c0b0a0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:09.298539 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1211/2423] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:09.308702 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f5aae-32a9-4dcf-aa15-b61dfe6dd8c7 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:09.312897 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-a53f5aae-32a9-4dcf-aa15-b61dfe6dd8c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:09.372671 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f5aae-32a9-4dcf-aa15-b61dfe6dd8c7 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:09.376364 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c43793-c36c-4ad9-968f-f791573f7612 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:09.376966 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c43793-c36c-4ad9-968f-f791573f7612 service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:09.377244 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c43793-c36c-4ad9-968f-f791573f7612 service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:09.377540 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c43793-c36c-4ad9-968f-f791573f7612 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:09.387502 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c43793-c36c-4ad9-968f-f791573f7612 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:09.388945 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c43793-c36c-4ad9-968f-f791573f7612 service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:09.398392 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1213/2424] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:09.499304 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ed978-ebf0-48f0-82f7-eb989c0dfe4e None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:09.499819 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ed978-ebf0-48f0-82f7-eb989c0dfe4e None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:09.499980 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ed978-ebf0-48f0-82f7-eb989c0dfe4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:09.520925 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-949ed978-ebf0-48f0-82f7-eb989c0dfe4e None None] MFA Rules not processed for user `b5c9dc6172654ed393a63ce65519975a`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:09.521918 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-949ed978-ebf0-48f0-82f7-eb989c0dfe4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:09.579356 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1212/2425] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:51:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:09.676813 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c43793-c36c-4ad9-968f-f791573f7612 service neutron] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:09.678280 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-81c43793-c36c-4ad9-968f-f791573f7612 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:09.694414 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c43793-c36c-4ad9-968f-f791573f7612 service neutron] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:09.700785 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92730808-ef6d-4a27-bdca-028fdd30961b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:09.701470 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92730808-ef6d-4a27-bdca-028fdd30961b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:09.701746 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92730808-ef6d-4a27-bdca-028fdd30961b admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:09.702031 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92730808-ef6d-4a27-bdca-028fdd30961b admin admin] PATH_INFO: `/v3/projects/6a6cd201986143a19c3be1f20d3055d3` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:09.703216 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92730808-ef6d-4a27-bdca-028fdd30961b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a6cd201986143a19c3be1f20d3055d3)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:09.705147 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92730808-ef6d-4a27-bdca-028fdd30961b admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:09.757656 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-92730808-ef6d-4a27-bdca-028fdd30961b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a6cd201986143a19c3be1f20d3055d3', 'request_id': 'req-92730808-ef6d-4a27-bdca-028fdd30961b'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:09.764094 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-92730808-ef6d-4a27-bdca-028fdd30961b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a6cd201986143a19c3be1f20d3055d3', 'request_id': 'req-92730808-ef6d-4a27-bdca-028fdd30961b'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:09.773087 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-92730808-ef6d-4a27-bdca-028fdd30961b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a6cd201986143a19c3be1f20d3055d3', 'request_id': 'req-92730808-ef6d-4a27-bdca-028fdd30961b'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:09.789477 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-92730808-ef6d-4a27-bdca-028fdd30961b admin admin] The token cache is being invalidate because project 6a6cd201986143a19c3be1f20d3055d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:09.789814 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-92730808-ef6d-4a27-bdca-028fdd30961b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:09.790543 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-92730808-ef6d-4a27-bdca-028fdd30961b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:09.792364 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1214/2426] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:09 2022] DELETE /identity/v3/projects/6a6cd201986143a19c3be1f20d3055d3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:09.797500 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b14bed-58da-48a3-afe3-973addf13993 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:09.797857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b14bed-58da-48a3-afe3-973addf13993 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:09.798364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b14bed-58da-48a3-afe3-973addf13993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:09.824611 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-b7b14bed-58da-48a3-afe3-973addf13993 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:09.826362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-b7b14bed-58da-48a3-afe3-973addf13993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:09.856554 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92730808-ef6d-4a27-bdca-028fdd30961b admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:09.858552 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-92730808-ef6d-4a27-bdca-028fdd30961b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:09.886811 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:09.928815 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1213/2427] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:09.935078 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92730808-ef6d-4a27-bdca-028fdd30961b admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:09.936771 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351918c7-007a-4d76-8702-93a003154efc None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:09.937067 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351918c7-007a-4d76-8702-93a003154efc None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:09.937519 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351918c7-007a-4d76-8702-93a003154efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:09.939856 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c77f1-6b6b-430d-a1e9-e3ea7d054b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:09.940515 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c77f1-6b6b-430d-a1e9-e3ea7d054b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:09.940791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c77f1-6b6b-430d-a1e9-e3ea7d054b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:09.941173 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c77f1-6b6b-430d-a1e9-e3ea7d054b95 admin admin] PATH_INFO: `/v3/users/67598b37f1aa49fe97dd37960a90d83e` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:09.942288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c77f1-6b6b-430d-a1e9-e3ea7d054b95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67598b37f1aa49fe97dd37960a90d83e)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:09.944204 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c77f1-6b6b-430d-a1e9-e3ea7d054b95 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:09.957704 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-351918c7-007a-4d76-8702-93a003154efc None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:09.958996 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-351918c7-007a-4d76-8702-93a003154efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:09.962826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:09.968022 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1214/2428] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:09.972211 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351918c7-007a-4d76-8702-93a003154efc None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:09.985305 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351918c7-007a-4d76-8702-93a003154efc None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:09.990534 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0aa30-6373-4994-88ba-f07051fabf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:09.991152 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0aa30-6373-4994-88ba-f07051fabf95 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:09.991432 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0aa30-6373-4994-88ba-f07051fabf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:09.991739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0aa30-6373-4994-88ba-f07051fabf95 admin admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:09.992359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0aa30-6373-4994-88ba-f07051fabf95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:51:09.992659 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0aa30-6373-4994-88ba-f07051fabf95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:09.994485 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0aa30-6373-4994-88ba-f07051fabf95 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:09.999818 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-3c7c77f1-6b6b-430d-a1e9-e3ea7d054b95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67598b37f1aa49fe97dd37960a90d83e'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:10.000463 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-3c7c77f1-6b6b-430d-a1e9-e3ea7d054b95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67598b37f1aa49fe97dd37960a90d83e'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:10.001086 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-3c7c77f1-6b6b-430d-a1e9-e3ea7d054b95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67598b37f1aa49fe97dd37960a90d83e'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:10.007024 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1215/2429] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:51:10.011495 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0aa30-6373-4994-88ba-f07051fabf95 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:10.013435 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-02a0aa30-6373-4994-88ba-f07051fabf95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:10.015171 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-3c7c77f1-6b6b-430d-a1e9-e3ea7d054b95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67598b37f1aa49fe97dd37960a90d83e'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:10.024628 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-3c7c77f1-6b6b-430d-a1e9-e3ea7d054b95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67598b37f1aa49fe97dd37960a90d83e'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:10.027190 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0aa30-6373-4994-88ba-f07051fabf95 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:10.032315 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809f613-48c9-48ea-a93f-962d39ac64a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:10.032947 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809f613-48c9-48ea-a93f-962d39ac64a0 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:10.033227 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809f613-48c9-48ea-a93f-962d39ac64a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:10.033534 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809f613-48c9-48ea-a93f-962d39ac64a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:10.034216 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6809f613-48c9-48ea-a93f-962d39ac64a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:10.036353 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6809f613-48c9-48ea-a93f-962d39ac64a0 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:10.040383 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1215/2430] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:09 2022] DELETE /identity/v3/users/67598b37f1aa49fe97dd37960a90d83e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:51:10.044804 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ab219-cfac-44bf-82a6-f564e0fe5a27 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:10.045089 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ab219-cfac-44bf-82a6-f564e0fe5a27 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:10.045390 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ab219-cfac-44bf-82a6-f564e0fe5a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:10.064027 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-288ab219-cfac-44bf-82a6-f564e0fe5a27 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:10.065149 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-288ab219-cfac-44bf-82a6-f564e0fe5a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:10.065417 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1216/2431] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:10 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:51:10.069617 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809f613-48c9-48ea-a93f-962d39ac64a0 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:10.129498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1216/2432] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:51:10.139404 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ab219-cfac-44bf-82a6-f564e0fe5a27 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:10.140986 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-288ab219-cfac-44bf-82a6-f564e0fe5a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:10.157599 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809f613-48c9-48ea-a93f-962d39ac64a0 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:10.165123 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23239e-5c77-4d8a-bbed-6dac8d5a9c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:10.165987 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23239e-5c77-4d8a-bbed-6dac8d5a9c0f admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:10.166476 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23239e-5c77-4d8a-bbed-6dac8d5a9c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:10.167569 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de23239e-5c77-4d8a-bbed-6dac8d5a9c0f admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:10.168471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de23239e-5c77-4d8a-bbed-6dac8d5a9c0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:10.173561 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de23239e-5c77-4d8a-bbed-6dac8d5a9c0f admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:10.202202 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ab219-cfac-44bf-82a6-f564e0fe5a27 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:10.206972 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1217/2433] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:10 2022] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:51:10.208058 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23239e-5c77-4d8a-bbed-6dac8d5a9c0f admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:10.209323 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45c45b-ff41-45d8-a917-a9857055d677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:10.209998 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45c45b-ff41-45d8-a917-a9857055d677 service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:10.210324 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45c45b-ff41-45d8-a917-a9857055d677 service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:10.210594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45c45b-ff41-45d8-a917-a9857055d677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:10.217838 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de23239e-5c77-4d8a-bbed-6dac8d5a9c0f admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:10.219862 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45c45b-ff41-45d8-a917-a9857055d677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:10.221397 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45c45b-ff41-45d8-a917-a9857055d677 service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:10.222440 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800193d9-dd37-4d5e-8923-25cc918b7e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:10.223030 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800193d9-dd37-4d5e-8923-25cc918b7e0f admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:10.223309 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800193d9-dd37-4d5e-8923-25cc918b7e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:10.223576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800193d9-dd37-4d5e-8923-25cc918b7e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:10.224211 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800193d9-dd37-4d5e-8923-25cc918b7e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:10.226304 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800193d9-dd37-4d5e-8923-25cc918b7e0f admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:10.231284 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1217/2434] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:10.237832 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1218/2435] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:51:10.241702 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45c45b-ff41-45d8-a917-a9857055d677 service neutron] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:10.253262 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45c45b-ff41-45d8-a917-a9857055d677 service neutron] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:10.258524 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28374a9-b8a1-4c6f-82e1-d5aa92737b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:10.259151 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28374a9-b8a1-4c6f-82e1-d5aa92737b8c admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:10.259430 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28374a9-b8a1-4c6f-82e1-d5aa92737b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:10.259701 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28374a9-b8a1-4c6f-82e1-d5aa92737b8c admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:10.260337 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28374a9-b8a1-4c6f-82e1-d5aa92737b8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:10.261970 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28374a9-b8a1-4c6f-82e1-d5aa92737b8c admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:10.275418 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1218/2436] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:10.277225 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800193d9-dd37-4d5e-8923-25cc918b7e0f admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:10.290587 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800193d9-dd37-4d5e-8923-25cc918b7e0f admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:10.296830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b0fdd-abcf-4a49-8633-10c8c997eee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:10.297714 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b0fdd-abcf-4a49-8633-10c8c997eee8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:10.298134 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b0fdd-abcf-4a49-8633-10c8c997eee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:10.298535 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67b0fdd-abcf-4a49-8633-10c8c997eee8 admin admin] PATH_INFO: `/v3/projects/60c44f57457342299a2e77b9c9fb5e30/users/2442c3698cd5422493efa014c47ab8eb/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:10.317634 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b0fdd-abcf-4a49-8633-10c8c997eee8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60c44f57457342299a2e77b9c9fb5e30, user_id=2442c3698cd5422493efa014c47ab8eb, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:10.320236 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67b0fdd-abcf-4a49-8633-10c8c997eee8 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:10.346611 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1219/2437] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:10 2022] PUT /identity/v3/projects/60c44f57457342299a2e77b9c9fb5e30/users/2442c3698cd5422493efa014c47ab8eb/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:10.357610 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e59f3a-fbbb-47ea-b080-24ddb2eccee2 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:10.358297 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e59f3a-fbbb-47ea-b080-24ddb2eccee2 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:10.359142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e59f3a-fbbb-47ea-b080-24ddb2eccee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:10.407171 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-a5e59f3a-fbbb-47ea-b080-24ddb2eccee2 None None] MFA Rules not processed for user `2442c3698cd5422493efa014c47ab8eb`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:10.408474 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-a5e59f3a-fbbb-47ea-b080-24ddb2eccee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:10.423683 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:10.487244 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1219/2438] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:51:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:10.498598 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b0fdd-abcf-4a49-8633-10c8c997eee8 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:10.500399 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-a67b0fdd-abcf-4a49-8633-10c8c997eee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:10.543894 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e59f3a-fbbb-47ea-b080-24ddb2eccee2 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:10.545164 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-a5e59f3a-fbbb-47ea-b080-24ddb2eccee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:10.574367 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:10.580515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67b0fdd-abcf-4a49-8633-10c8c997eee8 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:10.586789 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ec232-0392-40a4-a895-239e2fbcac14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:10.587463 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ec232-0392-40a4-a895-239e2fbcac14 service cinder] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:10.587936 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ec232-0392-40a4-a895-239e2fbcac14 service cinder] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:10.588220 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ec232-0392-40a4-a895-239e2fbcac14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:10.600629 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ec232-0392-40a4-a895-239e2fbcac14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:10.602648 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ec232-0392-40a4-a895-239e2fbcac14 service cinder] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:10.616722 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1220/2439] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:10.638677 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e59f3a-fbbb-47ea-b080-24ddb2eccee2 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:10.644751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c72d4-b8c1-4551-a442-3c282fcaf28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:10.645476 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c72d4-b8c1-4551-a442-3c282fcaf28c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:10.645758 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c72d4-b8c1-4551-a442-3c282fcaf28c admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:10.646028 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c72d4-b8c1-4551-a442-3c282fcaf28c admin admin] PATH_INFO: `/v3/projects/ff35d0db02e74a168243c2016ef2d787` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:10.647196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c72d4-b8c1-4551-a442-3c282fcaf28c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff35d0db02e74a168243c2016ef2d787)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:10.649436 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c72d4-b8c1-4551-a442-3c282fcaf28c admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:10.727122 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-035c72d4-b8c1-4551-a442-3c282fcaf28c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff35d0db02e74a168243c2016ef2d787', 'request_id': 'req-035c72d4-b8c1-4551-a442-3c282fcaf28c'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:10.735971 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-035c72d4-b8c1-4551-a442-3c282fcaf28c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff35d0db02e74a168243c2016ef2d787', 'request_id': 'req-035c72d4-b8c1-4551-a442-3c282fcaf28c'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:10.748293 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-035c72d4-b8c1-4551-a442-3c282fcaf28c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff35d0db02e74a168243c2016ef2d787', 'request_id': 'req-035c72d4-b8c1-4551-a442-3c282fcaf28c'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:10.772048 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-035c72d4-b8c1-4551-a442-3c282fcaf28c admin admin] The token cache is being invalidate because project ff35d0db02e74a168243c2016ef2d787 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:10.772363 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-035c72d4-b8c1-4551-a442-3c282fcaf28c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:10.773244 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-035c72d4-b8c1-4551-a442-3c282fcaf28c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:10.775425 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1220/2440] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:10 2022] DELETE /identity/v3/projects/ff35d0db02e74a168243c2016ef2d787 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:51:10.779651 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ec232-0392-40a4-a895-239e2fbcac14 service cinder] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:10.791385 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ec232-0392-40a4-a895-239e2fbcac14 service cinder] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:10.858003 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab2651-3c4f-47c9-8750-25431e312c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:10.858725 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab2651-3c4f-47c9-8750-25431e312c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:10.859073 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab2651-3c4f-47c9-8750-25431e312c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:10.859412 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab2651-3c4f-47c9-8750-25431e312c83 admin admin] PATH_INFO: `/v3/users/e568b440a0144e3381b68e8639f0104c` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:10.860648 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab2651-3c4f-47c9-8750-25431e312c83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e568b440a0144e3381b68e8639f0104c)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:10.863058 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab2651-3c4f-47c9-8750-25431e312c83 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:10.927467 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-00ab2651-3c4f-47c9-8750-25431e312c83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e568b440a0144e3381b68e8639f0104c'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:10.928189 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-00ab2651-3c4f-47c9-8750-25431e312c83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e568b440a0144e3381b68e8639f0104c'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:10.928849 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-00ab2651-3c4f-47c9-8750-25431e312c83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e568b440a0144e3381b68e8639f0104c'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:10.957871 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-00ab2651-3c4f-47c9-8750-25431e312c83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e568b440a0144e3381b68e8639f0104c'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:10.974361 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-00ab2651-3c4f-47c9-8750-25431e312c83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e568b440a0144e3381b68e8639f0104c'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:11.013689 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1221/2441] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:10 2022] DELETE /identity/v3/users/e568b440a0144e3381b68e8639f0104c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:11.369036 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c72d4-b8c1-4551-a442-3c282fcaf28c admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:11.371013 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-035c72d4-b8c1-4551-a442-3c282fcaf28c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:11.391389 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c72d4-b8c1-4551-a442-3c282fcaf28c admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:11.445821 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:11.464351 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d071727-8782-47bc-8a12-8b8c7bb8cac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:11.464991 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d071727-8782-47bc-8a12-8b8c7bb8cac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:11.465295 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d071727-8782-47bc-8a12-8b8c7bb8cac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:11.465624 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d071727-8782-47bc-8a12-8b8c7bb8cac0 admin admin] PATH_INFO: `/v3/projects/e6e898aa76734c2c87fb2c3fbcda40d0` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:11.466805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d071727-8782-47bc-8a12-8b8c7bb8cac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6e898aa76734c2c87fb2c3fbcda40d0)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:11.468973 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d071727-8782-47bc-8a12-8b8c7bb8cac0 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:11.526993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-1d071727-8782-47bc-8a12-8b8c7bb8cac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6e898aa76734c2c87fb2c3fbcda40d0', 'request_id': 'req-1d071727-8782-47bc-8a12-8b8c7bb8cac0'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:11.533572 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-1d071727-8782-47bc-8a12-8b8c7bb8cac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6e898aa76734c2c87fb2c3fbcda40d0', 'request_id': 'req-1d071727-8782-47bc-8a12-8b8c7bb8cac0'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:11.542833 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-1d071727-8782-47bc-8a12-8b8c7bb8cac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6e898aa76734c2c87fb2c3fbcda40d0', 'request_id': 'req-1d071727-8782-47bc-8a12-8b8c7bb8cac0'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:11.554731 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-1d071727-8782-47bc-8a12-8b8c7bb8cac0 admin admin] The token cache is being invalidate because project e6e898aa76734c2c87fb2c3fbcda40d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:11.555021 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-1d071727-8782-47bc-8a12-8b8c7bb8cac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:11.555722 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-1d071727-8782-47bc-8a12-8b8c7bb8cac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:11.557268 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1221/2442] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:11 2022] DELETE /identity/v3/projects/e6e898aa76734c2c87fb2c3fbcda40d0 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:11.561533 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab2651-3c4f-47c9-8750-25431e312c83 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:11.562939 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-00ab2651-3c4f-47c9-8750-25431e312c83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:11.576758 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab2651-3c4f-47c9-8750-25431e312c83 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:11.637391 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edb116-e516-4bc7-bc3f-9e2cba22e09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:11.638107 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edb116-e516-4bc7-bc3f-9e2cba22e09c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:11.638522 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edb116-e516-4bc7-bc3f-9e2cba22e09c admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:11.638782 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edb116-e516-4bc7-bc3f-9e2cba22e09c admin admin] PATH_INFO: `/v3/users/76141293e3ac47cf8b4b4642d28a7c58` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:11.640032 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edb116-e516-4bc7-bc3f-9e2cba22e09c admin admin] RBAC: Authorizing `identity:delete_user(user_id=76141293e3ac47cf8b4b4642d28a7c58)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:11.642313 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edb116-e516-4bc7-bc3f-9e2cba22e09c admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:11.655532 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:11.691170 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-45edb116-e516-4bc7-bc3f-9e2cba22e09c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76141293e3ac47cf8b4b4642d28a7c58'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:11.691814 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-45edb116-e516-4bc7-bc3f-9e2cba22e09c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76141293e3ac47cf8b4b4642d28a7c58'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:11.692410 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-45edb116-e516-4bc7-bc3f-9e2cba22e09c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76141293e3ac47cf8b4b4642d28a7c58'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:11.705962 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-45edb116-e516-4bc7-bc3f-9e2cba22e09c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76141293e3ac47cf8b4b4642d28a7c58'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:11.715288 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-45edb116-e516-4bc7-bc3f-9e2cba22e09c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76141293e3ac47cf8b4b4642d28a7c58'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:11.729014 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1222/2443] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:11 2022] DELETE /identity/v3/users/76141293e3ac47cf8b4b4642d28a7c58 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:51:12.032266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d071727-8782-47bc-8a12-8b8c7bb8cac0 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:12.033835 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-1d071727-8782-47bc-8a12-8b8c7bb8cac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:12.058594 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d071727-8782-47bc-8a12-8b8c7bb8cac0 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:12.141526 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61305b20-86ee-4c39-97e5-1607af49bed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:12.142227 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61305b20-86ee-4c39-97e5-1607af49bed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:12.142510 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61305b20-86ee-4c39-97e5-1607af49bed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:12.142812 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61305b20-86ee-4c39-97e5-1607af49bed7 admin admin] PATH_INFO: `/v3/projects/bf94efa7d5e44073b54524d86dde0642` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:12.144018 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61305b20-86ee-4c39-97e5-1607af49bed7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf94efa7d5e44073b54524d86dde0642)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:12.146027 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61305b20-86ee-4c39-97e5-1607af49bed7 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:12.210812 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-61305b20-86ee-4c39-97e5-1607af49bed7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf94efa7d5e44073b54524d86dde0642', 'request_id': 'req-61305b20-86ee-4c39-97e5-1607af49bed7'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:12.218969 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-61305b20-86ee-4c39-97e5-1607af49bed7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf94efa7d5e44073b54524d86dde0642', 'request_id': 'req-61305b20-86ee-4c39-97e5-1607af49bed7'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:12.228410 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-61305b20-86ee-4c39-97e5-1607af49bed7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf94efa7d5e44073b54524d86dde0642', 'request_id': 'req-61305b20-86ee-4c39-97e5-1607af49bed7'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:12.244891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-61305b20-86ee-4c39-97e5-1607af49bed7 admin admin] The token cache is being invalidate because project bf94efa7d5e44073b54524d86dde0642 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:12.244891 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-61305b20-86ee-4c39-97e5-1607af49bed7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:12.245327 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-61305b20-86ee-4c39-97e5-1607af49bed7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:12.247187 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1222/2444] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:12 2022] DELETE /identity/v3/projects/bf94efa7d5e44073b54524d86dde0642 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:20.916184 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edb116-e516-4bc7-bc3f-9e2cba22e09c admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:20.918055 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-45edb116-e516-4bc7-bc3f-9e2cba22e09c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:20.932078 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edb116-e516-4bc7-bc3f-9e2cba22e09c admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:20.997177 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8723e4-d8f3-416e-93a1-371a0527309b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:20.997796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8723e4-d8f3-416e-93a1-371a0527309b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:20.998078 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8723e4-d8f3-416e-93a1-371a0527309b admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:20.998355 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8723e4-d8f3-416e-93a1-371a0527309b admin admin] PATH_INFO: `/v3/users/2442c3698cd5422493efa014c47ab8eb` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:20.999821 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8723e4-d8f3-416e-93a1-371a0527309b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2442c3698cd5422493efa014c47ab8eb)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:21.002469 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8723e4-d8f3-416e-93a1-371a0527309b admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:21.060933 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-ca8723e4-d8f3-416e-93a1-371a0527309b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2442c3698cd5422493efa014c47ab8eb'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:21.061679 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-ca8723e4-d8f3-416e-93a1-371a0527309b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2442c3698cd5422493efa014c47ab8eb'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:21.062370 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-ca8723e4-d8f3-416e-93a1-371a0527309b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2442c3698cd5422493efa014c47ab8eb'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:21.077426 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-ca8723e4-d8f3-416e-93a1-371a0527309b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2442c3698cd5422493efa014c47ab8eb'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:21.087237 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-ca8723e4-d8f3-416e-93a1-371a0527309b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2442c3698cd5422493efa014c47ab8eb'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:21.102759 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1223/2445] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:20 2022] DELETE /identity/v3/users/2442c3698cd5422493efa014c47ab8eb => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:21.107471 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494736cb-a917-4d68-9816-f229f7ebe128 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:21.108011 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494736cb-a917-4d68-9816-f229f7ebe128 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:21.108011 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494736cb-a917-4d68-9816-f229f7ebe128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:21.117456 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:21.132537 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-494736cb-a917-4d68-9816-f229f7ebe128 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:21.134399 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-494736cb-a917-4d68-9816-f229f7ebe128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:21.205468 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1223/2446] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:21.215475 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8723e4-d8f3-416e-93a1-371a0527309b admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:21.216888 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-ca8723e4-d8f3-416e-93a1-371a0527309b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:21.228704 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:21.278992 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8723e4-d8f3-416e-93a1-371a0527309b admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:21.283054 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56391c76-5425-4e69-86f4-adbf6cb49939 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:21.283664 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56391c76-5425-4e69-86f4-adbf6cb49939 service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:21.283938 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56391c76-5425-4e69-86f4-adbf6cb49939 service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:21.284198 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56391c76-5425-4e69-86f4-adbf6cb49939 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:21.294736 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56391c76-5425-4e69-86f4-adbf6cb49939 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:21.296203 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56391c76-5425-4e69-86f4-adbf6cb49939 service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:21.306043 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1224/2447] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:51:21.582993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494736cb-a917-4d68-9816-f229f7ebe128 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:21.584534 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-494736cb-a917-4d68-9816-f229f7ebe128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:21.601114 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494736cb-a917-4d68-9816-f229f7ebe128 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:21.606447 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8711d-15e0-4111-a293-9ac19a051301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:21.607198 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8711d-15e0-4111-a293-9ac19a051301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:21.607622 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8711d-15e0-4111-a293-9ac19a051301 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:21.607732 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8711d-15e0-4111-a293-9ac19a051301 admin admin] PATH_INFO: `/v3/projects/60c44f57457342299a2e77b9c9fb5e30` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:21.609086 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8711d-15e0-4111-a293-9ac19a051301 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60c44f57457342299a2e77b9c9fb5e30)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:21.613969 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8711d-15e0-4111-a293-9ac19a051301 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:21.663667 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-70b8711d-15e0-4111-a293-9ac19a051301 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60c44f57457342299a2e77b9c9fb5e30', 'request_id': 'req-70b8711d-15e0-4111-a293-9ac19a051301'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:21.671226 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-70b8711d-15e0-4111-a293-9ac19a051301 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60c44f57457342299a2e77b9c9fb5e30', 'request_id': 'req-70b8711d-15e0-4111-a293-9ac19a051301'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:21.680786 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-70b8711d-15e0-4111-a293-9ac19a051301 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60c44f57457342299a2e77b9c9fb5e30', 'request_id': 'req-70b8711d-15e0-4111-a293-9ac19a051301'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:21.691948 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-70b8711d-15e0-4111-a293-9ac19a051301 admin admin] The token cache is being invalidate because project 60c44f57457342299a2e77b9c9fb5e30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:21.692294 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-70b8711d-15e0-4111-a293-9ac19a051301 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:21.692935 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-70b8711d-15e0-4111-a293-9ac19a051301 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:21.694484 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1224/2448] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:21 2022] DELETE /identity/v3/projects/60c44f57457342299a2e77b9c9fb5e30 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:31.301749 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=22 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:31.688833 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=52,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:34.571537 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fd31f-0369-4960-ae04-379ffd8ce8d8 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:34.572094 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fd31f-0369-4960-ae04-379ffd8ce8d8 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:34.572195 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fd31f-0369-4960-ae04-379ffd8ce8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:34.595642 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-dd5fd31f-0369-4960-ae04-379ffd8ce8d8 None None] MFA Rules not processed for user `12af555605384136af2082486782b584`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:34.596872 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-dd5fd31f-0369-4960-ae04-379ffd8ce8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:34.655515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1225/2449] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:51:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:36.102822 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8711d-15e0-4111-a293-9ac19a051301 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:36.104969 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-70b8711d-15e0-4111-a293-9ac19a051301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:36.182779 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8711d-15e0-4111-a293-9ac19a051301 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:36.188522 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be59368-9fcd-4c17-ba08-bb68b011ff8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:36.189166 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be59368-9fcd-4c17-ba08-bb68b011ff8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:36.189477 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be59368-9fcd-4c17-ba08-bb68b011ff8f admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:36.189755 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be59368-9fcd-4c17-ba08-bb68b011ff8f admin admin] PATH_INFO: `/v3/users/be5ca6726e7841219d5924c71dcb9c01` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:36.191019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be59368-9fcd-4c17-ba08-bb68b011ff8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=be5ca6726e7841219d5924c71dcb9c01)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:36.193135 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be59368-9fcd-4c17-ba08-bb68b011ff8f admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:36.255089 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-2be59368-9fcd-4c17-ba08-bb68b011ff8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be5ca6726e7841219d5924c71dcb9c01'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:36.255749 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-2be59368-9fcd-4c17-ba08-bb68b011ff8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be5ca6726e7841219d5924c71dcb9c01'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:36.256409 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-2be59368-9fcd-4c17-ba08-bb68b011ff8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be5ca6726e7841219d5924c71dcb9c01'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:36.269896 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-2be59368-9fcd-4c17-ba08-bb68b011ff8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be5ca6726e7841219d5924c71dcb9c01'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:36.277763 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-2be59368-9fcd-4c17-ba08-bb68b011ff8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be5ca6726e7841219d5924c71dcb9c01'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:36.290473 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1225/2450] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:36 2022] DELETE /identity/v3/users/be5ca6726e7841219d5924c71dcb9c01 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:36.295015 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8cebb-ee3c-4f5f-b253-81abe0737143 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:36.295533 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8cebb-ee3c-4f5f-b253-81abe0737143 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:36.295633 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8cebb-ee3c-4f5f-b253-81abe0737143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:36.332927 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-97d8cebb-ee3c-4f5f-b253-81abe0737143 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:36.334691 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-97d8cebb-ee3c-4f5f-b253-81abe0737143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:36.410111 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1226/2451] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:51:36.421943 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be59368-9fcd-4c17-ba08-bb68b011ff8f admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:36.423585 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-2be59368-9fcd-4c17-ba08-bb68b011ff8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:36.482204 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be59368-9fcd-4c17-ba08-bb68b011ff8f admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:36.486504 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597111cb-87fd-4957-9ac2-50fe71e6f9f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:36.487114 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597111cb-87fd-4957-9ac2-50fe71e6f9f5 service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:36.487390 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597111cb-87fd-4957-9ac2-50fe71e6f9f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:36.487661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597111cb-87fd-4957-9ac2-50fe71e6f9f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:36.497193 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597111cb-87fd-4957-9ac2-50fe71e6f9f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:36.498661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597111cb-87fd-4957-9ac2-50fe71e6f9f5 service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:36.509158 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1226/2452] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:36.788279 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8cebb-ee3c-4f5f-b253-81abe0737143 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:36.789966 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-97d8cebb-ee3c-4f5f-b253-81abe0737143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:36.807378 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8cebb-ee3c-4f5f-b253-81abe0737143 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:36.814837 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56105803-1d0d-4171-a730-da95628b581d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:36.815543 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56105803-1d0d-4171-a730-da95628b581d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:36.815750 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56105803-1d0d-4171-a730-da95628b581d admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:36.816023 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56105803-1d0d-4171-a730-da95628b581d admin admin] PATH_INFO: `/v3/projects/03503ef5958149a6af3e169ad36cb359` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:36.817313 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56105803-1d0d-4171-a730-da95628b581d admin admin] RBAC: Authorizing `identity:delete_project(project_id=03503ef5958149a6af3e169ad36cb359)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:36.819230 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56105803-1d0d-4171-a730-da95628b581d admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:36.899879 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-56105803-1d0d-4171-a730-da95628b581d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03503ef5958149a6af3e169ad36cb359', 'request_id': 'req-56105803-1d0d-4171-a730-da95628b581d'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:36.922376 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-56105803-1d0d-4171-a730-da95628b581d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03503ef5958149a6af3e169ad36cb359', 'request_id': 'req-56105803-1d0d-4171-a730-da95628b581d'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:36.936952 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-56105803-1d0d-4171-a730-da95628b581d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03503ef5958149a6af3e169ad36cb359', 'request_id': 'req-56105803-1d0d-4171-a730-da95628b581d'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:36.951353 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-56105803-1d0d-4171-a730-da95628b581d admin admin] The token cache is being invalidate because project 03503ef5958149a6af3e169ad36cb359 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:36.951645 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-56105803-1d0d-4171-a730-da95628b581d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:36.952670 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-56105803-1d0d-4171-a730-da95628b581d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:36.957630 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1227/2453] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:36 2022] DELETE /identity/v3/projects/03503ef5958149a6af3e169ad36cb359 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:36.960357 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad2e0f-ba8e-4efa-9ef0-a3e45992618c None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:36.960759 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad2e0f-ba8e-4efa-9ef0-a3e45992618c None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:36.961182 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad2e0f-ba8e-4efa-9ef0-a3e45992618c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:36.995521 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-e0ad2e0f-ba8e-4efa-9ef0-a3e45992618c None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:36.996930 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-e0ad2e0f-ba8e-4efa-9ef0-a3e45992618c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:37.035832 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:37.115015 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1227/2454] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:37.122905 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d9f2c-7f8d-493e-b3b9-7a1bbb5f48f2 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:37.123325 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d9f2c-7f8d-493e-b3b9-7a1bbb5f48f2 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:37.123778 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d9f2c-7f8d-493e-b3b9-7a1bbb5f48f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:37.146241 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-2f3d9f2c-7f8d-493e-b3b9-7a1bbb5f48f2 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:37.148194 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-2f3d9f2c-7f8d-493e-b3b9-7a1bbb5f48f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:37.155699 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1228/2455] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:51:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:37.160562 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad2e0f-ba8e-4efa-9ef0-a3e45992618c None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:37.171698 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad2e0f-ba8e-4efa-9ef0-a3e45992618c None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:37.176467 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d70ae3-2834-451f-a9a9-8ab3194d5f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:37.177072 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d70ae3-2834-451f-a9a9-8ab3194d5f22 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:37.177382 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d70ae3-2834-451f-a9a9-8ab3194d5f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:37.177663 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d70ae3-2834-451f-a9a9-8ab3194d5f22 admin admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:37.178310 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d70ae3-2834-451f-a9a9-8ab3194d5f22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:51:37.178612 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d70ae3-2834-451f-a9a9-8ab3194d5f22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:37.180207 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d70ae3-2834-451f-a9a9-8ab3194d5f22 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:37.192007 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1228/2456] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:51:37.196455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d9f2c-7f8d-493e-b3b9-7a1bbb5f48f2 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:37.205833 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d9f2c-7f8d-493e-b3b9-7a1bbb5f48f2 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:37.210773 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1527fae-06e8-46a1-9686-0f1a6663c065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:37.211378 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1527fae-06e8-46a1-9686-0f1a6663c065 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:37.211653 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1527fae-06e8-46a1-9686-0f1a6663c065 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:37.212244 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1527fae-06e8-46a1-9686-0f1a6663c065 admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:37.212894 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1527fae-06e8-46a1-9686-0f1a6663c065 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:37.215037 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1527fae-06e8-46a1-9686-0f1a6663c065 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:37.237582 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:37.245947 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1229/2457] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:37 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:37.249958 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d70ae3-2834-451f-a9a9-8ab3194d5f22 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:37.260411 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d70ae3-2834-451f-a9a9-8ab3194d5f22 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:37.319258 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7038dd-6c6c-403f-9da2-c254026b0927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:37.319863 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7038dd-6c6c-403f-9da2-c254026b0927 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:37.320152 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7038dd-6c6c-403f-9da2-c254026b0927 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:37.320423 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7038dd-6c6c-403f-9da2-c254026b0927 admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:37.321057 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7038dd-6c6c-403f-9da2-c254026b0927 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:37.323029 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7038dd-6c6c-403f-9da2-c254026b0927 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:37.345841 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1229/2458] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:37 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:37.350196 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1527fae-06e8-46a1-9686-0f1a6663c065 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:37.361240 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1527fae-06e8-46a1-9686-0f1a6663c065 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:37.366747 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a5a04-6525-4e25-a3b5-2541faceb07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:37.367348 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a5a04-6525-4e25-a3b5-2541faceb07c admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:37.367656 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a5a04-6525-4e25-a3b5-2541faceb07c admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:37.367928 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a5a04-6525-4e25-a3b5-2541faceb07c admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:37.368576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a5a04-6525-4e25-a3b5-2541faceb07c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:37.370223 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a5a04-6525-4e25-a3b5-2541faceb07c admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:37.381360 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1230/2459] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:37.385578 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7038dd-6c6c-403f-9da2-c254026b0927 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:37.396117 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7038dd-6c6c-403f-9da2-c254026b0927 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:37.401938 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b02be-da53-4d48-b969-c88ad808b670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:37.402538 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b02be-da53-4d48-b969-c88ad808b670 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:37.402812 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b02be-da53-4d48-b969-c88ad808b670 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:37.403080 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b02be-da53-4d48-b969-c88ad808b670 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:37.403718 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b02be-da53-4d48-b969-c88ad808b670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:37.405321 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b02be-da53-4d48-b969-c88ad808b670 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:37.417962 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1230/2460] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:37.422357 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a5a04-6525-4e25-a3b5-2541faceb07c admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:37.432551 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a5a04-6525-4e25-a3b5-2541faceb07c admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:37.437474 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defeb2b-2d42-4243-b9f1-fa9713beb9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:37.438170 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defeb2b-2d42-4243-b9f1-fa9713beb9ab admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:37.438451 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defeb2b-2d42-4243-b9f1-fa9713beb9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:37.438741 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defeb2b-2d42-4243-b9f1-fa9713beb9ab admin admin] PATH_INFO: `/v3/projects/94842228015e4fd280c6b9bfb497bce3/users/e3330478cfe14efe85828a55d4d51733/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:37.456180 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6defeb2b-2d42-4243-b9f1-fa9713beb9ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=94842228015e4fd280c6b9bfb497bce3, user_id=e3330478cfe14efe85828a55d4d51733, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:37.459318 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6defeb2b-2d42-4243-b9f1-fa9713beb9ab admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:37.480983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1231/2461] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:37 2022] PUT /identity/v3/projects/94842228015e4fd280c6b9bfb497bce3/users/e3330478cfe14efe85828a55d4d51733/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:37.493974 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed9a65-4eca-4ff1-ae2d-003494eea6f9 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:37.494263 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed9a65-4eca-4ff1-ae2d-003494eea6f9 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:37.494530 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed9a65-4eca-4ff1-ae2d-003494eea6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:37.524534 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-9fed9a65-4eca-4ff1-ae2d-003494eea6f9 None None] MFA Rules not processed for user `e3330478cfe14efe85828a55d4d51733`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:37.525848 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-9fed9a65-4eca-4ff1-ae2d-003494eea6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:37.594543 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1231/2462] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:51:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:37.606683 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defeb2b-2d42-4243-b9f1-fa9713beb9ab admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:37.608678 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-6defeb2b-2d42-4243-b9f1-fa9713beb9ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:37.667654 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defeb2b-2d42-4243-b9f1-fa9713beb9ab admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:37.671348 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879f00c-982f-4b43-bd7d-62b748c581ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:37.672029 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879f00c-982f-4b43-bd7d-62b748c581ea service cinder] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:37.672312 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879f00c-982f-4b43-bd7d-62b748c581ea service cinder] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:37.672584 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a879f00c-982f-4b43-bd7d-62b748c581ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:37.681325 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879f00c-982f-4b43-bd7d-62b748c581ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:37.682803 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a879f00c-982f-4b43-bd7d-62b748c581ea service cinder] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:37.691879 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1232/2463] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:39.093324 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648e53b-f812-4a91-859d-5d33c31989ae None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:39.093870 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648e53b-f812-4a91-859d-5d33c31989ae None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:39.094191 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d648e53b-f812-4a91-859d-5d33c31989ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:39.114467 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-d648e53b-f812-4a91-859d-5d33c31989ae None None] MFA Rules not processed for user `e3330478cfe14efe85828a55d4d51733`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:39.115664 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-d648e53b-f812-4a91-859d-5d33c31989ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:39.126963 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1232/2464] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:51:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:39.216697 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879f00c-982f-4b43-bd7d-62b748c581ea service cinder] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:39.219205 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-a879f00c-982f-4b43-bd7d-62b748c581ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:39.300040 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a879f00c-982f-4b43-bd7d-62b748c581ea service cinder] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:39.304657 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6eed0-2a3c-4661-8073-329be3618867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:39.304953 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6eed0-2a3c-4661-8073-329be3618867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:39.305214 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6eed0-2a3c-4661-8073-329be3618867 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:39.305520 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6eed0-2a3c-4661-8073-329be3618867 admin admin] PATH_INFO: `/v3/users/8ab0bcee008946ff87db3048e1864753` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:39.306671 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6eed0-2a3c-4661-8073-329be3618867 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ab0bcee008946ff87db3048e1864753)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:39.309024 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae6eed0-2a3c-4661-8073-329be3618867 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:39.364430 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-2ae6eed0-2a3c-4661-8073-329be3618867 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ab0bcee008946ff87db3048e1864753'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:39.365205 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-2ae6eed0-2a3c-4661-8073-329be3618867 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ab0bcee008946ff87db3048e1864753'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:39.365888 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-2ae6eed0-2a3c-4661-8073-329be3618867 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ab0bcee008946ff87db3048e1864753'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:39.380980 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-2ae6eed0-2a3c-4661-8073-329be3618867 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ab0bcee008946ff87db3048e1864753'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:39.385321 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:39.390574 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-2ae6eed0-2a3c-4661-8073-329be3618867 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ab0bcee008946ff87db3048e1864753'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:39.410662 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1233/2465] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:39 2022] DELETE /identity/v3/users/8ab0bcee008946ff87db3048e1864753 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:51:39.419392 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33df84d-73c1-450b-bcbf-809030947e00 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:39.419676 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33df84d-73c1-450b-bcbf-809030947e00 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:39.420452 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33df84d-73c1-450b-bcbf-809030947e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:39.446050 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-e33df84d-73c1-450b-bcbf-809030947e00 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:39.447272 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-e33df84d-73c1-450b-bcbf-809030947e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:39.454738 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:39.534011 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1233/2466] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:39.544320 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6eed0-2a3c-4661-8073-329be3618867 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:39.545915 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-2ae6eed0-2a3c-4661-8073-329be3618867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:39.612608 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6eed0-2a3c-4661-8073-329be3618867 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:39.618035 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556aceb-3c83-44dc-b1ab-4948254b427f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:39.618968 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556aceb-3c83-44dc-b1ab-4948254b427f service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:39.619280 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556aceb-3c83-44dc-b1ab-4948254b427f service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:39.619556 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556aceb-3c83-44dc-b1ab-4948254b427f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:39.633988 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556aceb-3c83-44dc-b1ab-4948254b427f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:39.635772 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556aceb-3c83-44dc-b1ab-4948254b427f service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:39.650075 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1234/2467] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:40.155323 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33df84d-73c1-450b-bcbf-809030947e00 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:40.158092 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-e33df84d-73c1-450b-bcbf-809030947e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:40.172967 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33df84d-73c1-450b-bcbf-809030947e00 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:40.181663 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec60f82-a0ae-4d1a-a84c-e87b55f8534e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:40.182472 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec60f82-a0ae-4d1a-a84c-e87b55f8534e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:40.182793 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec60f82-a0ae-4d1a-a84c-e87b55f8534e admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:40.183465 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec60f82-a0ae-4d1a-a84c-e87b55f8534e admin admin] PATH_INFO: `/v3/projects/8eef2cf129084a66bec8ec2f64df0512` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:40.185449 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec60f82-a0ae-4d1a-a84c-e87b55f8534e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eef2cf129084a66bec8ec2f64df0512)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:40.194062 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec60f82-a0ae-4d1a-a84c-e87b55f8534e admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:40.250105 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-3ec60f82-a0ae-4d1a-a84c-e87b55f8534e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eef2cf129084a66bec8ec2f64df0512', 'request_id': 'req-3ec60f82-a0ae-4d1a-a84c-e87b55f8534e'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:40.256828 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-3ec60f82-a0ae-4d1a-a84c-e87b55f8534e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eef2cf129084a66bec8ec2f64df0512', 'request_id': 'req-3ec60f82-a0ae-4d1a-a84c-e87b55f8534e'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:40.266341 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-3ec60f82-a0ae-4d1a-a84c-e87b55f8534e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eef2cf129084a66bec8ec2f64df0512', 'request_id': 'req-3ec60f82-a0ae-4d1a-a84c-e87b55f8534e'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:40.279049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-3ec60f82-a0ae-4d1a-a84c-e87b55f8534e admin admin] The token cache is being invalidate because project 8eef2cf129084a66bec8ec2f64df0512 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:40.279373 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-3ec60f82-a0ae-4d1a-a84c-e87b55f8534e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:40.280277 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-3ec60f82-a0ae-4d1a-a84c-e87b55f8534e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:40.281912 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1234/2468] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:40 2022] DELETE /identity/v3/projects/8eef2cf129084a66bec8ec2f64df0512 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:40.286929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48160d-f8dd-4901-8648-a8d35a1b8e4f None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:40.287423 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48160d-f8dd-4901-8648-a8d35a1b8e4f None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:40.287540 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48160d-f8dd-4901-8648-a8d35a1b8e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:40.307234 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-ce48160d-f8dd-4901-8648-a8d35a1b8e4f None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:40.308535 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-ce48160d-f8dd-4901-8648-a8d35a1b8e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:40.371648 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1235/2469] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:40.380122 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e52194-497a-479b-bf13-2b23b2d68f17 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:40.380488 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e52194-497a-479b-bf13-2b23b2d68f17 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:40.380818 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e52194-497a-479b-bf13-2b23b2d68f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:40.401478 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-d6e52194-497a-479b-bf13-2b23b2d68f17 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:40.402911 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-d6e52194-497a-479b-bf13-2b23b2d68f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:40.413481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1235/2470] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:40.417124 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48160d-f8dd-4901-8648-a8d35a1b8e4f None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:40.427855 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48160d-f8dd-4901-8648-a8d35a1b8e4f None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:40.433020 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd52f6-b829-4e13-839f-4fd647f2b2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:40.433671 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd52f6-b829-4e13-839f-4fd647f2b2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:40.433958 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd52f6-b829-4e13-839f-4fd647f2b2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:40.434234 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd52f6-b829-4e13-839f-4fd647f2b2f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:40.434891 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd52f6-b829-4e13-839f-4fd647f2b2f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:51:40.435199 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd52f6-b829-4e13-839f-4fd647f2b2f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:40.436895 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd52f6-b829-4e13-839f-4fd647f2b2f4 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:40.450639 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1236/2471] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:51:40.456080 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e52194-497a-479b-bf13-2b23b2d68f17 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:40.469020 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e52194-497a-479b-bf13-2b23b2d68f17 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:40.473804 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b8f52-a581-4602-a9a5-7badcefb653e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:40.474408 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b8f52-a581-4602-a9a5-7badcefb653e admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:40.474686 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b8f52-a581-4602-a9a5-7badcefb653e admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:40.474954 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b8f52-a581-4602-a9a5-7badcefb653e admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:40.475581 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b8f52-a581-4602-a9a5-7badcefb653e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:40.477519 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b8f52-a581-4602-a9a5-7badcefb653e admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:40.509211 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1236/2472] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:40 2022] POST /identity/v3/projects => generated 389 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:40.513458 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd52f6-b829-4e13-839f-4fd647f2b2f4 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:40.526129 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd52f6-b829-4e13-839f-4fd647f2b2f4 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:40.588716 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb2797-3a89-45f7-84ea-d4ef610ba711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:40.589342 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb2797-3a89-45f7-84ea-d4ef610ba711 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:40.589640 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb2797-3a89-45f7-84ea-d4ef610ba711 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:40.589915 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb2797-3a89-45f7-84ea-d4ef610ba711 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:40.590546 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb2797-3a89-45f7-84ea-d4ef610ba711 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:40.592492 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb2797-3a89-45f7-84ea-d4ef610ba711 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:40.617526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1237/2473] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:40 2022] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:51:40.618818 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b8f52-a581-4602-a9a5-7badcefb653e admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:40.629758 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b8f52-a581-4602-a9a5-7badcefb653e admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:40.636015 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771595b-3bd8-42a6-a716-05c98e81457c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:40.636612 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771595b-3bd8-42a6-a716-05c98e81457c admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:40.636985 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771595b-3bd8-42a6-a716-05c98e81457c admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:40.637199 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771595b-3bd8-42a6-a716-05c98e81457c admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:40.637824 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1771595b-3bd8-42a6-a716-05c98e81457c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:40.639548 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1771595b-3bd8-42a6-a716-05c98e81457c admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:40.650213 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1237/2474] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:40.654570 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb2797-3a89-45f7-84ea-d4ef610ba711 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:40.669257 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb2797-3a89-45f7-84ea-d4ef610ba711 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:40.674007 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffbfbf8-ffaa-46cd-a41a-9431ab6d4a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:40.674607 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbfbf8-ffaa-46cd-a41a-9431ab6d4a49 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:40.674882 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbfbf8-ffaa-46cd-a41a-9431ab6d4a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:40.675270 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbfbf8-ffaa-46cd-a41a-9431ab6d4a49 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:40.675783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffbfbf8-ffaa-46cd-a41a-9431ab6d4a49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:40.677393 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffbfbf8-ffaa-46cd-a41a-9431ab6d4a49 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:40.679206 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:40.691267 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1238/2475] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:40.695317 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771595b-3bd8-42a6-a716-05c98e81457c admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:40.705542 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771595b-3bd8-42a6-a716-05c98e81457c admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:40.710139 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ad263-5cc2-42ea-b6c2-020d2eddddbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:40.710783 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ad263-5cc2-42ea-b6c2-020d2eddddbe admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:40.711061 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ad263-5cc2-42ea-b6c2-020d2eddddbe admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:40.711331 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ad263-5cc2-42ea-b6c2-020d2eddddbe admin admin] PATH_INFO: `/v3/projects/2bcfa52f8d624dffb8d11b14bdd98f8d/users/23ac39e8a8da4857810750c6bd248954/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:40.726006 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ad263-5cc2-42ea-b6c2-020d2eddddbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bcfa52f8d624dffb8d11b14bdd98f8d, user_id=23ac39e8a8da4857810750c6bd248954, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:40.728705 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ad263-5cc2-42ea-b6c2-020d2eddddbe admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:40.744917 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1238/2476] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:40 2022] PUT /identity/v3/projects/2bcfa52f8d624dffb8d11b14bdd98f8d/users/23ac39e8a8da4857810750c6bd248954/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:40.757077 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db7317-4a95-44f5-90c4-c15e504a081b None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:40.757468 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db7317-4a95-44f5-90c4-c15e504a081b None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:40.757744 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db7317-4a95-44f5-90c4-c15e504a081b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:40.788049 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-27db7317-4a95-44f5-90c4-c15e504a081b None None] MFA Rules not processed for user `23ac39e8a8da4857810750c6bd248954`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:40.789400 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-27db7317-4a95-44f5-90c4-c15e504a081b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:40.869898 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1239/2477] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:51:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:40.878542 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ad263-5cc2-42ea-b6c2-020d2eddddbe admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:40.880581 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-b04ad263-5cc2-42ea-b6c2-020d2eddddbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:40.934696 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:40.969695 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ad263-5cc2-42ea-b6c2-020d2eddddbe admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:40.973423 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c657295-d24e-493d-bc7f-350ca2f1125b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:40.973986 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c657295-d24e-493d-bc7f-350ca2f1125b service cinder] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:40.974323 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c657295-d24e-493d-bc7f-350ca2f1125b service cinder] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:40.974663 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c657295-d24e-493d-bc7f-350ca2f1125b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:40.983966 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c657295-d24e-493d-bc7f-350ca2f1125b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:40.985557 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c657295-d24e-493d-bc7f-350ca2f1125b service cinder] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:40.995719 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1239/2478] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:40 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:50.071360 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96718b06-4111-4a55-b608-afb2710c776c None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:50.071828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96718b06-4111-4a55-b608-afb2710c776c None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:50.072084 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96718b06-4111-4a55-b608-afb2710c776c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:50.092193 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-96718b06-4111-4a55-b608-afb2710c776c None None] MFA Rules not processed for user `c737c4586910476eafead0dfd4d9bc4c`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:50.093420 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-96718b06-4111-4a55-b608-afb2710c776c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:50.163267 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1240/2479] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 24 04:51:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:50.215395 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c657295-d24e-493d-bc7f-350ca2f1125b service cinder] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:50.217186 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-2c657295-d24e-493d-bc7f-350ca2f1125b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:50.313599 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c657295-d24e-493d-bc7f-350ca2f1125b service cinder] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:50.319108 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc544fe-35c2-46e1-ad9c-e0dbbbc93022 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ebb5105220438693118d734c9fda70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:50.319914 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc544fe-35c2-46e1-ad9c-e0dbbbc93022 service swift] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:50.320172 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc544fe-35c2-46e1-ad9c-e0dbbbc93022 service swift] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:50.320532 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc544fe-35c2-46e1-ad9c-e0dbbbc93022 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:50.331315 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc544fe-35c2-46e1-ad9c-e0dbbbc93022 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:50.333145 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc544fe-35c2-46e1-ad9c-e0dbbbc93022 service swift] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:50.343221 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1240/2480] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 24 04:51:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:51:51.336014 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96718b06-4111-4a55-b608-afb2710c776c None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:51.454497 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96718b06-4111-4a55-b608-afb2710c776c None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:51.461398 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9678a97-38c7-429d-9bf0-10e06a9798a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:51.462440 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9678a97-38c7-429d-9bf0-10e06a9798a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:51.462922 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9678a97-38c7-429d-9bf0-10e06a9798a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:51.463355 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9678a97-38c7-429d-9bf0-10e06a9798a9 admin admin] PATH_INFO: `/v3/users/23ac39e8a8da4857810750c6bd248954` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:51.464878 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9678a97-38c7-429d-9bf0-10e06a9798a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23ac39e8a8da4857810750c6bd248954)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:51.467149 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9678a97-38c7-429d-9bf0-10e06a9798a9 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:51.520619 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:51.568557 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-c9678a97-38c7-429d-9bf0-10e06a9798a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23ac39e8a8da4857810750c6bd248954'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:51.571687 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-c9678a97-38c7-429d-9bf0-10e06a9798a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23ac39e8a8da4857810750c6bd248954'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:51.572476 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-c9678a97-38c7-429d-9bf0-10e06a9798a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23ac39e8a8da4857810750c6bd248954'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:51.590275 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-c9678a97-38c7-429d-9bf0-10e06a9798a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23ac39e8a8da4857810750c6bd248954'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:51.601565 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-c9678a97-38c7-429d-9bf0-10e06a9798a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23ac39e8a8da4857810750c6bd248954'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:51.624402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1241/2481] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:51:51 2022] DELETE /identity/v3/users/23ac39e8a8da4857810750c6bd248954 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:51.625913 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35f120-ffe9-4c14-adaa-6cb840ff85da None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:51.627017 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35f120-ffe9-4c14-adaa-6cb840ff85da None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:51.627442 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c35f120-ffe9-4c14-adaa-6cb840ff85da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:51.670408 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-6c35f120-ffe9-4c14-adaa-6cb840ff85da None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:51.672017 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-6c35f120-ffe9-4c14-adaa-6cb840ff85da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:51.794444 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1241/2482] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:51.807933 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9678a97-38c7-429d-9bf0-10e06a9798a9 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:51.810674 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-c9678a97-38c7-429d-9bf0-10e06a9798a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:51.890578 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9678a97-38c7-429d-9bf0-10e06a9798a9 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:51.897627 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4342f61-8d1f-4c4f-a53f-aebe91073207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:51.898590 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4342f61-8d1f-4c4f-a53f-aebe91073207 service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:51.898897 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4342f61-8d1f-4c4f-a53f-aebe91073207 service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:51.899250 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4342f61-8d1f-4c4f-a53f-aebe91073207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:51.911610 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4342f61-8d1f-4c4f-a53f-aebe91073207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:51.913158 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4342f61-8d1f-4c4f-a53f-aebe91073207 service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:51.926442 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1242/2483] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:52.313417 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35f120-ffe9-4c14-adaa-6cb840ff85da None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:52.315471 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-6c35f120-ffe9-4c14-adaa-6cb840ff85da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:52.338394 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c35f120-ffe9-4c14-adaa-6cb840ff85da None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:52.348162 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277457a1-da2b-48e2-9c40-ad6fe92db9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:52.349397 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277457a1-da2b-48e2-9c40-ad6fe92db9dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:52.349905 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277457a1-da2b-48e2-9c40-ad6fe92db9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:52.350496 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277457a1-da2b-48e2-9c40-ad6fe92db9dd admin admin] PATH_INFO: `/v3/projects/2bcfa52f8d624dffb8d11b14bdd98f8d` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:52.352466 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277457a1-da2b-48e2-9c40-ad6fe92db9dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bcfa52f8d624dffb8d11b14bdd98f8d)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:52.356183 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277457a1-da2b-48e2-9c40-ad6fe92db9dd admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:52.428499 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-277457a1-da2b-48e2-9c40-ad6fe92db9dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bcfa52f8d624dffb8d11b14bdd98f8d', 'request_id': 'req-277457a1-da2b-48e2-9c40-ad6fe92db9dd'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:52.436259 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-277457a1-da2b-48e2-9c40-ad6fe92db9dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bcfa52f8d624dffb8d11b14bdd98f8d', 'request_id': 'req-277457a1-da2b-48e2-9c40-ad6fe92db9dd'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:52.440968 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:52.446146 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-277457a1-da2b-48e2-9c40-ad6fe92db9dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bcfa52f8d624dffb8d11b14bdd98f8d', 'request_id': 'req-277457a1-da2b-48e2-9c40-ad6fe92db9dd'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:52.467748 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-277457a1-da2b-48e2-9c40-ad6fe92db9dd admin admin] The token cache is being invalidate because project 2bcfa52f8d624dffb8d11b14bdd98f8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:51:52.468148 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-277457a1-da2b-48e2-9c40-ad6fe92db9dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:52.469209 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-277457a1-da2b-48e2-9c40-ad6fe92db9dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:51:52.474510 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1242/2484] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:51:52 2022] DELETE /identity/v3/projects/2bcfa52f8d624dffb8d11b14bdd98f8d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:52.476795 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fa469-ad60-43ce-9e34-73a6fe84472b None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:52.477283 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fa469-ad60-43ce-9e34-73a6fe84472b None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:52.477412 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43fa469-ad60-43ce-9e34-73a6fe84472b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:52.499872 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-d43fa469-ad60-43ce-9e34-73a6fe84472b None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:52.501211 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-d43fa469-ad60-43ce-9e34-73a6fe84472b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:52.747838 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1243/2485] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:52.757035 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c946da-1c1d-4d52-96b0-672868fe68a9 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:52.757781 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c946da-1c1d-4d52-96b0-672868fe68a9 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:52.757781 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c946da-1c1d-4d52-96b0-672868fe68a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:52.814418 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-81c946da-1c1d-4d52-96b0-672868fe68a9 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:52.815710 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-81c946da-1c1d-4d52-96b0-672868fe68a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:52.836554 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1243/2486] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:52.840955 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43fa469-ad60-43ce-9e34-73a6fe84472b None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:52.860601 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43fa469-ad60-43ce-9e34-73a6fe84472b None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:52.873273 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae737432-0f61-4060-be70-e9750b290847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:52.874978 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae737432-0f61-4060-be70-e9750b290847 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:52.876813 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae737432-0f61-4060-be70-e9750b290847 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:52.877310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae737432-0f61-4060-be70-e9750b290847 admin admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:52.881822 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae737432-0f61-4060-be70-e9750b290847 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:51:52.882234 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae737432-0f61-4060-be70-e9750b290847 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:52.884056 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae737432-0f61-4060-be70-e9750b290847 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:52.920950 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c946da-1c1d-4d52-96b0-672868fe68a9 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:52.927080 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1244/2487] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:51:52.932080 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c946da-1c1d-4d52-96b0-672868fe68a9 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:52.959591 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9f17b-6ddd-4f35-8a45-c46257a39bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:52.960196 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9f17b-6ddd-4f35-8a45-c46257a39bcc admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:52.960475 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9f17b-6ddd-4f35-8a45-c46257a39bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:52.960824 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f9f17b-6ddd-4f35-8a45-c46257a39bcc admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:52.961505 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f9f17b-6ddd-4f35-8a45-c46257a39bcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:52.964586 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f9f17b-6ddd-4f35-8a45-c46257a39bcc admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:53.017408 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1244/2488] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:52 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:51:53.019225 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae737432-0f61-4060-be70-e9750b290847 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:53.030782 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae737432-0f61-4060-be70-e9750b290847 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:53.099230 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:53.164784 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f596fd-c699-4346-af2f-62c22a302b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:53.165796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f596fd-c699-4346-af2f-62c22a302b27 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:53.166312 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f596fd-c699-4346-af2f-62c22a302b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:53.166936 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f596fd-c699-4346-af2f-62c22a302b27 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:53.168115 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f596fd-c699-4346-af2f-62c22a302b27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:53.170786 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f596fd-c699-4346-af2f-62c22a302b27 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:53.202514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1245/2489] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:53 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:53.207136 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9f17b-6ddd-4f35-8a45-c46257a39bcc admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:53.225494 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f9f17b-6ddd-4f35-8a45-c46257a39bcc admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:53.231877 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ce8c2-0eaf-4e30-aaa2-a01c2ee8add2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:53.232999 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ce8c2-0eaf-4e30-aaa2-a01c2ee8add2 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:53.233612 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ce8c2-0eaf-4e30-aaa2-a01c2ee8add2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:53.234098 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ce8c2-0eaf-4e30-aaa2-a01c2ee8add2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:53.235042 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ce8c2-0eaf-4e30-aaa2-a01c2ee8add2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:53.237392 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ce8c2-0eaf-4e30-aaa2-a01c2ee8add2 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:53.252391 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1245/2490] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:53.256204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f596fd-c699-4346-af2f-62c22a302b27 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:53.273144 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f596fd-c699-4346-af2f-62c22a302b27 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:53.283787 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8edd3c-a6da-4de9-aa83-9a193775459e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:53.284735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8edd3c-a6da-4de9-aa83-9a193775459e admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:53.285233 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8edd3c-a6da-4de9-aa83-9a193775459e admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:53.285763 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8edd3c-a6da-4de9-aa83-9a193775459e admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:53.287638 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8edd3c-a6da-4de9-aa83-9a193775459e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:53.290293 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8edd3c-a6da-4de9-aa83-9a193775459e admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:53.312424 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1246/2491] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:51:53.313686 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ce8c2-0eaf-4e30-aaa2-a01c2ee8add2 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:53.324876 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ce8c2-0eaf-4e30-aaa2-a01c2ee8add2 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:53.329911 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0ebf6-807d-46b7-bbfe-78c5e04a292a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:53.330577 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0ebf6-807d-46b7-bbfe-78c5e04a292a admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:53.330849 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0ebf6-807d-46b7-bbfe-78c5e04a292a admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:53.331148 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0ebf6-807d-46b7-bbfe-78c5e04a292a admin admin] PATH_INFO: `/v3/projects/b555d885bdfc4f3c8fd295c14a46c2c1/users/d85ea8509d2342eebb50f04f11c0a99f/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:53.347030 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0ebf6-807d-46b7-bbfe-78c5e04a292a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b555d885bdfc4f3c8fd295c14a46c2c1, user_id=d85ea8509d2342eebb50f04f11c0a99f, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:53.349882 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0ebf6-807d-46b7-bbfe-78c5e04a292a admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:53.366875 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1246/2492] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:51:53 2022] PUT /identity/v3/projects/b555d885bdfc4f3c8fd295c14a46c2c1/users/d85ea8509d2342eebb50f04f11c0a99f/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:51:53.372553 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788c944-699e-4e78-9e9d-243549bd5cbe None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:53.373155 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788c944-699e-4e78-9e9d-243549bd5cbe None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:53.373457 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788c944-699e-4e78-9e9d-243549bd5cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:53.396205 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-9788c944-699e-4e78-9e9d-243549bd5cbe None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:53.397868 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-9788c944-699e-4e78-9e9d-243549bd5cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:53.482558 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1247/2493] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:51:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:53.492760 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0ebf6-807d-46b7-bbfe-78c5e04a292a admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:53.494543 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-e2c0ebf6-807d-46b7-bbfe-78c5e04a292a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:53.567589 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0ebf6-807d-46b7-bbfe-78c5e04a292a admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:53.571495 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effb293-3bc0-4ed2-8ed3-3143735939ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:53.572349 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effb293-3bc0-4ed2-8ed3-3143735939ec service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:53.572800 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effb293-3bc0-4ed2-8ed3-3143735939ec service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:53.573280 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effb293-3bc0-4ed2-8ed3-3143735939ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:53.583803 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8effb293-3bc0-4ed2-8ed3-3143735939ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:53.585249 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8effb293-3bc0-4ed2-8ed3-3143735939ec service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:53.607193 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1247/2494] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:58.850802 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ce5b2-f9c0-4d9b-b71c-077ffa664d74 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:58.852101 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ce5b2-f9c0-4d9b-b71c-077ffa664d74 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:58.852576 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ce5b2-f9c0-4d9b-b71c-077ffa664d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:58.876223 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-a68ce5b2-f9c0-4d9b-b71c-077ffa664d74 None None] MFA Rules not processed for user `c737c4586910476eafead0dfd4d9bc4c`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:58.878439 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-a68ce5b2-f9c0-4d9b-b71c-077ffa664d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:58.958684 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1248/2495] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 24 04:51:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:58.969308 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effb293-3bc0-4ed2-8ed3-3143735939ec service neutron] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:58.971604 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-8effb293-3bc0-4ed2-8ed3-3143735939ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:59.089792 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effb293-3bc0-4ed2-8ed3-3143735939ec service neutron] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:59.102863 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88754b0e-1c19-47ff-afe0-0e50a479ffa1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ebb5105220438693118d734c9fda70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:59.103650 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88754b0e-1c19-47ff-afe0-0e50a479ffa1 service swift] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:59.106451 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88754b0e-1c19-47ff-afe0-0e50a479ffa1 service swift] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:59.106958 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88754b0e-1c19-47ff-afe0-0e50a479ffa1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:59.135949 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88754b0e-1c19-47ff-afe0-0e50a479ffa1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:59.138584 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88754b0e-1c19-47ff-afe0-0e50a479ffa1 service swift] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:59.189458 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1248/2496] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 24 04:51:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 04:51:59.527982 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ac795-473d-4aae-847d-b8f1e60f5c44 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:59.528512 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ac795-473d-4aae-847d-b8f1e60f5c44 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:59.529015 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ac795-473d-4aae-847d-b8f1e60f5c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:59.568284 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-e70ac795-473d-4aae-847d-b8f1e60f5c44 None None] MFA Rules not processed for user `d85ea8509d2342eebb50f04f11c0a99f`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:59.571653 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-e70ac795-473d-4aae-847d-b8f1e60f5c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:59.666700 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:59.688372 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1249/2497] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:51:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:59.697962 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88754b0e-1c19-47ff-afe0-0e50a479ffa1 service swift] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:59.724319 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88754b0e-1c19-47ff-afe0-0e50a479ffa1 service swift] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:59.742567 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66232e-05e8-4dc3-ad4a-0f0c224bbb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:59.743388 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66232e-05e8-4dc3-ad4a-0f0c224bbb39 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:59.743675 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66232e-05e8-4dc3-ad4a-0f0c224bbb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:59.744064 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66232e-05e8-4dc3-ad4a-0f0c224bbb39 admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:59.745298 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa66232e-05e8-4dc3-ad4a-0f0c224bbb39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:59.747958 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa66232e-05e8-4dc3-ad4a-0f0c224bbb39 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:59.788373 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:59.817435 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1249/2498] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:51:59 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:59.821325 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ac795-473d-4aae-847d-b8f1e60f5c44 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:59.837133 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ac795-473d-4aae-847d-b8f1e60f5c44 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:59.924997 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9d339-66b4-4537-b221-7fa86bf2a2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:59.925779 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9d339-66b4-4537-b221-7fa86bf2a2e6 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:59.926048 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9d339-66b4-4537-b221-7fa86bf2a2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:59.926312 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9d339-66b4-4537-b221-7fa86bf2a2e6 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:59.927054 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9d339-66b4-4537-b221-7fa86bf2a2e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:59.934858 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9d339-66b4-4537-b221-7fa86bf2a2e6 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:59.966284 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1250/2499] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:51:59 2022] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:51:59.970001 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66232e-05e8-4dc3-ad4a-0f0c224bbb39 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:59.986049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66232e-05e8-4dc3-ad4a-0f0c224bbb39 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:59.991927 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2536e-2186-450f-9de5-5d8a38bf3b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:59.992933 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2536e-2186-450f-9de5-5d8a38bf3b49 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:59.993405 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2536e-2186-450f-9de5-5d8a38bf3b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:59.994016 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2536e-2186-450f-9de5-5d8a38bf3b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:59.994835 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2536e-2186-450f-9de5-5d8a38bf3b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:59.996770 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2536e-2186-450f-9de5-5d8a38bf3b49 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:00.018851 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1250/2500] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:52:00.019977 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9d339-66b4-4537-b221-7fa86bf2a2e6 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:00.031548 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9d339-66b4-4537-b221-7fa86bf2a2e6 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:00.042914 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcff1f3-d223-4e1e-a035-ece739756f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:00.043949 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcff1f3-d223-4e1e-a035-ece739756f27 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:00.045695 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcff1f3-d223-4e1e-a035-ece739756f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:00.046051 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcff1f3-d223-4e1e-a035-ece739756f27 admin admin] PATH_INFO: `/v3/projects/0264c4f9176346cca09bfc2ab58a3f9f/users/39afaa1dd0b048a8a43e2e987a347ebf/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:00.067387 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcff1f3-d223-4e1e-a035-ece739756f27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0264c4f9176346cca09bfc2ab58a3f9f, user_id=39afaa1dd0b048a8a43e2e987a347ebf, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:00.070905 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcff1f3-d223-4e1e-a035-ece739756f27 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:00.089961 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1251/2501] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:52:00 2022] PUT /identity/v3/projects/0264c4f9176346cca09bfc2ab58a3f9f/users/39afaa1dd0b048a8a43e2e987a347ebf/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:52:00.091203 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2536e-2186-450f-9de5-5d8a38bf3b49 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:00.103996 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2536e-2186-450f-9de5-5d8a38bf3b49 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:00.186149 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8d950-1471-49f9-b60f-a11c4b05f739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:00.187042 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8d950-1471-49f9-b60f-a11c4b05f739 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:00.187514 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8d950-1471-49f9-b60f-a11c4b05f739 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:00.188106 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8d950-1471-49f9-b60f-a11c4b05f739 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:00.189083 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c8d950-1471-49f9-b60f-a11c4b05f739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:00.189846 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533eb86b-e9bf-49e6-8f4c-4867c9996282 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:00.190208 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533eb86b-e9bf-49e6-8f4c-4867c9996282 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:00.190536 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533eb86b-e9bf-49e6-8f4c-4867c9996282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:00.191723 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c8d950-1471-49f9-b60f-a11c4b05f739 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:00.208709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1251/2502] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:52:00.210461 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8d950-1471-49f9-b60f-a11c4b05f739 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:00.218552 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-533eb86b-e9bf-49e6-8f4c-4867c9996282 None None] MFA Rules not processed for user `c737c4586910476eafead0dfd4d9bc4c`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:00.220427 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-533eb86b-e9bf-49e6-8f4c-4867c9996282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:00.226372 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8d950-1471-49f9-b60f-a11c4b05f739 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:00.231413 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3697f-b36d-4f12-a1d0-0c0e03198485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:00.232081 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3697f-b36d-4f12-a1d0-0c0e03198485 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:00.232366 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3697f-b36d-4f12-a1d0-0c0e03198485 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:00.232641 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3697f-b36d-4f12-a1d0-0c0e03198485 admin admin] PATH_INFO: `/v3/projects/0264c4f9176346cca09bfc2ab58a3f9f/users/39afaa1dd0b048a8a43e2e987a347ebf/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:00.234796 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3697f-b36d-4f12-a1d0-0c0e03198485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0264c4f9176346cca09bfc2ab58a3f9f, user_id=39afaa1dd0b048a8a43e2e987a347ebf, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:00.237630 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3697f-b36d-4f12-a1d0-0c0e03198485 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:00.256711 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1252/2503] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:52:00 2022] PUT /identity/v3/projects/0264c4f9176346cca09bfc2ab58a3f9f/users/39afaa1dd0b048a8a43e2e987a347ebf/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:52:00.354802 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1252/2504] 10.222.0.49 () {58 vars in 967 bytes} [Wed Aug 24 04:52:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:52:00.382639 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3697f-b36d-4f12-a1d0-0c0e03198485 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:00.507558 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3697f-b36d-4f12-a1d0-0c0e03198485 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:00.514736 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1885a-b2b3-408c-8815-bcbd4cbe3a30 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ebb5105220438693118d734c9fda70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:00.515500 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1885a-b2b3-408c-8815-bcbd4cbe3a30 service swift] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:00.515845 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1885a-b2b3-408c-8815-bcbd4cbe3a30 service swift] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:00.516193 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1885a-b2b3-408c-8815-bcbd4cbe3a30 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:00.621551 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b1885a-b2b3-408c-8815-bcbd4cbe3a30 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:00.623602 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b1885a-b2b3-408c-8815-bcbd4cbe3a30 service swift] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:00.637055 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1253/2505] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 24 04:52:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:52:01.221485 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ec7f4-6815-47a2-ae73-c48639814c0d None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:01.222040 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ec7f4-6815-47a2-ae73-c48639814c0d None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:01.222241 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ec7f4-6815-47a2-ae73-c48639814c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:01.289113 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-cd3ec7f4-6815-47a2-ae73-c48639814c0d None None] MFA Rules not processed for user `c737c4586910476eafead0dfd4d9bc4c`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:01.299120 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-cd3ec7f4-6815-47a2-ae73-c48639814c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:01.345556 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1253/2506] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 24 04:52:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:01.353003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1885a-b2b3-408c-8815-bcbd4cbe3a30 service swift] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:01.372913 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1885a-b2b3-408c-8815-bcbd4cbe3a30 service swift] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:01.382494 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea3eb1-d2d9-4ca8-942c-61980b821837 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ebb5105220438693118d734c9fda70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:01.383828 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea3eb1-d2d9-4ca8-942c-61980b821837 service swift] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:01.384487 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea3eb1-d2d9-4ca8-942c-61980b821837 service swift] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:01.385721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea3eb1-d2d9-4ca8-942c-61980b821837 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:01.393774 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:01.407333 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea3eb1-d2d9-4ca8-942c-61980b821837 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:01.410827 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea3eb1-d2d9-4ca8-942c-61980b821837 service swift] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:01.439935 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1254/2507] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 24 04:52:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:52:02.006855 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2c5c8-b29d-4415-91fd-99d91f52b3a3 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:02.007453 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2c5c8-b29d-4415-91fd-99d91f52b3a3 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:02.007854 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2c5c8-b29d-4415-91fd-99d91f52b3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:02.053015 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-e0a2c5c8-b29d-4415-91fd-99d91f52b3a3 None None] MFA Rules not processed for user `c737c4586910476eafead0dfd4d9bc4c`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:02.055017 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-e0a2c5c8-b29d-4415-91fd-99d91f52b3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:02.075190 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1254/2508] 10.222.0.49 () {58 vars in 967 bytes} [Wed Aug 24 04:52:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:02.087218 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea3eb1-d2d9-4ca8-942c-61980b821837 service swift] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:02.101871 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea3eb1-d2d9-4ca8-942c-61980b821837 service swift] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:02.108259 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ced1c3-5b3f-4e05-9e40-85a4f5b5adeb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ebb5105220438693118d734c9fda70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:02.108800 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ced1c3-5b3f-4e05-9e40-85a4f5b5adeb service swift] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:02.109056 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ced1c3-5b3f-4e05-9e40-85a4f5b5adeb service swift] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:02.109324 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ced1c3-5b3f-4e05-9e40-85a4f5b5adeb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:02.120459 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ced1c3-5b3f-4e05-9e40-85a4f5b5adeb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:02.122849 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ced1c3-5b3f-4e05-9e40-85a4f5b5adeb service swift] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:02.157274 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1255/2509] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 24 04:52:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 04:52:05.410891 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2c5c8-b29d-4415-91fd-99d91f52b3a3 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:05.414254 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-e0a2c5c8-b29d-4415-91fd-99d91f52b3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:05.524784 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:05.543595 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2c5c8-b29d-4415-91fd-99d91f52b3a3 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:05.550418 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3fd5a-cd86-4441-b3b7-01743045128d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:05.551080 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3fd5a-cd86-4441-b3b7-01743045128d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:05.551427 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3fd5a-cd86-4441-b3b7-01743045128d admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:05.557167 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3fd5a-cd86-4441-b3b7-01743045128d admin admin] PATH_INFO: `/v3/users/e3330478cfe14efe85828a55d4d51733` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:05.559042 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e3fd5a-cd86-4441-b3b7-01743045128d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3330478cfe14efe85828a55d4d51733)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:05.563366 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e3fd5a-cd86-4441-b3b7-01743045128d admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:05.644073 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-59e3fd5a-cd86-4441-b3b7-01743045128d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3330478cfe14efe85828a55d4d51733'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:05.645927 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-59e3fd5a-cd86-4441-b3b7-01743045128d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3330478cfe14efe85828a55d4d51733'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:05.647322 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-59e3fd5a-cd86-4441-b3b7-01743045128d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3330478cfe14efe85828a55d4d51733'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:05.668461 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-59e3fd5a-cd86-4441-b3b7-01743045128d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3330478cfe14efe85828a55d4d51733'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:05.696824 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-59e3fd5a-cd86-4441-b3b7-01743045128d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3330478cfe14efe85828a55d4d51733'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:05.733149 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1255/2510] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:52:05 2022] DELETE /identity/v3/users/e3330478cfe14efe85828a55d4d51733 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:52:05.734747 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a56285-99b6-4ac7-b9e0-76aa683ce002 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:05.735307 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a56285-99b6-4ac7-b9e0-76aa683ce002 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:05.735307 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a56285-99b6-4ac7-b9e0-76aa683ce002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:05.770899 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-a5a56285-99b6-4ac7-b9e0-76aa683ce002 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:05.773770 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-a5a56285-99b6-4ac7-b9e0-76aa683ce002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:05.973953 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1256/2511] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:05.984661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3fd5a-cd86-4441-b3b7-01743045128d admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:05.986256 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-59e3fd5a-cd86-4441-b3b7-01743045128d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:06.123334 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3fd5a-cd86-4441-b3b7-01743045128d admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:06.136988 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e0098-de18-4e8c-ae48-14f59ba83ba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:06.137584 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e0098-de18-4e8c-ae48-14f59ba83ba4 service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:06.137942 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e0098-de18-4e8c-ae48-14f59ba83ba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:06.138210 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e0098-de18-4e8c-ae48-14f59ba83ba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:06.158626 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e0098-de18-4e8c-ae48-14f59ba83ba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:06.158626 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e0098-de18-4e8c-ae48-14f59ba83ba4 service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:06.197048 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1256/2512] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:52:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:52:06.671859 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a56285-99b6-4ac7-b9e0-76aa683ce002 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:06.673401 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-a5a56285-99b6-4ac7-b9e0-76aa683ce002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:06.691373 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a56285-99b6-4ac7-b9e0-76aa683ce002 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:06.720632 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74553b2-97b2-4779-8f7d-89824ff25c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:06.721173 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74553b2-97b2-4779-8f7d-89824ff25c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:06.721487 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74553b2-97b2-4779-8f7d-89824ff25c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:06.721761 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74553b2-97b2-4779-8f7d-89824ff25c60 admin admin] PATH_INFO: `/v3/projects/94842228015e4fd280c6b9bfb497bce3` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:06.722906 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74553b2-97b2-4779-8f7d-89824ff25c60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94842228015e4fd280c6b9bfb497bce3)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:06.724835 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74553b2-97b2-4779-8f7d-89824ff25c60 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:06.825876 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b74553b2-97b2-4779-8f7d-89824ff25c60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94842228015e4fd280c6b9bfb497bce3', 'request_id': 'req-b74553b2-97b2-4779-8f7d-89824ff25c60'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:06.836810 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b74553b2-97b2-4779-8f7d-89824ff25c60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94842228015e4fd280c6b9bfb497bce3', 'request_id': 'req-b74553b2-97b2-4779-8f7d-89824ff25c60'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:06.856916 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b74553b2-97b2-4779-8f7d-89824ff25c60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94842228015e4fd280c6b9bfb497bce3', 'request_id': 'req-b74553b2-97b2-4779-8f7d-89824ff25c60'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:06.875815 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b74553b2-97b2-4779-8f7d-89824ff25c60 admin admin] The token cache is being invalidate because project 94842228015e4fd280c6b9bfb497bce3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:52:06.876114 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b74553b2-97b2-4779-8f7d-89824ff25c60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:06.878025 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b74553b2-97b2-4779-8f7d-89824ff25c60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:06.882034 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1257/2513] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:52:06 2022] DELETE /identity/v3/projects/94842228015e4fd280c6b9bfb497bce3 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:52:06.887032 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9d620-54d6-4e4e-be21-356a7be4cc10 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:06.888127 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9d620-54d6-4e4e-be21-356a7be4cc10 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:06.888531 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9d620-54d6-4e4e-be21-356a7be4cc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:06.921231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-e5a9d620-54d6-4e4e-be21-356a7be4cc10 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:06.922609 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-e5a9d620-54d6-4e4e-be21-356a7be4cc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:07.062042 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1257/2514] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:07.070576 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7d668-5327-4081-ac48-b245433f4964 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:07.071004 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7d668-5327-4081-ac48-b245433f4964 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:07.071368 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7d668-5327-4081-ac48-b245433f4964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:07.090675 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0115d-196e-4322-9aea-09ca198623cb None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:07.091346 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0115d-196e-4322-9aea-09ca198623cb None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:07.092079 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d0115d-196e-4322-9aea-09ca198623cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:07.121167 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-3cf7d668-5327-4081-ac48-b245433f4964 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:07.122762 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-3cf7d668-5327-4081-ac48-b245433f4964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:07.144371 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1258/2515] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:52:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:07.145728 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7d668-5327-4081-ac48-b245433f4964 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:07.163503 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:07.165696 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-43d0115d-196e-4322-9aea-09ca198623cb None None] MFA Rules not processed for user `39afaa1dd0b048a8a43e2e987a347ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:07.166112 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7d668-5327-4081-ac48-b245433f4964 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:07.177282 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-43d0115d-196e-4322-9aea-09ca198623cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:07.178014 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39efe40-e863-49b8-b13b-d54535b5d6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:07.179446 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39efe40-e863-49b8-b13b-d54535b5d6aa admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:07.181315 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39efe40-e863-49b8-b13b-d54535b5d6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:07.181315 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39efe40-e863-49b8-b13b-d54535b5d6aa admin admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:07.182524 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39efe40-e863-49b8-b13b-d54535b5d6aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:52:07.182892 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39efe40-e863-49b8-b13b-d54535b5d6aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:07.184632 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39efe40-e863-49b8-b13b-d54535b5d6aa admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:07.207429 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1259/2516] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:52:07.209539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39efe40-e863-49b8-b13b-d54535b5d6aa admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:07.222693 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39efe40-e863-49b8-b13b-d54535b5d6aa admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:07.228707 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb45b8-bf81-4d5c-828b-f24c00b8677a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:07.229993 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb45b8-bf81-4d5c-828b-f24c00b8677a admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:07.230338 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb45b8-bf81-4d5c-828b-f24c00b8677a admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:07.230669 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb45b8-bf81-4d5c-828b-f24c00b8677a admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:07.231862 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb45b8-bf81-4d5c-828b-f24c00b8677a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:07.235082 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb45b8-bf81-4d5c-828b-f24c00b8677a admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:07.286769 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1260/2517] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:52:07 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:52:07.289539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb45b8-bf81-4d5c-828b-f24c00b8677a admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:07.325831 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:07.373366 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb45b8-bf81-4d5c-828b-f24c00b8677a admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:07.379893 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d65434-d45c-46ce-84d2-f397994fec18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:07.380665 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d65434-d45c-46ce-84d2-f397994fec18 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:07.381004 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d65434-d45c-46ce-84d2-f397994fec18 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:07.381384 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d65434-d45c-46ce-84d2-f397994fec18 admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:07.382098 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d65434-d45c-46ce-84d2-f397994fec18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:07.384098 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d65434-d45c-46ce-84d2-f397994fec18 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:07.396206 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1258/2518] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:52:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:07.410744 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0115d-196e-4322-9aea-09ca198623cb None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:07.413854 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-43d0115d-196e-4322-9aea-09ca198623cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:07.438160 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1261/2519] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:52:07 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:52:07.439396 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d65434-d45c-46ce-84d2-f397994fec18 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:07.450863 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d65434-d45c-46ce-84d2-f397994fec18 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:07.456292 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d3e64-5aeb-4db2-88db-d8c76aa55119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:07.457030 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d3e64-5aeb-4db2-88db-d8c76aa55119 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:07.457421 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d3e64-5aeb-4db2-88db-d8c76aa55119 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:07.457861 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d3e64-5aeb-4db2-88db-d8c76aa55119 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:07.458454 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d3e64-5aeb-4db2-88db-d8c76aa55119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:07.460420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d3e64-5aeb-4db2-88db-d8c76aa55119 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:07.497994 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1262/2520] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:52:07.507213 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d3e64-5aeb-4db2-88db-d8c76aa55119 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:07.526693 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d3e64-5aeb-4db2-88db-d8c76aa55119 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:07.532545 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11741b5a-a231-491a-8f76-74d98764c50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:07.533633 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11741b5a-a231-491a-8f76-74d98764c50e admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:07.533633 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11741b5a-a231-491a-8f76-74d98764c50e admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:07.533885 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11741b5a-a231-491a-8f76-74d98764c50e admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:07.534614 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11741b5a-a231-491a-8f76-74d98764c50e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:07.537000 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11741b5a-a231-491a-8f76-74d98764c50e admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:07.569049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1263/2521] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:52:07.573011 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11741b5a-a231-491a-8f76-74d98764c50e admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:07.581032 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d0115d-196e-4322-9aea-09ca198623cb None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:07.594096 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11741b5a-a231-491a-8f76-74d98764c50e admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:07.601182 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa23ed0-9255-4d94-a81d-47d5e2104804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:07.601912 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa23ed0-9255-4d94-a81d-47d5e2104804 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:07.602186 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa23ed0-9255-4d94-a81d-47d5e2104804 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:07.602454 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa23ed0-9255-4d94-a81d-47d5e2104804 admin admin] PATH_INFO: `/v3/projects/95005d7baa974ef1a92b7b83dafcd15d/users/29b8b1421c674580bac351e65a4cc0ee/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:07.642214 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa23ed0-9255-4d94-a81d-47d5e2104804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95005d7baa974ef1a92b7b83dafcd15d, user_id=29b8b1421c674580bac351e65a4cc0ee, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:07.647095 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa23ed0-9255-4d94-a81d-47d5e2104804 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:07.673380 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1264/2522] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:52:07 2022] PUT /identity/v3/projects/95005d7baa974ef1a92b7b83dafcd15d/users/29b8b1421c674580bac351e65a4cc0ee/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:52:07.679900 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7ae92-28f9-4f89-a702-1fdbcbb698ac None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:07.680201 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7ae92-28f9-4f89-a702-1fdbcbb698ac None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:07.680458 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7ae92-28f9-4f89-a702-1fdbcbb698ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:07.682332 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74e133-7ca5-408e-8ae3-55d049caa2e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:07.682735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74e133-7ca5-408e-8ae3-55d049caa2e9 service nova] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:07.683028 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74e133-7ca5-408e-8ae3-55d049caa2e9 service nova] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:07.683299 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74e133-7ca5-408e-8ae3-55d049caa2e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:07.692212 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-de74e133-7ca5-408e-8ae3-55d049caa2e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:07.729437 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-d6e7ae92-28f9-4f89-a702-1fdbcbb698ac None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:07.731528 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-d6e7ae92-28f9-4f89-a702-1fdbcbb698ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:07.759678 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:07.807026 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de74e133-7ca5-408e-8ae3-55d049caa2e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:07.809186 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de74e133-7ca5-408e-8ae3-55d049caa2e9 service nova] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:07.828894 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1265/2523] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:52:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:07.837578 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1259/2524] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:52:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:52:07.840065 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7ae92-28f9-4f89-a702-1fdbcbb698ac None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:07.841502 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-d6e7ae92-28f9-4f89-a702-1fdbcbb698ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:07.956280 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7ae92-28f9-4f89-a702-1fdbcbb698ac None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:07.962783 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8956fa-1f51-4243-ac5e-f29c3d3f816d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:07.963894 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8956fa-1f51-4243-ac5e-f29c3d3f816d service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:07.964251 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8956fa-1f51-4243-ac5e-f29c3d3f816d service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:07.964787 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8956fa-1f51-4243-ac5e-f29c3d3f816d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:07.997687 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8956fa-1f51-4243-ac5e-f29c3d3f816d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:07.999357 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8956fa-1f51-4243-ac5e-f29c3d3f816d service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:08.016374 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1266/2525] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:52:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:52:09.921392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0590f-9d46-4b63-8d51-a586c90761d2 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:09.922004 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0590f-9d46-4b63-8d51-a586c90761d2 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:09.922004 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba0590f-9d46-4b63-8d51-a586c90761d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:09.942889 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-eba0590f-9d46-4b63-8d51-a586c90761d2 None None] MFA Rules not processed for user `d85ea8509d2342eebb50f04f11c0a99f`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:09.944508 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-eba0590f-9d46-4b63-8d51-a586c90761d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:10.050881 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1260/2526] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:52:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:14.478753 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcc26f-7f7b-44af-9fcf-693bf1b6b6c1 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:14.479372 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcc26f-7f7b-44af-9fcf-693bf1b6b6c1 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:14.479372 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcc26f-7f7b-44af-9fcf-693bf1b6b6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:14.517973 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:14.538879 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-68fcc26f-7f7b-44af-9fcf-693bf1b6b6c1 None None] MFA Rules not processed for user `29b8b1421c674580bac351e65a4cc0ee`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:14.540121 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-68fcc26f-7f7b-44af-9fcf-693bf1b6b6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:14.675341 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1267/2527] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:52:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:14.676928 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0590f-9d46-4b63-8d51-a586c90761d2 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:14.695749 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba0590f-9d46-4b63-8d51-a586c90761d2 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:14.701629 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e801ef5-14ea-4277-bc46-06967453f2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:14.702480 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e801ef5-14ea-4277-bc46-06967453f2aa admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:14.702831 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e801ef5-14ea-4277-bc46-06967453f2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:14.703174 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e801ef5-14ea-4277-bc46-06967453f2aa admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:14.704036 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e801ef5-14ea-4277-bc46-06967453f2aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:14.706182 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e801ef5-14ea-4277-bc46-06967453f2aa admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:14.786397 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1261/2528] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:52:14 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:52:14.786714 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcc26f-7f7b-44af-9fcf-693bf1b6b6c1 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:14.802671 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcc26f-7f7b-44af-9fcf-693bf1b6b6c1 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:14.905876 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a343d-96de-4375-a2e7-09c6e2cec209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:14.906508 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a343d-96de-4375-a2e7-09c6e2cec209 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:14.906764 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a343d-96de-4375-a2e7-09c6e2cec209 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:14.907041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a343d-96de-4375-a2e7-09c6e2cec209 admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:14.907675 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9a343d-96de-4375-a2e7-09c6e2cec209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:14.909678 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9a343d-96de-4375-a2e7-09c6e2cec209 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:14.957087 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1268/2529] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:52:14 2022] POST /identity/v3/users => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:52:14.962128 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e801ef5-14ea-4277-bc46-06967453f2aa admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:14.982044 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e801ef5-14ea-4277-bc46-06967453f2aa admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:15.004132 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fc645-7fc3-4cc7-8d27-d06e5085ab5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:15.005112 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fc645-7fc3-4cc7-8d27-d06e5085ab5e admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:15.005512 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fc645-7fc3-4cc7-8d27-d06e5085ab5e admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:15.005847 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fc645-7fc3-4cc7-8d27-d06e5085ab5e admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:15.006876 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545fc645-7fc3-4cc7-8d27-d06e5085ab5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:15.009435 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545fc645-7fc3-4cc7-8d27-d06e5085ab5e admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:15.033302 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1262/2530] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:52:15.037850 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a343d-96de-4375-a2e7-09c6e2cec209 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:15.058560 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a343d-96de-4375-a2e7-09c6e2cec209 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:15.065842 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980104d-2159-4a02-b52e-246c87e0b34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:15.066827 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980104d-2159-4a02-b52e-246c87e0b34f admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:15.067263 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980104d-2159-4a02-b52e-246c87e0b34f admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:15.067688 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980104d-2159-4a02-b52e-246c87e0b34f admin admin] PATH_INFO: `/v3/projects/d9c8e23951df4756a00e0ede298a0370/users/b703c69cfd0c426f814b44c9152c3563/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:15.097120 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7980104d-2159-4a02-b52e-246c87e0b34f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9c8e23951df4756a00e0ede298a0370, user_id=b703c69cfd0c426f814b44c9152c3563, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:15.100374 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7980104d-2159-4a02-b52e-246c87e0b34f admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:15.125601 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1269/2531] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:52:15 2022] PUT /identity/v3/projects/d9c8e23951df4756a00e0ede298a0370/users/b703c69cfd0c426f814b44c9152c3563/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:52:15.138745 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fc645-7fc3-4cc7-8d27-d06e5085ab5e admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:15.157405 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fc645-7fc3-4cc7-8d27-d06e5085ab5e admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:15.242597 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b37e7-99f2-4f78-9878-9c2ff4aacd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:15.243689 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b37e7-99f2-4f78-9878-9c2ff4aacd6e admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:15.244259 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b37e7-99f2-4f78-9878-9c2ff4aacd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:15.244942 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b37e7-99f2-4f78-9878-9c2ff4aacd6e admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:15.246179 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b37e7-99f2-4f78-9878-9c2ff4aacd6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:15.248235 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b37e7-99f2-4f78-9878-9c2ff4aacd6e admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:15.263482 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1263/2532] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:52:15.267981 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980104d-2159-4a02-b52e-246c87e0b34f admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:15.290660 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980104d-2159-4a02-b52e-246c87e0b34f admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:15.305813 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917a2ff-a3d5-4f5d-8316-6e5e6a4c267a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:15.308523 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917a2ff-a3d5-4f5d-8316-6e5e6a4c267a admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:15.308894 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917a2ff-a3d5-4f5d-8316-6e5e6a4c267a admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:15.309177 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917a2ff-a3d5-4f5d-8316-6e5e6a4c267a admin admin] PATH_INFO: `/v3/projects/d9c8e23951df4756a00e0ede298a0370/users/b703c69cfd0c426f814b44c9152c3563/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:15.318181 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9917a2ff-a3d5-4f5d-8316-6e5e6a4c267a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9c8e23951df4756a00e0ede298a0370, user_id=b703c69cfd0c426f814b44c9152c3563, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:15.322997 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9917a2ff-a3d5-4f5d-8316-6e5e6a4c267a admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:15.346927 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1270/2533] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:52:15 2022] PUT /identity/v3/projects/d9c8e23951df4756a00e0ede298a0370/users/b703c69cfd0c426f814b44c9152c3563/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:52:17.174788 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea416c93-f051-4c86-a199-ecbcfc4ec752 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:17.175280 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea416c93-f051-4c86-a199-ecbcfc4ec752 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:17.175541 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea416c93-f051-4c86-a199-ecbcfc4ec752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:17.198946 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-ea416c93-f051-4c86-a199-ecbcfc4ec752 None None] MFA Rules not processed for user `c737c4586910476eafead0dfd4d9bc4c`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:17.200426 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-ea416c93-f051-4c86-a199-ecbcfc4ec752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:17.245512 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:17.265451 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1264/2534] 10.222.0.49 () {58 vars in 967 bytes} [Wed Aug 24 04:52:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:17.283106 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917a2ff-a3d5-4f5d-8316-6e5e6a4c267a admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:17.285433 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-9917a2ff-a3d5-4f5d-8316-6e5e6a4c267a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:17.363174 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:17.390881 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917a2ff-a3d5-4f5d-8316-6e5e6a4c267a admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:17.396520 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e60848-c762-4fbb-b74d-526795f13315 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ebb5105220438693118d734c9fda70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:17.403810 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e60848-c762-4fbb-b74d-526795f13315 service swift] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:17.403810 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e60848-c762-4fbb-b74d-526795f13315 service swift] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:17.403810 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e60848-c762-4fbb-b74d-526795f13315 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:17.422963 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e60848-c762-4fbb-b74d-526795f13315 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:17.426009 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e60848-c762-4fbb-b74d-526795f13315 service swift] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:17.436230 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1271/2535] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 24 04:52:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 04:52:19.929522 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fc4bc-1a57-4855-a2fc-e43adc3edfe9 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:19.930414 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fc4bc-1a57-4855-a2fc-e43adc3edfe9 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:19.930866 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fc4bc-1a57-4855-a2fc-e43adc3edfe9 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:19.935667 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1265/2536] 10.222.0.49 () {54 vars in 921 bytes} [Wed Aug 24 04:52:19 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:52:19.943231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68394c81-da89-4bd0-8996-63dbfc0991ab None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:19.944308 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68394c81-da89-4bd0-8996-63dbfc0991ab None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:19.944886 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68394c81-da89-4bd0-8996-63dbfc0991ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:19.974362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fc4bc-1a57-4855-a2fc-e43adc3edfe9 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:19.976281 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-509fc4bc-1a57-4855-a2fc-e43adc3edfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:20.013053 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-68394c81-da89-4bd0-8996-63dbfc0991ab None None] MFA Rules not processed for user `edf1b960a2eb4e5e9ada736b5f3f5810`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:20.014495 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-68394c81-da89-4bd0-8996-63dbfc0991ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:20.119614 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fc4bc-1a57-4855-a2fc-e43adc3edfe9 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:20.135124 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d207116-c8bb-426c-aa19-a9b2c80278dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:20.137198 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d207116-c8bb-426c-aa19-a9b2c80278dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:20.145776 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d207116-c8bb-426c-aa19-a9b2c80278dd admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:20.146085 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d207116-c8bb-426c-aa19-a9b2c80278dd admin admin] PATH_INFO: `/v3/users/b5c9dc6172654ed393a63ce65519975a` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:20.151348 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d207116-c8bb-426c-aa19-a9b2c80278dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5c9dc6172654ed393a63ce65519975a)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:20.153376 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d207116-c8bb-426c-aa19-a9b2c80278dd admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:20.153561 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1272/2537] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Aug 24 04:52:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:52:20.178609 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68394c81-da89-4bd0-8996-63dbfc0991ab None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:20.180821 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-68394c81-da89-4bd0-8996-63dbfc0991ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:20.195752 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68394c81-da89-4bd0-8996-63dbfc0991ab None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:20.202622 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7472d8b-9bc5-4464-9642-613bd1e62c67 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf1b960a2eb4e5e9ada736b5f3f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:20.203348 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7472d8b-9bc5-4464-9642-613bd1e62c67 service placement] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:20.203704 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7472d8b-9bc5-4464-9642-613bd1e62c67 service placement] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:20.204323 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7472d8b-9bc5-4464-9642-613bd1e62c67 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:20.214779 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7472d8b-9bc5-4464-9642-613bd1e62c67 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:20.216983 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7472d8b-9bc5-4464-9642-613bd1e62c67 service placement] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:20.228126 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-7d207116-c8bb-426c-aa19-a9b2c80278dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5c9dc6172654ed393a63ce65519975a'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:20.229013 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-7d207116-c8bb-426c-aa19-a9b2c80278dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5c9dc6172654ed393a63ce65519975a'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:20.229771 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-7d207116-c8bb-426c-aa19-a9b2c80278dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5c9dc6172654ed393a63ce65519975a'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:20.242038 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1273/2538] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:52:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:52:20.244045 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23d6ab-8e30-4d31-92f8-6882985a8173 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:20.244659 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23d6ab-8e30-4d31-92f8-6882985a8173 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:20.245312 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23d6ab-8e30-4d31-92f8-6882985a8173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:20.293046 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-7d207116-c8bb-426c-aa19-a9b2c80278dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5c9dc6172654ed393a63ce65519975a'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:20.301313 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-1f23d6ab-8e30-4d31-92f8-6882985a8173 None None] MFA Rules not processed for user `b703c69cfd0c426f814b44c9152c3563`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:20.302676 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-1f23d6ab-8e30-4d31-92f8-6882985a8173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:20.304447 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-7d207116-c8bb-426c-aa19-a9b2c80278dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5c9dc6172654ed393a63ce65519975a'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:20.323555 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1266/2539] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:52:19 2022] DELETE /identity/v3/users/b5c9dc6172654ed393a63ce65519975a => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:52:20.425785 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1274/2540] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:52:20 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:20.427596 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d207116-c8bb-426c-aa19-a9b2c80278dd admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:20.430194 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-7d207116-c8bb-426c-aa19-a9b2c80278dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:20.531979 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d207116-c8bb-426c-aa19-a9b2c80278dd admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:20.536288 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66abc83b-d25b-4d12-b35b-0aedd095550e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be44ea93247420d994e24912a9ac32e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:20.536921 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abc83b-d25b-4d12-b35b-0aedd095550e service glance] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:20.537203 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abc83b-d25b-4d12-b35b-0aedd095550e service glance] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:20.537512 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abc83b-d25b-4d12-b35b-0aedd095550e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:20.539598 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-66abc83b-d25b-4d12-b35b-0aedd095550e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:20.563942 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:20.608209 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f23d6ab-8e30-4d31-92f8-6882985a8173 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:20.609947 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-1f23d6ab-8e30-4d31-92f8-6882985a8173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:20.640564 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f23d6ab-8e30-4d31-92f8-6882985a8173 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:20.677203 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66abc83b-d25b-4d12-b35b-0aedd095550e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:20.679328 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66abc83b-d25b-4d12-b35b-0aedd095550e service glance] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:20.709736 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1267/2541] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:52:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:52:20.717537 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:20.744804 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f46ea-f2f3-41e3-b532-6d41b13e7316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:20.745505 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f46ea-f2f3-41e3-b532-6d41b13e7316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:20.747202 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f46ea-f2f3-41e3-b532-6d41b13e7316 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:20.747498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f46ea-f2f3-41e3-b532-6d41b13e7316 admin admin] PATH_INFO: `/v3/projects/e08891a3d0534bb791a5c4d492b1598a` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:20.748772 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f46ea-f2f3-41e3-b532-6d41b13e7316 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e08891a3d0534bb791a5c4d492b1598a)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:20.750753 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f46ea-f2f3-41e3-b532-6d41b13e7316 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:20.852496 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-840f46ea-f2f3-41e3-b532-6d41b13e7316 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e08891a3d0534bb791a5c4d492b1598a', 'request_id': 'req-840f46ea-f2f3-41e3-b532-6d41b13e7316'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:20.861460 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-840f46ea-f2f3-41e3-b532-6d41b13e7316 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e08891a3d0534bb791a5c4d492b1598a', 'request_id': 'req-840f46ea-f2f3-41e3-b532-6d41b13e7316'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:20.874130 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-840f46ea-f2f3-41e3-b532-6d41b13e7316 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e08891a3d0534bb791a5c4d492b1598a', 'request_id': 'req-840f46ea-f2f3-41e3-b532-6d41b13e7316'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:20.888881 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-840f46ea-f2f3-41e3-b532-6d41b13e7316 admin admin] The token cache is being invalidate because project e08891a3d0534bb791a5c4d492b1598a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:52:20.889182 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-840f46ea-f2f3-41e3-b532-6d41b13e7316 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:20.889957 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-840f46ea-f2f3-41e3-b532-6d41b13e7316 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:20.891810 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1275/2542] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:52:20 2022] DELETE /identity/v3/projects/e08891a3d0534bb791a5c4d492b1598a => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:52:20.899580 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49589d7-4ca3-4ca8-a97e-5300ea6bc8ef None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:20.900503 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49589d7-4ca3-4ca8-a97e-5300ea6bc8ef None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:20.901032 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49589d7-4ca3-4ca8-a97e-5300ea6bc8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:20.915232 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cca79-7b0e-40f5-9b21-0ef01f21c864 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:20.915518 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cca79-7b0e-40f5-9b21-0ef01f21c864 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:20.915920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886cca79-7b0e-40f5-9b21-0ef01f21c864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:20.937374 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-b49589d7-4ca3-4ca8-a97e-5300ea6bc8ef None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:20.939437 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-b49589d7-4ca3-4ca8-a97e-5300ea6bc8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:20.940771 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-886cca79-7b0e-40f5-9b21-0ef01f21c864 None None] MFA Rules not processed for user `c737c4586910476eafead0dfd4d9bc4c`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:20.944298 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-886cca79-7b0e-40f5-9b21-0ef01f21c864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:21.023026 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1276/2543] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 24 04:52:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:21.026378 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1268/2544] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:52:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:21.034741 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace48a36-31f8-473e-bcd1-754784d80d74 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:21.035176 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace48a36-31f8-473e-bcd1-754784d80d74 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:21.035458 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace48a36-31f8-473e-bcd1-754784d80d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:21.040089 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49589d7-4ca3-4ca8-a97e-5300ea6bc8ef None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:21.041589 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-b49589d7-4ca3-4ca8-a97e-5300ea6bc8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:21.068650 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-ace48a36-31f8-473e-bcd1-754784d80d74 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:21.070627 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-ace48a36-31f8-473e-bcd1-754784d80d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:21.084313 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1277/2545] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:52:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:52:21.085645 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace48a36-31f8-473e-bcd1-754784d80d74 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:21.095755 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace48a36-31f8-473e-bcd1-754784d80d74 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:21.102570 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3112044-5f35-4f0f-b6a2-517d4d5a0d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:21.103357 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3112044-5f35-4f0f-b6a2-517d4d5a0d5a admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:21.103736 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3112044-5f35-4f0f-b6a2-517d4d5a0d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:21.104074 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3112044-5f35-4f0f-b6a2-517d4d5a0d5a admin admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:21.104816 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3112044-5f35-4f0f-b6a2-517d4d5a0d5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:52:21.105281 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3112044-5f35-4f0f-b6a2-517d4d5a0d5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:21.106925 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3112044-5f35-4f0f-b6a2-517d4d5a0d5a admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:21.122215 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1278/2546] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:52:21.127437 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3112044-5f35-4f0f-b6a2-517d4d5a0d5a admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:21.131362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49589d7-4ca3-4ca8-a97e-5300ea6bc8ef None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:21.139783 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb783d-0702-499e-baaf-2fe97e07cfb0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ebb5105220438693118d734c9fda70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:21.140417 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb783d-0702-499e-baaf-2fe97e07cfb0 service swift] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:21.140700 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb783d-0702-499e-baaf-2fe97e07cfb0 service swift] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:21.140932 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3112044-5f35-4f0f-b6a2-517d4d5a0d5a admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:21.141047 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb783d-0702-499e-baaf-2fe97e07cfb0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:21.146796 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e840e3-00c9-4f03-8eb2-4f1fe2474710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:21.147654 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e840e3-00c9-4f03-8eb2-4f1fe2474710 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:21.148125 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e840e3-00c9-4f03-8eb2-4f1fe2474710 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:21.148492 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e840e3-00c9-4f03-8eb2-4f1fe2474710 admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:21.149248 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e840e3-00c9-4f03-8eb2-4f1fe2474710 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:21.151332 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb783d-0702-499e-baaf-2fe97e07cfb0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:21.153076 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e840e3-00c9-4f03-8eb2-4f1fe2474710 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:21.153303 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb783d-0702-499e-baaf-2fe97e07cfb0 service swift] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:21.163857 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1269/2547] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 24 04:52:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 04:52:21.247472 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1279/2548] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:52:21 2022] POST /identity/v3/projects => generated 363 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:52:21.251553 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb783d-0702-499e-baaf-2fe97e07cfb0 service swift] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:21.266374 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb783d-0702-499e-baaf-2fe97e07cfb0 service swift] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:21.354064 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:21.370755 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229651a-fda5-4ad9-ba99-f980df1cdadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:21.371486 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229651a-fda5-4ad9-ba99-f980df1cdadc admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:21.371836 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229651a-fda5-4ad9-ba99-f980df1cdadc admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:21.372183 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229651a-fda5-4ad9-ba99-f980df1cdadc admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:21.372913 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d229651a-fda5-4ad9-ba99-f980df1cdadc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:21.374963 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d229651a-fda5-4ad9-ba99-f980df1cdadc admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:21.413469 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1270/2549] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:52:21 2022] POST /identity/v3/users => generated 282 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:52:21.415083 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e840e3-00c9-4f03-8eb2-4f1fe2474710 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:21.437153 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e840e3-00c9-4f03-8eb2-4f1fe2474710 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:21.444977 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ea807-2b76-47e7-aa5c-f25eb1d02699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:21.445839 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ea807-2b76-47e7-aa5c-f25eb1d02699 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:21.446337 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ea807-2b76-47e7-aa5c-f25eb1d02699 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:21.446753 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ea807-2b76-47e7-aa5c-f25eb1d02699 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:21.447788 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ea807-2b76-47e7-aa5c-f25eb1d02699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:21.452049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3ea807-2b76-47e7-aa5c-f25eb1d02699 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:21.490580 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1280/2550] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:52:21.490802 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229651a-fda5-4ad9-ba99-f980df1cdadc admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:21.507310 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229651a-fda5-4ad9-ba99-f980df1cdadc admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:21.520981 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169d497-51d2-4dfb-9657-1e2f8d227647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:21.521649 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169d497-51d2-4dfb-9657-1e2f8d227647 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:21.521929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169d497-51d2-4dfb-9657-1e2f8d227647 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:21.522591 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169d497-51d2-4dfb-9657-1e2f8d227647 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:21.522853 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169d497-51d2-4dfb-9657-1e2f8d227647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:21.524485 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169d497-51d2-4dfb-9657-1e2f8d227647 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:21.536424 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1271/2551] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:52:21.540748 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ea807-2b76-47e7-aa5c-f25eb1d02699 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:21.554186 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ea807-2b76-47e7-aa5c-f25eb1d02699 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:21.560111 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fd66c-9d46-48a0-8522-779833063bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:21.561146 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fd66c-9d46-48a0-8522-779833063bc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:21.561699 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fd66c-9d46-48a0-8522-779833063bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:21.562181 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75fd66c-9d46-48a0-8522-779833063bc0 admin admin] PATH_INFO: `/v3/projects/c9b6b857c0d34bad8896293c752e5516/users/121bd952186f44a7add864b5cf88013e/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:21.588593 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75fd66c-9d46-48a0-8522-779833063bc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9b6b857c0d34bad8896293c752e5516, user_id=121bd952186f44a7add864b5cf88013e, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:21.591988 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75fd66c-9d46-48a0-8522-779833063bc0 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:21.613623 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1281/2552] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:52:21 2022] PUT /identity/v3/projects/c9b6b857c0d34bad8896293c752e5516/users/121bd952186f44a7add864b5cf88013e/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:52:21.686556 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01285393-e723-4641-ba18-3294e42dff92 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:21.686850 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01285393-e723-4641-ba18-3294e42dff92 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:21.687108 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01285393-e723-4641-ba18-3294e42dff92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:21.724588 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-01285393-e723-4641-ba18-3294e42dff92 None None] MFA Rules not processed for user `121bd952186f44a7add864b5cf88013e`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:21.725981 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-01285393-e723-4641-ba18-3294e42dff92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:21.849204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1272/2553] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:52:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:21.866034 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fd66c-9d46-48a0-8522-779833063bc0 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:21.872569 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-b75fd66c-9d46-48a0-8522-779833063bc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:21.888173 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:21.953922 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75fd66c-9d46-48a0-8522-779833063bc0 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:21.958152 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12d2b3-a3a7-497f-9ae5-ecc79400e8c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:21.958773 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12d2b3-a3a7-497f-9ae5-ecc79400e8c2 service cinder] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:21.959043 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12d2b3-a3a7-497f-9ae5-ecc79400e8c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:21.959315 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12d2b3-a3a7-497f-9ae5-ecc79400e8c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:21.969387 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e12d2b3-a3a7-497f-9ae5-ecc79400e8c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:21.970582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e12d2b3-a3a7-497f-9ae5-ecc79400e8c2 service cinder] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:21.981304 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1282/2554] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:52:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:52:31.377124 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2bf4e-e63c-43af-9a18-4e2e1a3139c3 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:31.378281 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2bf4e-e63c-43af-9a18-4e2e1a3139c3 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:31.378724 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2bf4e-e63c-43af-9a18-4e2e1a3139c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:31.404281 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-ddf2bf4e-e63c-43af-9a18-4e2e1a3139c3 None None] MFA Rules not processed for user `29b8b1421c674580bac351e65a4cc0ee`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:31.406034 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-ddf2bf4e-e63c-43af-9a18-4e2e1a3139c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:31.493973 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1273/2555] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:52:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:31.976248 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=23 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:35.149128 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50dbf6-11b2-423c-9169-a28153f1a802 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:35.149772 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50dbf6-11b2-423c-9169-a28153f1a802 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:35.149772 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50dbf6-11b2-423c-9169-a28153f1a802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:35.177468 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-3b50dbf6-11b2-423c-9169-a28153f1a802 None None] MFA Rules not processed for user `c737c4586910476eafead0dfd4d9bc4c`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:35.179852 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-3b50dbf6-11b2-423c-9169-a28153f1a802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:35.251119 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1283/2556] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 24 04:52:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:35.259312 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2bf4e-e63c-43af-9a18-4e2e1a3139c3 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:35.399920 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2bf4e-e63c-43af-9a18-4e2e1a3139c3 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:35.410274 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62bbf86-77bd-4366-892d-610d2b89cd86 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ebb5105220438693118d734c9fda70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:35.410913 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bbf86-77bd-4366-892d-610d2b89cd86 service swift] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:35.411212 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bbf86-77bd-4366-892d-610d2b89cd86 service swift] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:35.411458 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bbf86-77bd-4366-892d-610d2b89cd86 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:35.422708 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:35.432557 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62bbf86-77bd-4366-892d-610d2b89cd86 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:35.435510 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62bbf86-77bd-4366-892d-610d2b89cd86 service swift] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:35.452144 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1274/2557] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 24 04:52:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:52:45.236453 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=25 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:45.443665 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=3 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:48.864023 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50dbf6-11b2-423c-9169-a28153f1a802 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:48.865636 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-3b50dbf6-11b2-423c-9169-a28153f1a802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:48.924589 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50dbf6-11b2-423c-9169-a28153f1a802 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:48.928693 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ee3bc2-692b-4863-9fe6-d02dd9bcaf1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:48.929297 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee3bc2-692b-4863-9fe6-d02dd9bcaf1d service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:48.929601 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee3bc2-692b-4863-9fe6-d02dd9bcaf1d service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:48.929870 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ee3bc2-692b-4863-9fe6-d02dd9bcaf1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:48.931752 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-61ee3bc2-692b-4863-9fe6-d02dd9bcaf1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:48.998501 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ee3bc2-692b-4863-9fe6-d02dd9bcaf1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:48.999874 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ee3bc2-692b-4863-9fe6-d02dd9bcaf1d service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:49.009486 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1284/2558] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:52:48 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:52:55.714385 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62bbf86-77bd-4366-892d-610d2b89cd86 service swift] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:55.800976 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62bbf86-77bd-4366-892d-610d2b89cd86 service swift] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:55.806000 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f189c0b-20aa-42c5-a90a-8b1b8bc1f161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:55.808065 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f189c0b-20aa-42c5-a90a-8b1b8bc1f161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:55.808065 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f189c0b-20aa-42c5-a90a-8b1b8bc1f161 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:55.808065 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f189c0b-20aa-42c5-a90a-8b1b8bc1f161 admin admin] PATH_INFO: `/v3/users/121bd952186f44a7add864b5cf88013e` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:55.811124 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f189c0b-20aa-42c5-a90a-8b1b8bc1f161 admin admin] RBAC: Authorizing `identity:delete_user(user_id=121bd952186f44a7add864b5cf88013e)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:55.813674 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f189c0b-20aa-42c5-a90a-8b1b8bc1f161 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:55.879482 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-6f189c0b-20aa-42c5-a90a-8b1b8bc1f161 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '121bd952186f44a7add864b5cf88013e'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:55.880183 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-6f189c0b-20aa-42c5-a90a-8b1b8bc1f161 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '121bd952186f44a7add864b5cf88013e'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:55.880837 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-6f189c0b-20aa-42c5-a90a-8b1b8bc1f161 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '121bd952186f44a7add864b5cf88013e'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:55.910908 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-6f189c0b-20aa-42c5-a90a-8b1b8bc1f161 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '121bd952186f44a7add864b5cf88013e'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:55.924773 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-6f189c0b-20aa-42c5-a90a-8b1b8bc1f161 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '121bd952186f44a7add864b5cf88013e'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:55.938390 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1275/2559] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:52:55 2022] DELETE /identity/v3/users/121bd952186f44a7add864b5cf88013e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:52:55.943023 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766aed7-1342-4014-b23a-7053a9730320 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:55.943495 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766aed7-1342-4014-b23a-7053a9730320 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:55.943617 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766aed7-1342-4014-b23a-7053a9730320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:55.964063 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-f766aed7-1342-4014-b23a-7053a9730320 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:55.965282 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-f766aed7-1342-4014-b23a-7053a9730320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:56.032238 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1285/2560] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:52:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:56.042259 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f189c0b-20aa-42c5-a90a-8b1b8bc1f161 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:56.043985 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-6f189c0b-20aa-42c5-a90a-8b1b8bc1f161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:56.133136 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f189c0b-20aa-42c5-a90a-8b1b8bc1f161 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:56.136898 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231cc65-4d06-4e1b-b4ad-a0356553ac06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:56.137590 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231cc65-4d06-4e1b-b4ad-a0356553ac06 service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:56.137824 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231cc65-4d06-4e1b-b4ad-a0356553ac06 service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:56.138086 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231cc65-4d06-4e1b-b4ad-a0356553ac06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:56.149104 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231cc65-4d06-4e1b-b4ad-a0356553ac06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:56.150899 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231cc65-4d06-4e1b-b4ad-a0356553ac06 service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:56.167301 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1276/2561] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:52:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:52:56.478164 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766aed7-1342-4014-b23a-7053a9730320 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:56.479666 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-f766aed7-1342-4014-b23a-7053a9730320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:56.495476 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766aed7-1342-4014-b23a-7053a9730320 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:56.500651 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd6fb2-3b36-4966-8bce-fa37b252faa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:56.501267 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd6fb2-3b36-4966-8bce-fa37b252faa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:56.501578 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd6fb2-3b36-4966-8bce-fa37b252faa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:56.501854 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd6fb2-3b36-4966-8bce-fa37b252faa4 admin admin] PATH_INFO: `/v3/projects/c9b6b857c0d34bad8896293c752e5516` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:56.503107 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd6fb2-3b36-4966-8bce-fa37b252faa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9b6b857c0d34bad8896293c752e5516)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:56.505056 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd6fb2-3b36-4966-8bce-fa37b252faa4 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:56.556988 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:56.560176 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-cbcd6fb2-3b36-4966-8bce-fa37b252faa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9b6b857c0d34bad8896293c752e5516', 'request_id': 'req-cbcd6fb2-3b36-4966-8bce-fa37b252faa4'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:56.568551 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-cbcd6fb2-3b36-4966-8bce-fa37b252faa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9b6b857c0d34bad8896293c752e5516', 'request_id': 'req-cbcd6fb2-3b36-4966-8bce-fa37b252faa4'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:56.577499 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-cbcd6fb2-3b36-4966-8bce-fa37b252faa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9b6b857c0d34bad8896293c752e5516', 'request_id': 'req-cbcd6fb2-3b36-4966-8bce-fa37b252faa4'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:56.589880 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-cbcd6fb2-3b36-4966-8bce-fa37b252faa4 admin admin] The token cache is being invalidate because project c9b6b857c0d34bad8896293c752e5516 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:52:56.590170 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-cbcd6fb2-3b36-4966-8bce-fa37b252faa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:56.590811 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-cbcd6fb2-3b36-4966-8bce-fa37b252faa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:52:56.592593 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1286/2562] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:52:56 2022] DELETE /identity/v3/projects/c9b6b857c0d34bad8896293c752e5516 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:53:01.104672 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231cc65-4d06-4e1b-b4ad-a0356553ac06 service neutron] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:01.114628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231cc65-4d06-4e1b-b4ad-a0356553ac06 service neutron] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:01.137589 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:01.173908 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e64c16-ed67-4e37-a075-29774a835a6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:01.174517 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e64c16-ed67-4e37-a075-29774a835a6f service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:01.174788 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e64c16-ed67-4e37-a075-29774a835a6f service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:01.175056 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e64c16-ed67-4e37-a075-29774a835a6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:01.177377 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-b3e64c16-ed67-4e37-a075-29774a835a6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:01.249289 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e64c16-ed67-4e37-a075-29774a835a6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:01.250776 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e64c16-ed67-4e37-a075-29774a835a6f service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:01.260657 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1277/2563] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:53:01 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:53:06.586870 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:11.256544 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=40 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:16.428676 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc13c9c-2320-4c8a-ba6e-aac71b25e043 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:16.429195 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc13c9c-2320-4c8a-ba6e-aac71b25e043 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:16.429195 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc13c9c-2320-4c8a-ba6e-aac71b25e043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:16.449832 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-fdc13c9c-2320-4c8a-ba6e-aac71b25e043 None None] MFA Rules not processed for user `12af555605384136af2082486782b584`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:16.451050 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-fdc13c9c-2320-4c8a-ba6e-aac71b25e043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:16.512454 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1287/2564] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:53:16 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:26.504606 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=25 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:29.975134 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e64c16-ed67-4e37-a075-29774a835a6f service neutron] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:29.976816 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-b3e64c16-ed67-4e37-a075-29774a835a6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:30.051492 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e64c16-ed67-4e37-a075-29774a835a6f service neutron] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:30.056931 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9798f-a52f-4cbd-9696-7160bcd08eee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf1b960a2eb4e5e9ada736b5f3f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:30.057558 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9798f-a52f-4cbd-9696-7160bcd08eee service placement] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:30.057829 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9798f-a52f-4cbd-9696-7160bcd08eee service placement] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:30.058094 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9798f-a52f-4cbd-9696-7160bcd08eee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:30.059886 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-22f9798f-a52f-4cbd-9696-7160bcd08eee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:30.071923 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9798f-a52f-4cbd-9696-7160bcd08eee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:30.073620 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9798f-a52f-4cbd-9696-7160bcd08eee service placement] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:30.084710 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1278/2565] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:53:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:53:40.079965 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=32 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:41.572528 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9abd1f-282b-459f-8279-46ebaa3f7eb7 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:41.573062 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9abd1f-282b-459f-8279-46ebaa3f7eb7 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:41.573168 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9abd1f-282b-459f-8279-46ebaa3f7eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:41.593325 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-5b9abd1f-282b-459f-8279-46ebaa3f7eb7 None None] MFA Rules not processed for user `d6811ba6d5fc41c499fdbe5f93dceb0d`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:41.594570 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-5b9abd1f-282b-459f-8279-46ebaa3f7eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:41.651513 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1288/2566] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:53:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:51.643736 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=25 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:23.930388 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9798f-a52f-4cbd-9696-7160bcd08eee service placement] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:23.931932 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-22f9798f-a52f-4cbd-9696-7160bcd08eee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:24.001998 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9798f-a52f-4cbd-9696-7160bcd08eee service placement] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:24.006645 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59fc071-44bf-44a3-a772-cd284a24468c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:24.007272 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fc071-44bf-44a3-a772-cd284a24468c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:24.007548 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fc071-44bf-44a3-a772-cd284a24468c admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:24.007819 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fc071-44bf-44a3-a772-cd284a24468c admin admin] PATH_INFO: `/v3/users/12af555605384136af2082486782b584` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:24.008956 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59fc071-44bf-44a3-a772-cd284a24468c admin admin] RBAC: Authorizing `identity:delete_user(user_id=12af555605384136af2082486782b584)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:24.010942 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59fc071-44bf-44a3-a772-cd284a24468c admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:24.058892 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-c59fc071-44bf-44a3-a772-cd284a24468c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12af555605384136af2082486782b584'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:24.059474 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-c59fc071-44bf-44a3-a772-cd284a24468c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12af555605384136af2082486782b584'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:24.060081 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-c59fc071-44bf-44a3-a772-cd284a24468c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12af555605384136af2082486782b584'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:24.074113 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-c59fc071-44bf-44a3-a772-cd284a24468c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12af555605384136af2082486782b584'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:24.083530 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-c59fc071-44bf-44a3-a772-cd284a24468c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12af555605384136af2082486782b584'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:24.101741 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1279/2567] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:23 2022] DELETE /identity/v3/users/12af555605384136af2082486782b584 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:24.283744 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9abd1f-282b-459f-8279-46ebaa3f7eb7 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:24.295216 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9abd1f-282b-459f-8279-46ebaa3f7eb7 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:24.360148 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e26f8a-1d94-4fa6-9976-e2e712e18e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:24.360781 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e26f8a-1d94-4fa6-9976-e2e712e18e8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:24.361059 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e26f8a-1d94-4fa6-9976-e2e712e18e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:24.361354 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e26f8a-1d94-4fa6-9976-e2e712e18e8f admin admin] PATH_INFO: `/v3/projects/07419bc87e5148899a0ef56c66f7c46e` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:24.362550 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e26f8a-1d94-4fa6-9976-e2e712e18e8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=07419bc87e5148899a0ef56c66f7c46e)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:24.364472 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e26f8a-1d94-4fa6-9976-e2e712e18e8f admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:24.414458 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-47e26f8a-1d94-4fa6-9976-e2e712e18e8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07419bc87e5148899a0ef56c66f7c46e', 'request_id': 'req-47e26f8a-1d94-4fa6-9976-e2e712e18e8f'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:24.420655 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-47e26f8a-1d94-4fa6-9976-e2e712e18e8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07419bc87e5148899a0ef56c66f7c46e', 'request_id': 'req-47e26f8a-1d94-4fa6-9976-e2e712e18e8f'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:24.430153 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-47e26f8a-1d94-4fa6-9976-e2e712e18e8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07419bc87e5148899a0ef56c66f7c46e', 'request_id': 'req-47e26f8a-1d94-4fa6-9976-e2e712e18e8f'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:24.441088 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-47e26f8a-1d94-4fa6-9976-e2e712e18e8f admin admin] The token cache is being invalidate because project 07419bc87e5148899a0ef56c66f7c46e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:24.441405 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-47e26f8a-1d94-4fa6-9976-e2e712e18e8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:24.442068 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-47e26f8a-1d94-4fa6-9976-e2e712e18e8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:24.443574 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1289/2568] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:24 2022] DELETE /identity/v3/projects/07419bc87e5148899a0ef56c66f7c46e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:24.449618 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b5d0e-cd73-400a-928c-f5b3f8d27d11 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:24.449877 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b5d0e-cd73-400a-928c-f5b3f8d27d11 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:24.450178 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b5d0e-cd73-400a-928c-f5b3f8d27d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:24.475265 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-027b5d0e-cd73-400a-928c-f5b3f8d27d11 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:24.476552 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-027b5d0e-cd73-400a-928c-f5b3f8d27d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:24.542468 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1280/2569] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:24.550182 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd098367-adf1-4867-a972-419af8557c23 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:24.550541 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd098367-adf1-4867-a972-419af8557c23 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:24.550909 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd098367-adf1-4867-a972-419af8557c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:24.573697 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-dd098367-adf1-4867-a972-419af8557c23 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:24.575134 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-dd098367-adf1-4867-a972-419af8557c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:24.586292 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1290/2570] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:54:24.590245 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b5d0e-cd73-400a-928c-f5b3f8d27d11 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:24.600667 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b5d0e-cd73-400a-928c-f5b3f8d27d11 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:24.606019 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901ca01-d66e-418b-9f46-9760443ac81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:24.606634 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901ca01-d66e-418b-9f46-9760443ac81f admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:24.606927 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901ca01-d66e-418b-9f46-9760443ac81f admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:24.607179 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901ca01-d66e-418b-9f46-9760443ac81f admin admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:24.607829 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5901ca01-d66e-418b-9f46-9760443ac81f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:54:24.608127 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5901ca01-d66e-418b-9f46-9760443ac81f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:24.609781 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5901ca01-d66e-418b-9f46-9760443ac81f admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:24.622060 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1281/2571] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:54:24.626540 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd098367-adf1-4867-a972-419af8557c23 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:24.636585 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd098367-adf1-4867-a972-419af8557c23 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:24.642485 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4f4ce-e432-4fec-add0-433ed9d562ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:24.643038 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4f4ce-e432-4fec-add0-433ed9d562ad admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:24.643343 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4f4ce-e432-4fec-add0-433ed9d562ad admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:24.643608 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4f4ce-e432-4fec-add0-433ed9d562ad admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:24.644231 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4f4ce-e432-4fec-add0-433ed9d562ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:24.646314 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4f4ce-e432-4fec-add0-433ed9d562ad admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:24.676450 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1291/2572] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:54:24 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:24.680744 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901ca01-d66e-418b-9f46-9760443ac81f admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:24.691000 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901ca01-d66e-418b-9f46-9760443ac81f admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:24.695300 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:24.753612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d5cfb-c2b6-4bfc-b911-d8318181a3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:24.754363 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d5cfb-c2b6-4bfc-b911-d8318181a3ff admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:24.754642 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d5cfb-c2b6-4bfc-b911-d8318181a3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:24.754913 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d5cfb-c2b6-4bfc-b911-d8318181a3ff admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:24.755543 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d5cfb-c2b6-4bfc-b911-d8318181a3ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:24.757540 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d5cfb-c2b6-4bfc-b911-d8318181a3ff admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:24.780297 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1282/2573] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:54:24 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:54:24.784624 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4f4ce-e432-4fec-add0-433ed9d562ad admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:24.795333 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4f4ce-e432-4fec-add0-433ed9d562ad admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:24.801058 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5295a-f500-4454-a5a2-37889c20c1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:24.801689 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5295a-f500-4454-a5a2-37889c20c1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:24.801972 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5295a-f500-4454-a5a2-37889c20c1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:24.802269 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5295a-f500-4454-a5a2-37889c20c1f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:24.802976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f5295a-f500-4454-a5a2-37889c20c1f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:24.805386 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f5295a-f500-4454-a5a2-37889c20c1f5 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:24.816271 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1292/2574] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:24.821012 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d5cfb-c2b6-4bfc-b911-d8318181a3ff admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:24.831557 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d5cfb-c2b6-4bfc-b911-d8318181a3ff admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:24.837019 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0747df6-a8dc-4206-8d01-0ee42ff75993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:24.837658 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0747df6-a8dc-4206-8d01-0ee42ff75993 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:24.837934 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0747df6-a8dc-4206-8d01-0ee42ff75993 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:24.838203 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0747df6-a8dc-4206-8d01-0ee42ff75993 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:24.838829 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0747df6-a8dc-4206-8d01-0ee42ff75993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:24.840430 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0747df6-a8dc-4206-8d01-0ee42ff75993 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:24.851737 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1283/2575] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:24.856095 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5295a-f500-4454-a5a2-37889c20c1f5 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:24.866806 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5295a-f500-4454-a5a2-37889c20c1f5 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:24.872033 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438c012-3fbc-46ef-9032-3a52172ac984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:24.872669 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438c012-3fbc-46ef-9032-3a52172ac984 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:24.872952 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438c012-3fbc-46ef-9032-3a52172ac984 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:24.873220 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438c012-3fbc-46ef-9032-3a52172ac984 admin admin] PATH_INFO: `/v3/projects/3945040b058b41ab8c08d5e861d277fd/users/859775d2666a49feb933b86261391684/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:24.888093 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9438c012-3fbc-46ef-9032-3a52172ac984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3945040b058b41ab8c08d5e861d277fd, user_id=859775d2666a49feb933b86261391684, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:24.890844 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9438c012-3fbc-46ef-9032-3a52172ac984 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:24.905627 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1293/2576] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:24 2022] PUT /identity/v3/projects/3945040b058b41ab8c08d5e861d277fd/users/859775d2666a49feb933b86261391684/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:24.910851 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f681d-df5e-4df8-a4d8-29e35b68b8d6 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:24.911128 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f681d-df5e-4df8-a4d8-29e35b68b8d6 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:24.911397 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f681d-df5e-4df8-a4d8-29e35b68b8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:24.930540 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-8a2f681d-df5e-4df8-a4d8-29e35b68b8d6 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:24.931803 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-8a2f681d-df5e-4df8-a4d8-29e35b68b8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:24.997611 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1284/2577] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:25.008160 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438c012-3fbc-46ef-9032-3a52172ac984 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:25.010599 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-9438c012-3fbc-46ef-9032-3a52172ac984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:25.049959 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:25.085208 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9438c012-3fbc-46ef-9032-3a52172ac984 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:25.091878 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8b152-134d-4ec8-8aee-3e51e54ff8ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:25.092478 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8b152-134d-4ec8-8aee-3e51e54ff8ef service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:25.092853 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8b152-134d-4ec8-8aee-3e51e54ff8ef service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:25.093252 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8b152-134d-4ec8-8aee-3e51e54ff8ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:25.106133 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe8b152-134d-4ec8-8aee-3e51e54ff8ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:25.107613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe8b152-134d-4ec8-8aee-3e51e54ff8ef service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:25.117164 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1294/2578] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:28.976179 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470c298-f59c-4465-8d89-dfcdca24a053 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:28.976745 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470c298-f59c-4465-8d89-dfcdca24a053 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:28.976745 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470c298-f59c-4465-8d89-dfcdca24a053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:29.007610 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-4470c298-f59c-4465-8d89-dfcdca24a053 None None] MFA Rules not processed for user `859775d2666a49feb933b86261391684`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:29.008208 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-4470c298-f59c-4465-8d89-dfcdca24a053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:29.096541 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1285/2579] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:54:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:29.113025 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8b152-134d-4ec8-8aee-3e51e54ff8ef service neutron] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:29.114720 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-6fe8b152-134d-4ec8-8aee-3e51e54ff8ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:29.203389 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8b152-134d-4ec8-8aee-3e51e54ff8ef service neutron] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:29.208882 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9fa4c-0bd4-421f-aa3d-6a8068db06e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:29.209582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9fa4c-0bd4-421f-aa3d-6a8068db06e7 service nova] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:29.209859 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9fa4c-0bd4-421f-aa3d-6a8068db06e7 service nova] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:29.210128 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9fa4c-0bd4-421f-aa3d-6a8068db06e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:29.219484 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c9fa4c-0bd4-421f-aa3d-6a8068db06e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:29.221012 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c9fa4c-0bd4-421f-aa3d-6a8068db06e7 service nova] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:29.231010 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1295/2580] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:29 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:30.557691 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72e471-3026-4be7-a70d-65b96fec5d7d None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:30.558230 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72e471-3026-4be7-a70d-65b96fec5d7d None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:30.558230 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72e471-3026-4be7-a70d-65b96fec5d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:30.578139 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-0b72e471-3026-4be7-a70d-65b96fec5d7d None None] MFA Rules not processed for user `859775d2666a49feb933b86261391684`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:30.579360 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-0b72e471-3026-4be7-a70d-65b96fec5d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:30.586647 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1286/2581] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:54:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:30.633430 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9fa4c-0bd4-421f-aa3d-6a8068db06e7 service nova] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:30.635146 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-01c9fa4c-0bd4-421f-aa3d-6a8068db06e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:30.700750 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9fa4c-0bd4-421f-aa3d-6a8068db06e7 service nova] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:30.704283 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505d8fe-4107-47b3-b0eb-5b25c037a214 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be44ea93247420d994e24912a9ac32e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:30.704888 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505d8fe-4107-47b3-b0eb-5b25c037a214 service glance] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:30.705160 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505d8fe-4107-47b3-b0eb-5b25c037a214 service glance] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:30.705995 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505d8fe-4107-47b3-b0eb-5b25c037a214 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:30.707817 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-4505d8fe-4107-47b3-b0eb-5b25c037a214 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:30.722513 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4505d8fe-4107-47b3-b0eb-5b25c037a214 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:30.723978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4505d8fe-4107-47b3-b0eb-5b25c037a214 service glance] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:30.735985 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1296/2582] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:31.370562 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72e471-3026-4be7-a70d-65b96fec5d7d None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:31.371988 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-0b72e471-3026-4be7-a70d-65b96fec5d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:31.385238 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72e471-3026-4be7-a70d-65b96fec5d7d None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:31.403478 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d4cf2-b65a-4a32-8730-1a9b9d727b05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:31.404128 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d4cf2-b65a-4a32-8730-1a9b9d727b05 service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:31.404403 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d4cf2-b65a-4a32-8730-1a9b9d727b05 service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:31.404885 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d4cf2-b65a-4a32-8730-1a9b9d727b05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:31.407964 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-a89d4cf2-b65a-4a32-8730-1a9b9d727b05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:31.422607 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:31.426397 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d4cf2-b65a-4a32-8730-1a9b9d727b05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:31.429136 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d4cf2-b65a-4a32-8730-1a9b9d727b05 service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:31.444871 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1287/2583] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:40.644013 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505d8fe-4107-47b3-b0eb-5b25c037a214 service glance] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:40.661469 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505d8fe-4107-47b3-b0eb-5b25c037a214 service glance] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:40.667758 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65b6be-162c-4561-9a07-05bdff012a59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:40.668472 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65b6be-162c-4561-9a07-05bdff012a59 service nova] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:40.668811 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65b6be-162c-4561-9a07-05bdff012a59 service nova] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:40.669143 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b65b6be-162c-4561-9a07-05bdff012a59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:40.673037 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-3b65b6be-162c-4561-9a07-05bdff012a59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:40.733792 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:40.736494 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65b6be-162c-4561-9a07-05bdff012a59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:40.738480 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b65b6be-162c-4561-9a07-05bdff012a59 service nova] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:40.749059 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1297/2584] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:41.438779 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=2 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:49.107709 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38574f5b-e8cd-434e-8483-fde8a142d6c7 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:49.108855 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38574f5b-e8cd-434e-8483-fde8a142d6c7 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:49.109195 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38574f5b-e8cd-434e-8483-fde8a142d6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:49.129303 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-38574f5b-e8cd-434e-8483-fde8a142d6c7 None None] MFA Rules not processed for user `c737c4586910476eafead0dfd4d9bc4c`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:49.130593 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-38574f5b-e8cd-434e-8483-fde8a142d6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:49.198547 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1288/2585] 10.222.0.49 () {58 vars in 967 bytes} [Wed Aug 24 04:54:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:49.241249 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65b6be-162c-4561-9a07-05bdff012a59 service nova] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:49.242806 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-3b65b6be-162c-4561-9a07-05bdff012a59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:49.317112 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b65b6be-162c-4561-9a07-05bdff012a59 service nova] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:49.322204 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae421b00-1c22-4de8-9adc-a2f764878462 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ebb5105220438693118d734c9fda70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:49.322810 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae421b00-1c22-4de8-9adc-a2f764878462 service swift] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:49.323111 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae421b00-1c22-4de8-9adc-a2f764878462 service swift] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:49.323389 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae421b00-1c22-4de8-9adc-a2f764878462 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:49.332537 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae421b00-1c22-4de8-9adc-a2f764878462 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:49.334317 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae421b00-1c22-4de8-9adc-a2f764878462 service swift] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:49.343061 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1298/2586] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 24 04:54:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:54:56.873673 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38574f5b-e8cd-434e-8483-fde8a142d6c7 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:56.875985 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-38574f5b-e8cd-434e-8483-fde8a142d6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:56.932681 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae421b00-1c22-4de8-9adc-a2f764878462 service swift] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:56.934293 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-ae421b00-1c22-4de8-9adc-a2f764878462 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:56.954437 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae421b00-1c22-4de8-9adc-a2f764878462 service swift] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:56.959504 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9519e29-b2f2-4993-babd-d4aea647f74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:56.960150 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9519e29-b2f2-4993-babd-d4aea647f74f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:56.960418 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9519e29-b2f2-4993-babd-d4aea647f74f admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:56.960699 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9519e29-b2f2-4993-babd-d4aea647f74f admin admin] PATH_INFO: `/v3/users/29b8b1421c674580bac351e65a4cc0ee` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:56.961889 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9519e29-b2f2-4993-babd-d4aea647f74f admin admin] RBAC: Authorizing `identity:delete_user(user_id=29b8b1421c674580bac351e65a4cc0ee)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:56.963807 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9519e29-b2f2-4993-babd-d4aea647f74f admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:56.967695 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38574f5b-e8cd-434e-8483-fde8a142d6c7 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:56.973082 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a298a-a3c7-41bc-b3eb-fa13dfe775b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf1b960a2eb4e5e9ada736b5f3f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:56.974226 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a298a-a3c7-41bc-b3eb-fa13dfe775b1 service placement] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:56.974386 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a298a-a3c7-41bc-b3eb-fa13dfe775b1 service placement] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:56.974662 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53a298a-a3c7-41bc-b3eb-fa13dfe775b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:56.976459 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-f53a298a-a3c7-41bc-b3eb-fa13dfe775b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:56.990585 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a298a-a3c7-41bc-b3eb-fa13dfe775b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:56.992358 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53a298a-a3c7-41bc-b3eb-fa13dfe775b1 service placement] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:57.007213 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1289/2587] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:57.031097 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-e9519e29-b2f2-4993-babd-d4aea647f74f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29b8b1421c674580bac351e65a4cc0ee'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:57.031862 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-e9519e29-b2f2-4993-babd-d4aea647f74f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29b8b1421c674580bac351e65a4cc0ee'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:57.033723 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-e9519e29-b2f2-4993-babd-d4aea647f74f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29b8b1421c674580bac351e65a4cc0ee'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:57.047877 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-e9519e29-b2f2-4993-babd-d4aea647f74f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29b8b1421c674580bac351e65a4cc0ee'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:57.056151 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-e9519e29-b2f2-4993-babd-d4aea647f74f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29b8b1421c674580bac351e65a4cc0ee'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:57.068756 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1299/2588] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:56 2022] DELETE /identity/v3/users/29b8b1421c674580bac351e65a4cc0ee => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:57.277823 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a298a-a3c7-41bc-b3eb-fa13dfe775b1 service placement] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:57.292001 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53a298a-a3c7-41bc-b3eb-fa13dfe775b1 service placement] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:57.383399 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a863d-4ac7-4655-93fe-b7b1f682f031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:57.384289 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a863d-4ac7-4655-93fe-b7b1f682f031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:57.384625 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a863d-4ac7-4655-93fe-b7b1f682f031 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:57.384962 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7a863d-4ac7-4655-93fe-b7b1f682f031 admin admin] PATH_INFO: `/v3/projects/95005d7baa974ef1a92b7b83dafcd15d` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:57.386455 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a863d-4ac7-4655-93fe-b7b1f682f031 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95005d7baa974ef1a92b7b83dafcd15d)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:57.388637 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7a863d-4ac7-4655-93fe-b7b1f682f031 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:57.437407 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:57.447717 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-8b7a863d-4ac7-4655-93fe-b7b1f682f031 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95005d7baa974ef1a92b7b83dafcd15d', 'request_id': 'req-8b7a863d-4ac7-4655-93fe-b7b1f682f031'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:57.455995 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-8b7a863d-4ac7-4655-93fe-b7b1f682f031 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95005d7baa974ef1a92b7b83dafcd15d', 'request_id': 'req-8b7a863d-4ac7-4655-93fe-b7b1f682f031'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:57.462303 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-8b7a863d-4ac7-4655-93fe-b7b1f682f031 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95005d7baa974ef1a92b7b83dafcd15d', 'request_id': 'req-8b7a863d-4ac7-4655-93fe-b7b1f682f031'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:57.472756 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-8b7a863d-4ac7-4655-93fe-b7b1f682f031 admin admin] The token cache is being invalidate because project 95005d7baa974ef1a92b7b83dafcd15d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:57.473048 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-8b7a863d-4ac7-4655-93fe-b7b1f682f031 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:57.474074 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-8b7a863d-4ac7-4655-93fe-b7b1f682f031 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:57.475644 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1290/2589] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:57 2022] DELETE /identity/v3/projects/95005d7baa974ef1a92b7b83dafcd15d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:57.479776 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9519e29-b2f2-4993-babd-d4aea647f74f admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:57.481452 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-e9519e29-b2f2-4993-babd-d4aea647f74f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:57.495190 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9519e29-b2f2-4993-babd-d4aea647f74f admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:57.547693 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:57.555101 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb6cac-1b72-456b-b26b-12eb722bfa79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:57.556224 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb6cac-1b72-456b-b26b-12eb722bfa79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:57.556560 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb6cac-1b72-456b-b26b-12eb722bfa79 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:57.557011 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb6cac-1b72-456b-b26b-12eb722bfa79 admin admin] PATH_INFO: `/v3/users/b703c69cfd0c426f814b44c9152c3563` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:57.558403 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb6cac-1b72-456b-b26b-12eb722bfa79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b703c69cfd0c426f814b44c9152c3563)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:57.560800 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb6cac-1b72-456b-b26b-12eb722bfa79 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:57.610157 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-adfb6cac-1b72-456b-b26b-12eb722bfa79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b703c69cfd0c426f814b44c9152c3563'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:57.610730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-adfb6cac-1b72-456b-b26b-12eb722bfa79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b703c69cfd0c426f814b44c9152c3563'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:57.611343 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-adfb6cac-1b72-456b-b26b-12eb722bfa79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b703c69cfd0c426f814b44c9152c3563'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:57.624341 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-adfb6cac-1b72-456b-b26b-12eb722bfa79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b703c69cfd0c426f814b44c9152c3563'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:57.632482 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-adfb6cac-1b72-456b-b26b-12eb722bfa79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b703c69cfd0c426f814b44c9152c3563'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:57.644611 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1300/2590] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:57 2022] DELETE /identity/v3/users/b703c69cfd0c426f814b44c9152c3563 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:54:57.837193 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a863d-4ac7-4655-93fe-b7b1f682f031 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:57.838888 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-8b7a863d-4ac7-4655-93fe-b7b1f682f031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:57.854404 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7a863d-4ac7-4655-93fe-b7b1f682f031 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:57.914854 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ea9d0-36d3-4ae0-8752-7fd6a32db354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:57.915536 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ea9d0-36d3-4ae0-8752-7fd6a32db354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:57.915767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ea9d0-36d3-4ae0-8752-7fd6a32db354 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:57.916041 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ea9d0-36d3-4ae0-8752-7fd6a32db354 admin admin] PATH_INFO: `/v3/projects/d9c8e23951df4756a00e0ede298a0370` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:57.917183 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ea9d0-36d3-4ae0-8752-7fd6a32db354 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9c8e23951df4756a00e0ede298a0370)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:57.919149 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ea9d0-36d3-4ae0-8752-7fd6a32db354 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:57.967796 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-b87ea9d0-36d3-4ae0-8752-7fd6a32db354 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9c8e23951df4756a00e0ede298a0370', 'request_id': 'req-b87ea9d0-36d3-4ae0-8752-7fd6a32db354'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:57.975177 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-b87ea9d0-36d3-4ae0-8752-7fd6a32db354 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9c8e23951df4756a00e0ede298a0370', 'request_id': 'req-b87ea9d0-36d3-4ae0-8752-7fd6a32db354'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:57.981903 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-b87ea9d0-36d3-4ae0-8752-7fd6a32db354 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9c8e23951df4756a00e0ede298a0370', 'request_id': 'req-b87ea9d0-36d3-4ae0-8752-7fd6a32db354'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:57.993054 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-b87ea9d0-36d3-4ae0-8752-7fd6a32db354 admin admin] The token cache is being invalidate because project d9c8e23951df4756a00e0ede298a0370 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:57.993362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-b87ea9d0-36d3-4ae0-8752-7fd6a32db354 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:57.994090 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-b87ea9d0-36d3-4ae0-8752-7fd6a32db354 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:57.995725 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1291/2591] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:57 2022] DELETE /identity/v3/projects/d9c8e23951df4756a00e0ede298a0370 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:58.510703 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb6cac-1b72-456b-b26b-12eb722bfa79 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:58.512561 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-adfb6cac-1b72-456b-b26b-12eb722bfa79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:58.572543 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb6cac-1b72-456b-b26b-12eb722bfa79 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:58.620968 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bda911-858b-4a6a-9732-125959493346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:58.621628 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bda911-858b-4a6a-9732-125959493346 service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:58.621911 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bda911-858b-4a6a-9732-125959493346 service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:58.622177 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bda911-858b-4a6a-9732-125959493346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:58.624001 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-44bda911-858b-4a6a-9732-125959493346 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:58.667957 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:58.691153 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bda911-858b-4a6a-9732-125959493346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:58.692609 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bda911-858b-4a6a-9732-125959493346 service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:58.703072 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1301/2592] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:01.948609 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ea9d0-36d3-4ae0-8752-7fd6a32db354 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:01.950155 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-b87ea9d0-36d3-4ae0-8752-7fd6a32db354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:01.963772 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ea9d0-36d3-4ae0-8752-7fd6a32db354 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:01.969271 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4540ccc-9bc2-4ba0-98d6-ed5a4471e643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:01.969950 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4540ccc-9bc2-4ba0-98d6-ed5a4471e643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:01.970229 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4540ccc-9bc2-4ba0-98d6-ed5a4471e643 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:01.970502 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4540ccc-9bc2-4ba0-98d6-ed5a4471e643 admin admin] PATH_INFO: `/v3/users/d6811ba6d5fc41c499fdbe5f93dceb0d` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:01.971626 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4540ccc-9bc2-4ba0-98d6-ed5a4471e643 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6811ba6d5fc41c499fdbe5f93dceb0d)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:01.973981 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4540ccc-9bc2-4ba0-98d6-ed5a4471e643 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:02.037053 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-c4540ccc-9bc2-4ba0-98d6-ed5a4471e643 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6811ba6d5fc41c499fdbe5f93dceb0d'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:02.037648 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-c4540ccc-9bc2-4ba0-98d6-ed5a4471e643 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6811ba6d5fc41c499fdbe5f93dceb0d'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:02.039625 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-c4540ccc-9bc2-4ba0-98d6-ed5a4471e643 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6811ba6d5fc41c499fdbe5f93dceb0d'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:02.041866 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:02.056210 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-c4540ccc-9bc2-4ba0-98d6-ed5a4471e643 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6811ba6d5fc41c499fdbe5f93dceb0d'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:02.064599 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-c4540ccc-9bc2-4ba0-98d6-ed5a4471e643 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6811ba6d5fc41c499fdbe5f93dceb0d'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:02.082015 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1292/2593] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:55:01 2022] DELETE /identity/v3/users/d6811ba6d5fc41c499fdbe5f93dceb0d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:02.308051 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bda911-858b-4a6a-9732-125959493346 service neutron] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:02.318425 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bda911-858b-4a6a-9732-125959493346 service neutron] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:02.379726 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a203f31c-14ed-4f0a-bd68-9dce9f26db52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:02.380344 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203f31c-14ed-4f0a-bd68-9dce9f26db52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:02.380638 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203f31c-14ed-4f0a-bd68-9dce9f26db52 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:02.380914 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203f31c-14ed-4f0a-bd68-9dce9f26db52 admin admin] PATH_INFO: `/v3/projects/8efad2d2c0d34ee9921c32b6b654f482` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:02.382014 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a203f31c-14ed-4f0a-bd68-9dce9f26db52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8efad2d2c0d34ee9921c32b6b654f482)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:02.384006 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a203f31c-14ed-4f0a-bd68-9dce9f26db52 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:02.433827 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-a203f31c-14ed-4f0a-bd68-9dce9f26db52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8efad2d2c0d34ee9921c32b6b654f482', 'request_id': 'req-a203f31c-14ed-4f0a-bd68-9dce9f26db52'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:02.440031 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-a203f31c-14ed-4f0a-bd68-9dce9f26db52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8efad2d2c0d34ee9921c32b6b654f482', 'request_id': 'req-a203f31c-14ed-4f0a-bd68-9dce9f26db52'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:02.450987 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-a203f31c-14ed-4f0a-bd68-9dce9f26db52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8efad2d2c0d34ee9921c32b6b654f482', 'request_id': 'req-a203f31c-14ed-4f0a-bd68-9dce9f26db52'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:02.464549 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-a203f31c-14ed-4f0a-bd68-9dce9f26db52 admin admin] The token cache is being invalidate because project 8efad2d2c0d34ee9921c32b6b654f482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:55:02.464942 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-a203f31c-14ed-4f0a-bd68-9dce9f26db52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:02.465983 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-a203f31c-14ed-4f0a-bd68-9dce9f26db52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:02.467924 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1302/2594] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:55:02 2022] DELETE /identity/v3/projects/8efad2d2c0d34ee9921c32b6b654f482 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:02.473209 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4372f13-9a48-4d3d-b2ea-70e77c64e84e None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:02.473848 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4372f13-9a48-4d3d-b2ea-70e77c64e84e None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:02.474125 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4372f13-9a48-4d3d-b2ea-70e77c64e84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:02.494707 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-c4372f13-9a48-4d3d-b2ea-70e77c64e84e None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:02.495927 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-c4372f13-9a48-4d3d-b2ea-70e77c64e84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:02.556366 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1293/2595] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:55:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:55:02.564646 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d75ce-90dc-4ea2-89c9-e17782a340ab None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:02.564940 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d75ce-90dc-4ea2-89c9-e17782a340ab None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:02.565213 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d75ce-90dc-4ea2-89c9-e17782a340ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:02.585374 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-d91d75ce-90dc-4ea2-89c9-e17782a340ab None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:02.586604 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-d91d75ce-90dc-4ea2-89c9-e17782a340ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:02.594893 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1303/2596] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:55:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:02.599385 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4372f13-9a48-4d3d-b2ea-70e77c64e84e None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:02.610275 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4372f13-9a48-4d3d-b2ea-70e77c64e84e None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:02.615632 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3364f4a-58af-4f9f-9c66-995d8f3a02b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:02.616402 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3364f4a-58af-4f9f-9c66-995d8f3a02b3 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:02.616753 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3364f4a-58af-4f9f-9c66-995d8f3a02b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:02.617091 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3364f4a-58af-4f9f-9c66-995d8f3a02b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:02.617790 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3364f4a-58af-4f9f-9c66-995d8f3a02b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:55:02.618097 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3364f4a-58af-4f9f-9c66-995d8f3a02b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:02.619719 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3364f4a-58af-4f9f-9c66-995d8f3a02b3 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:02.636025 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1294/2597] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:55:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:55:02.637188 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d75ce-90dc-4ea2-89c9-e17782a340ab None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:02.647101 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d75ce-90dc-4ea2-89c9-e17782a340ab None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:02.652491 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59638069-8a73-41fe-adde-345f9b899b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:02.653084 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59638069-8a73-41fe-adde-345f9b899b77 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:02.653402 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59638069-8a73-41fe-adde-345f9b899b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:02.653697 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59638069-8a73-41fe-adde-345f9b899b77 admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:02.654313 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59638069-8a73-41fe-adde-345f9b899b77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:02.656197 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59638069-8a73-41fe-adde-345f9b899b77 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:02.684803 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1304/2598] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:55:02 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:02.688997 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3364f4a-58af-4f9f-9c66-995d8f3a02b3 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:02.701901 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3364f4a-58af-4f9f-9c66-995d8f3a02b3 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:02.760709 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378cccc8-9c07-4dff-b569-5c5761d07fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:02.761362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cccc8-9c07-4dff-b569-5c5761d07fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:02.761643 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cccc8-9c07-4dff-b569-5c5761d07fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:02.761916 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cccc8-9c07-4dff-b569-5c5761d07fd1 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:02.762556 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378cccc8-9c07-4dff-b569-5c5761d07fd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:02.764509 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378cccc8-9c07-4dff-b569-5c5761d07fd1 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:02.787336 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1295/2599] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:55:02 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:55:02.791574 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59638069-8a73-41fe-adde-345f9b899b77 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:02.802271 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59638069-8a73-41fe-adde-345f9b899b77 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:02.808277 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28409a6a-bc30-4118-80c0-38ce4fbc98dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:02.808784 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28409a6a-bc30-4118-80c0-38ce4fbc98dc admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:02.809069 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28409a6a-bc30-4118-80c0-38ce4fbc98dc admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:02.809375 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28409a6a-bc30-4118-80c0-38ce4fbc98dc admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:02.809999 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28409a6a-bc30-4118-80c0-38ce4fbc98dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:02.811614 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28409a6a-bc30-4118-80c0-38ce4fbc98dc admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:02.822464 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1305/2600] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:02.826489 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378cccc8-9c07-4dff-b569-5c5761d07fd1 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:02.836860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378cccc8-9c07-4dff-b569-5c5761d07fd1 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:02.841930 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b9023b-d3b5-4a19-9c51-11c8f3d6c6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:02.842525 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9023b-d3b5-4a19-9c51-11c8f3d6c6af admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:02.842798 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9023b-d3b5-4a19-9c51-11c8f3d6c6af admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:02.843086 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9023b-d3b5-4a19-9c51-11c8f3d6c6af admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:02.843726 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b9023b-d3b5-4a19-9c51-11c8f3d6c6af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:02.845370 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b9023b-d3b5-4a19-9c51-11c8f3d6c6af admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:02.857295 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1296/2601] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:02.861839 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28409a6a-bc30-4118-80c0-38ce4fbc98dc admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:02.872582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28409a6a-bc30-4118-80c0-38ce4fbc98dc admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:02.878459 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799584a2-593b-4d8e-8811-55eb3f5f4c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:02.879091 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799584a2-593b-4d8e-8811-55eb3f5f4c8d admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:02.879396 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799584a2-593b-4d8e-8811-55eb3f5f4c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:02.879675 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799584a2-593b-4d8e-8811-55eb3f5f4c8d admin admin] PATH_INFO: `/v3/projects/253b36efcd414cf5ac0cde488cb9cb7f/users/7dd2a8267e2f4960aa395cea623bd807/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:02.894708 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799584a2-593b-4d8e-8811-55eb3f5f4c8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=253b36efcd414cf5ac0cde488cb9cb7f, user_id=7dd2a8267e2f4960aa395cea623bd807, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:02.897370 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799584a2-593b-4d8e-8811-55eb3f5f4c8d admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:02.913380 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1306/2602] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:02 2022] PUT /identity/v3/projects/253b36efcd414cf5ac0cde488cb9cb7f/users/7dd2a8267e2f4960aa395cea623bd807/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:02.924154 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae0cde-4ea6-41bc-b4ca-811a4bab3e69 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:02.924390 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae0cde-4ea6-41bc-b4ca-811a4bab3e69 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:02.924662 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae0cde-4ea6-41bc-b4ca-811a4bab3e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:02.954350 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-b7ae0cde-4ea6-41bc-b4ca-811a4bab3e69 None None] MFA Rules not processed for user `7dd2a8267e2f4960aa395cea623bd807`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:02.955940 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-b7ae0cde-4ea6-41bc-b4ca-811a4bab3e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:02.983267 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:03.030648 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1297/2603] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:55:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:03.045564 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799584a2-593b-4d8e-8811-55eb3f5f4c8d admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:03.047479 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-799584a2-593b-4d8e-8811-55eb3f5f4c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:03.059161 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:03.128195 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799584a2-593b-4d8e-8811-55eb3f5f4c8d admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:03.134484 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deff551-b8d7-4ffb-b2a3-e6eb3265d50f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:03.135135 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deff551-b8d7-4ffb-b2a3-e6eb3265d50f service nova] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:03.135415 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deff551-b8d7-4ffb-b2a3-e6eb3265d50f service nova] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:03.135685 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deff551-b8d7-4ffb-b2a3-e6eb3265d50f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:03.144325 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deff551-b8d7-4ffb-b2a3-e6eb3265d50f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:03.146019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deff551-b8d7-4ffb-b2a3-e6eb3265d50f service nova] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:03.158287 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1307/2604] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:07.563248 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae0cde-4ea6-41bc-b4ca-811a4bab3e69 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:07.565675 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-b7ae0cde-4ea6-41bc-b4ca-811a4bab3e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:07.635549 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae0cde-4ea6-41bc-b4ca-811a4bab3e69 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:07.640062 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef191a7-4a29-4df9-b0d4-c8c7ad40f51f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:07.640684 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef191a7-4a29-4df9-b0d4-c8c7ad40f51f service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:07.640976 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef191a7-4a29-4df9-b0d4-c8c7ad40f51f service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:07.641245 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef191a7-4a29-4df9-b0d4-c8c7ad40f51f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:07.643237 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-7ef191a7-4a29-4df9-b0d4-c8c7ad40f51f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:07.653126 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef191a7-4a29-4df9-b0d4-c8c7ad40f51f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:07.654621 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef191a7-4a29-4df9-b0d4-c8c7ad40f51f service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:07.662729 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1298/2605] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:08.415667 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deff551-b8d7-4ffb-b2a3-e6eb3265d50f service nova] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:08.483958 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deff551-b8d7-4ffb-b2a3-e6eb3265d50f service nova] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:08.489014 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77279da1-f126-420f-b938-dce91fb398af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:08.489659 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77279da1-f126-420f-b938-dce91fb398af admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:08.489939 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77279da1-f126-420f-b938-dce91fb398af admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:08.490213 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77279da1-f126-420f-b938-dce91fb398af admin admin] PATH_INFO: `/v3/users/7dd2a8267e2f4960aa395cea623bd807` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:08.491367 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77279da1-f126-420f-b938-dce91fb398af admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dd2a8267e2f4960aa395cea623bd807)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:08.493369 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77279da1-f126-420f-b938-dce91fb398af admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:08.547562 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-77279da1-f126-420f-b938-dce91fb398af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dd2a8267e2f4960aa395cea623bd807'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:08.548480 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-77279da1-f126-420f-b938-dce91fb398af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dd2a8267e2f4960aa395cea623bd807'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:08.549540 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-77279da1-f126-420f-b938-dce91fb398af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dd2a8267e2f4960aa395cea623bd807'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:08.562650 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-77279da1-f126-420f-b938-dce91fb398af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dd2a8267e2f4960aa395cea623bd807'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:08.571511 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-77279da1-f126-420f-b938-dce91fb398af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dd2a8267e2f4960aa395cea623bd807'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:08.585661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1308/2606] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:55:08 2022] DELETE /identity/v3/users/7dd2a8267e2f4960aa395cea623bd807 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:08.590495 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c1a52-1358-4fdd-99ce-4726c0f0ccb4 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:08.590988 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c1a52-1358-4fdd-99ce-4726c0f0ccb4 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:08.591084 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c1a52-1358-4fdd-99ce-4726c0f0ccb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:08.610521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-e97c1a52-1358-4fdd-99ce-4726c0f0ccb4 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:08.611731 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-e97c1a52-1358-4fdd-99ce-4726c0f0ccb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:08.675523 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1299/2607] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:55:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:08.685470 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77279da1-f126-420f-b938-dce91fb398af admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:08.686980 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-77279da1-f126-420f-b938-dce91fb398af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:08.702547 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:08.747986 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77279da1-f126-420f-b938-dce91fb398af admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:08.751836 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5437a0e-f3f5-4d4b-9a66-1629ebcb3252 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:08.752439 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5437a0e-f3f5-4d4b-9a66-1629ebcb3252 service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:08.752715 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5437a0e-f3f5-4d4b-9a66-1629ebcb3252 service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:08.752987 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5437a0e-f3f5-4d4b-9a66-1629ebcb3252 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:08.762554 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5437a0e-f3f5-4d4b-9a66-1629ebcb3252 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:08.763980 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5437a0e-f3f5-4d4b-9a66-1629ebcb3252 service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:08.773696 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1309/2608] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:09.054265 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c1a52-1358-4fdd-99ce-4726c0f0ccb4 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:09.055863 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-e97c1a52-1358-4fdd-99ce-4726c0f0ccb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:09.069940 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c1a52-1358-4fdd-99ce-4726c0f0ccb4 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:09.075986 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1671c8c0-4e65-444f-a6e4-a86ab58fafe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:09.076747 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671c8c0-4e65-444f-a6e4-a86ab58fafe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:09.077089 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671c8c0-4e65-444f-a6e4-a86ab58fafe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:09.078294 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671c8c0-4e65-444f-a6e4-a86ab58fafe5 admin admin] PATH_INFO: `/v3/projects/253b36efcd414cf5ac0cde488cb9cb7f` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:09.079805 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1671c8c0-4e65-444f-a6e4-a86ab58fafe5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=253b36efcd414cf5ac0cde488cb9cb7f)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:09.081828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1671c8c0-4e65-444f-a6e4-a86ab58fafe5 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:09.136249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-1671c8c0-4e65-444f-a6e4-a86ab58fafe5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '253b36efcd414cf5ac0cde488cb9cb7f', 'request_id': 'req-1671c8c0-4e65-444f-a6e4-a86ab58fafe5'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:09.145610 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-1671c8c0-4e65-444f-a6e4-a86ab58fafe5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '253b36efcd414cf5ac0cde488cb9cb7f', 'request_id': 'req-1671c8c0-4e65-444f-a6e4-a86ab58fafe5'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:09.153844 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-1671c8c0-4e65-444f-a6e4-a86ab58fafe5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '253b36efcd414cf5ac0cde488cb9cb7f', 'request_id': 'req-1671c8c0-4e65-444f-a6e4-a86ab58fafe5'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:09.155170 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:09.170025 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-1671c8c0-4e65-444f-a6e4-a86ab58fafe5 admin admin] The token cache is being invalidate because project 253b36efcd414cf5ac0cde488cb9cb7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:55:09.170318 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-1671c8c0-4e65-444f-a6e4-a86ab58fafe5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:09.170967 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-1671c8c0-4e65-444f-a6e4-a86ab58fafe5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:09.172524 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1300/2609] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:55:09 2022] DELETE /identity/v3/projects/253b36efcd414cf5ac0cde488cb9cb7f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:09.177790 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64210ab0-6ea0-48f2-b411-f1250dc2e069 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:09.178024 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64210ab0-6ea0-48f2-b411-f1250dc2e069 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:09.178297 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64210ab0-6ea0-48f2-b411-f1250dc2e069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:09.201362 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-64210ab0-6ea0-48f2-b411-f1250dc2e069 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:09.202584 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-64210ab0-6ea0-48f2-b411-f1250dc2e069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:09.263316 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1310/2610] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:09.271179 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6f513-90ea-4fe1-be0b-d3091161553d None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:09.271572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6f513-90ea-4fe1-be0b-d3091161553d None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:09.271935 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6f513-90ea-4fe1-be0b-d3091161553d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:09.293146 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-86b6f513-90ea-4fe1-be0b-d3091161553d None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:09.294482 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-86b6f513-90ea-4fe1-be0b-d3091161553d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:09.303769 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1301/2611] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:09.309476 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64210ab0-6ea0-48f2-b411-f1250dc2e069 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:09.319782 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64210ab0-6ea0-48f2-b411-f1250dc2e069 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:09.325042 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6db29c-af4f-456c-8a80-e4ba663af745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:09.325719 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6db29c-af4f-456c-8a80-e4ba663af745 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:09.325995 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6db29c-af4f-456c-8a80-e4ba663af745 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:09.326263 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6db29c-af4f-456c-8a80-e4ba663af745 admin admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:09.326996 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6db29c-af4f-456c-8a80-e4ba663af745 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:55:09.327295 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6db29c-af4f-456c-8a80-e4ba663af745 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:09.328934 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6db29c-af4f-456c-8a80-e4ba663af745 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:09.341653 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1311/2612] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:55:09.346146 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6f513-90ea-4fe1-be0b-d3091161553d None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:09.355859 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6f513-90ea-4fe1-be0b-d3091161553d None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:09.361480 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd798ee1-5de2-4fb8-bf79-9466ea2dde7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:09.362092 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd798ee1-5de2-4fb8-bf79-9466ea2dde7f admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:09.362375 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd798ee1-5de2-4fb8-bf79-9466ea2dde7f admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:09.362680 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd798ee1-5de2-4fb8-bf79-9466ea2dde7f admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:09.363481 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd798ee1-5de2-4fb8-bf79-9466ea2dde7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:09.365669 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd798ee1-5de2-4fb8-bf79-9466ea2dde7f admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:09.399121 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1302/2613] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:55:09 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:09.400613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6db29c-af4f-456c-8a80-e4ba663af745 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:09.410903 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6db29c-af4f-456c-8a80-e4ba663af745 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:09.468532 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f0fd3-5f81-4278-8f80-d6c320a946c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:09.469202 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f0fd3-5f81-4278-8f80-d6c320a946c4 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:09.469422 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f0fd3-5f81-4278-8f80-d6c320a946c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:09.469695 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f0fd3-5f81-4278-8f80-d6c320a946c4 admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:09.470310 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f0fd3-5f81-4278-8f80-d6c320a946c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:09.472236 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f0fd3-5f81-4278-8f80-d6c320a946c4 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:09.495150 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1312/2614] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:55:09 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:55:09.501223 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd798ee1-5de2-4fb8-bf79-9466ea2dde7f admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:09.511919 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd798ee1-5de2-4fb8-bf79-9466ea2dde7f admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:09.516929 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419619f-8623-4bc5-b459-67b260b01846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:09.517550 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419619f-8623-4bc5-b459-67b260b01846 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:09.517828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419619f-8623-4bc5-b459-67b260b01846 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:09.518096 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419619f-8623-4bc5-b459-67b260b01846 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:09.518735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3419619f-8623-4bc5-b459-67b260b01846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:09.520346 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3419619f-8623-4bc5-b459-67b260b01846 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:09.530523 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1303/2615] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:09.534345 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f0fd3-5f81-4278-8f80-d6c320a946c4 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:09.544599 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f0fd3-5f81-4278-8f80-d6c320a946c4 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:09.549703 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ccfa3b-ec62-4681-83b6-aa4ca081181c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:09.550284 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccfa3b-ec62-4681-83b6-aa4ca081181c admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:09.550563 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccfa3b-ec62-4681-83b6-aa4ca081181c admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:09.550862 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccfa3b-ec62-4681-83b6-aa4ca081181c admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:09.552286 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ccfa3b-ec62-4681-83b6-aa4ca081181c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:09.553968 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ccfa3b-ec62-4681-83b6-aa4ca081181c admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:09.564412 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1313/2616] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:09.569080 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419619f-8623-4bc5-b459-67b260b01846 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:09.584681 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419619f-8623-4bc5-b459-67b260b01846 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:09.592307 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded25ee3-5b8f-4d41-a9c5-6c8b0efbacff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:09.593273 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded25ee3-5b8f-4d41-a9c5-6c8b0efbacff admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:09.593742 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded25ee3-5b8f-4d41-a9c5-6c8b0efbacff admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:09.594172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded25ee3-5b8f-4d41-a9c5-6c8b0efbacff admin admin] PATH_INFO: `/v3/projects/aff043709efe4190b4fa3d8ae83f01a7/users/6df566c81edb4cefa93047abf22c28a3/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:09.615549 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded25ee3-5b8f-4d41-a9c5-6c8b0efbacff admin admin] RBAC: Authorizing `identity:create_grant(project_id=aff043709efe4190b4fa3d8ae83f01a7, user_id=6df566c81edb4cefa93047abf22c28a3, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:09.619836 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded25ee3-5b8f-4d41-a9c5-6c8b0efbacff admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:09.637735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1304/2617] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:09 2022] PUT /identity/v3/projects/aff043709efe4190b4fa3d8ae83f01a7/users/6df566c81edb4cefa93047abf22c28a3/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:09.648678 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112d6f9-900b-4bb3-8f70-c67cf789850a None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:09.648990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112d6f9-900b-4bb3-8f70-c67cf789850a None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:09.649275 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112d6f9-900b-4bb3-8f70-c67cf789850a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:09.679025 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-d112d6f9-900b-4bb3-8f70-c67cf789850a None None] MFA Rules not processed for user `6df566c81edb4cefa93047abf22c28a3`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:09.680187 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-d112d6f9-900b-4bb3-8f70-c67cf789850a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:09.689965 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:09.748703 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1314/2618] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:55:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:09.762274 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded25ee3-5b8f-4d41-a9c5-6c8b0efbacff admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:09.764240 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-ded25ee3-5b8f-4d41-a9c5-6c8b0efbacff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:09.825569 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded25ee3-5b8f-4d41-a9c5-6c8b0efbacff admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:09.829625 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b7553-c476-420c-b8f7-8fe02a07aa1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:09.830244 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b7553-c476-420c-b8f7-8fe02a07aa1d service cinder] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:09.830531 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b7553-c476-420c-b8f7-8fe02a07aa1d service cinder] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:09.830811 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b7553-c476-420c-b8f7-8fe02a07aa1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:09.840067 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b7553-c476-420c-b8f7-8fe02a07aa1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:09.841626 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b7553-c476-420c-b8f7-8fe02a07aa1d service cinder] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:09.851739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1305/2619] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:10.683159 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112d6f9-900b-4bb3-8f70-c67cf789850a None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:10.684704 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-d112d6f9-900b-4bb3-8f70-c67cf789850a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:10.745678 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112d6f9-900b-4bb3-8f70-c67cf789850a None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:10.749680 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e608a-92a0-4564-a82e-39f24413d580 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:10.750283 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e608a-92a0-4564-a82e-39f24413d580 service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:10.750553 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e608a-92a0-4564-a82e-39f24413d580 service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:10.750824 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e608a-92a0-4564-a82e-39f24413d580 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:10.752654 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-304e608a-92a0-4564-a82e-39f24413d580 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:10.762634 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e608a-92a0-4564-a82e-39f24413d580 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:10.764095 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e608a-92a0-4564-a82e-39f24413d580 service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:10.772237 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1315/2620] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:10.907801 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60483e2-0c95-4424-8d3e-1adde3064718 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:10.908346 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60483e2-0c95-4424-8d3e-1adde3064718 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:10.908498 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60483e2-0c95-4424-8d3e-1adde3064718 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:10.909944 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1306/2621] 10.222.0.49 () {54 vars in 921 bytes} [Wed Aug 24 04:55:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:55:10.916183 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3578e5-677e-4c8d-8e9d-500b4925fa6a None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:10.916539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3578e5-677e-4c8d-8e9d-500b4925fa6a None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:10.916919 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3578e5-677e-4c8d-8e9d-500b4925fa6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:10.936793 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-eb3578e5-677e-4c8d-8e9d-500b4925fa6a None None] MFA Rules not processed for user `087c0311906a4987b294729706a08810`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:10.938023 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-eb3578e5-677e-4c8d-8e9d-500b4925fa6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:10.944578 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1316/2622] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Aug 24 04:55:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:10.957623 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60483e2-0c95-4424-8d3e-1adde3064718 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:10.959458 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-b60483e2-0c95-4424-8d3e-1adde3064718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:10.974127 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60483e2-0c95-4424-8d3e-1adde3064718 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:10.978436 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1396509-82cb-4d4c-bd62-3b51d8eaa338 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:10.979048 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1396509-82cb-4d4c-bd62-3b51d8eaa338 service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:10.979329 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1396509-82cb-4d4c-bd62-3b51d8eaa338 service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:10.979604 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1396509-82cb-4d4c-bd62-3b51d8eaa338 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:10.987295 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1396509-82cb-4d4c-bd62-3b51d8eaa338 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:10.988840 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1396509-82cb-4d4c-bd62-3b51d8eaa338 service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:10.997209 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1307/2623] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:11.082403 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b08664-4bdb-47b5-8ca9-41c218bc5e8a None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:11.082725 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b08664-4bdb-47b5-8ca9-41c218bc5e8a None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:11.082992 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b08664-4bdb-47b5-8ca9-41c218bc5e8a None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:11.084356 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1317/2624] 10.222.0.49 () {54 vars in 921 bytes} [Wed Aug 24 04:55:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:55:11.089888 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff91a6-c335-4024-8d9a-21a0de0564aa None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:11.090196 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff91a6-c335-4024-8d9a-21a0de0564aa None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:11.090457 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff91a6-c335-4024-8d9a-21a0de0564aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:11.111403 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-caff91a6-c335-4024-8d9a-21a0de0564aa None None] MFA Rules not processed for user `9dc9a3cf381e4a2da36ed82b407a2d94`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:11.112630 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-caff91a6-c335-4024-8d9a-21a0de0564aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:11.183561 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1308/2625] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Aug 24 04:55:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:11.194586 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b08664-4bdb-47b5-8ca9-41c218bc5e8a None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:11.205886 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b08664-4bdb-47b5-8ca9-41c218bc5e8a None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:11.209883 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970d0c9-50c6-48cb-adf8-166ddb1c8431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:11.210473 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970d0c9-50c6-48cb-adf8-166ddb1c8431 service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:11.210762 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970d0c9-50c6-48cb-adf8-166ddb1c8431 service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:11.211029 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970d0c9-50c6-48cb-adf8-166ddb1c8431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:11.223192 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970d0c9-50c6-48cb-adf8-166ddb1c8431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:11.225022 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970d0c9-50c6-48cb-adf8-166ddb1c8431 service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:11.242640 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1318/2626] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:11.303661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff91a6-c335-4024-8d9a-21a0de0564aa None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:11.305182 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-caff91a6-c335-4024-8d9a-21a0de0564aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:11.315066 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:11.376354 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff91a6-c335-4024-8d9a-21a0de0564aa None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:11.382111 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16b583-6acd-48f5-94da-24c02d1b5b20 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf1b960a2eb4e5e9ada736b5f3f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:11.382732 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16b583-6acd-48f5-94da-24c02d1b5b20 service placement] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:11.383067 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16b583-6acd-48f5-94da-24c02d1b5b20 service placement] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:11.383281 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16b583-6acd-48f5-94da-24c02d1b5b20 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:11.385184 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-4a16b583-6acd-48f5-94da-24c02d1b5b20 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:11.398169 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16b583-6acd-48f5-94da-24c02d1b5b20 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:11.399906 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16b583-6acd-48f5-94da-24c02d1b5b20 service placement] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:11.410122 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1309/2627] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:12.248633 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970d0c9-50c6-48cb-adf8-166ddb1c8431 service neutron] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:12.250321 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-3970d0c9-50c6-48cb-adf8-166ddb1c8431 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:12.269103 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970d0c9-50c6-48cb-adf8-166ddb1c8431 service neutron] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:12.276351 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3f2d9-5b8f-4316-afbd-4597684e055d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:12.277328 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3f2d9-5b8f-4316-afbd-4597684e055d service nova] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:12.277903 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3f2d9-5b8f-4316-afbd-4597684e055d service nova] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:12.278464 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3f2d9-5b8f-4316-afbd-4597684e055d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:12.280692 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-bdb3f2d9-5b8f-4316-afbd-4597684e055d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:12.296184 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3f2d9-5b8f-4316-afbd-4597684e055d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:12.298098 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3f2d9-5b8f-4316-afbd-4597684e055d service nova] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:12.309596 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1319/2628] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:18.344937 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16b583-6acd-48f5-94da-24c02d1b5b20 service placement] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:18.414826 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16b583-6acd-48f5-94da-24c02d1b5b20 service placement] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:18.419704 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b7f031-45d1-4658-8ce8-d25b67b71db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:18.420347 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7f031-45d1-4658-8ce8-d25b67b71db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:18.420611 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7f031-45d1-4658-8ce8-d25b67b71db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:18.420884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7f031-45d1-4658-8ce8-d25b67b71db4 admin admin] PATH_INFO: `/v3/users/6df566c81edb4cefa93047abf22c28a3` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:18.422486 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b7f031-45d1-4658-8ce8-d25b67b71db4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6df566c81edb4cefa93047abf22c28a3)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:18.424422 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b7f031-45d1-4658-8ce8-d25b67b71db4 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:18.473769 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-03b7f031-45d1-4658-8ce8-d25b67b71db4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6df566c81edb4cefa93047abf22c28a3'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:18.474461 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-03b7f031-45d1-4658-8ce8-d25b67b71db4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6df566c81edb4cefa93047abf22c28a3'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:18.475077 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-03b7f031-45d1-4658-8ce8-d25b67b71db4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6df566c81edb4cefa93047abf22c28a3'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:18.486944 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-03b7f031-45d1-4658-8ce8-d25b67b71db4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6df566c81edb4cefa93047abf22c28a3'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:18.498286 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-03b7f031-45d1-4658-8ce8-d25b67b71db4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6df566c81edb4cefa93047abf22c28a3'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:18.511248 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1310/2629] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:55:18 2022] DELETE /identity/v3/users/6df566c81edb4cefa93047abf22c28a3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:18.515911 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8300539-cc3a-4340-a693-afba3cfa32b0 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:18.516301 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8300539-cc3a-4340-a693-afba3cfa32b0 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:18.516456 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8300539-cc3a-4340-a693-afba3cfa32b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:18.538884 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-e8300539-cc3a-4340-a693-afba3cfa32b0 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:18.540103 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-e8300539-cc3a-4340-a693-afba3cfa32b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:18.603084 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1320/2630] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:55:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:18.613028 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b7f031-45d1-4658-8ce8-d25b67b71db4 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:18.614656 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-03b7f031-45d1-4658-8ce8-d25b67b71db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:18.634441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:18.677468 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b7f031-45d1-4658-8ce8-d25b67b71db4 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:18.681288 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0bfe4-7618-4c88-9a63-771080e16c02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:18.681923 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0bfe4-7618-4c88-9a63-771080e16c02 service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:18.682199 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0bfe4-7618-4c88-9a63-771080e16c02 service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:18.682476 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0bfe4-7618-4c88-9a63-771080e16c02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:18.691724 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0bfe4-7618-4c88-9a63-771080e16c02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:18.693155 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0bfe4-7618-4c88-9a63-771080e16c02 service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:18.702971 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1311/2631] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:18.984497 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8300539-cc3a-4340-a693-afba3cfa32b0 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:18.986869 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-e8300539-cc3a-4340-a693-afba3cfa32b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:19.000354 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8300539-cc3a-4340-a693-afba3cfa32b0 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:19.005914 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf4f85-5838-4c41-8256-4a4f35ca9757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:19.006577 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf4f85-5838-4c41-8256-4a4f35ca9757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:19.006872 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf4f85-5838-4c41-8256-4a4f35ca9757 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:19.007142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf4f85-5838-4c41-8256-4a4f35ca9757 admin admin] PATH_INFO: `/v3/projects/aff043709efe4190b4fa3d8ae83f01a7` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:19.008418 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf4f85-5838-4c41-8256-4a4f35ca9757 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aff043709efe4190b4fa3d8ae83f01a7)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:19.010384 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf4f85-5838-4c41-8256-4a4f35ca9757 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:19.028965 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:19.060710 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-44bf4f85-5838-4c41-8256-4a4f35ca9757 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aff043709efe4190b4fa3d8ae83f01a7', 'request_id': 'req-44bf4f85-5838-4c41-8256-4a4f35ca9757'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:19.067366 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-44bf4f85-5838-4c41-8256-4a4f35ca9757 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aff043709efe4190b4fa3d8ae83f01a7', 'request_id': 'req-44bf4f85-5838-4c41-8256-4a4f35ca9757'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:19.077864 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-44bf4f85-5838-4c41-8256-4a4f35ca9757 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aff043709efe4190b4fa3d8ae83f01a7', 'request_id': 'req-44bf4f85-5838-4c41-8256-4a4f35ca9757'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:19.090948 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-44bf4f85-5838-4c41-8256-4a4f35ca9757 admin admin] The token cache is being invalidate because project aff043709efe4190b4fa3d8ae83f01a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:55:19.091235 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-44bf4f85-5838-4c41-8256-4a4f35ca9757 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:19.091960 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-44bf4f85-5838-4c41-8256-4a4f35ca9757 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:19.093559 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1321/2632] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:55:18 2022] DELETE /identity/v3/projects/aff043709efe4190b4fa3d8ae83f01a7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:19.098978 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af3fba-71b9-4774-a137-b21e37337f0a None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:19.099270 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af3fba-71b9-4774-a137-b21e37337f0a None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:19.099543 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af3fba-71b9-4774-a137-b21e37337f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:19.119349 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-77af3fba-71b9-4774-a137-b21e37337f0a None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:19.120559 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-77af3fba-71b9-4774-a137-b21e37337f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:19.185804 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1312/2633] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:19.197176 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083fb27-2fa3-4f1e-84d9-9df2c5cdaaea None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:19.197458 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083fb27-2fa3-4f1e-84d9-9df2c5cdaaea None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:19.197737 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4083fb27-2fa3-4f1e-84d9-9df2c5cdaaea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:19.225663 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-4083fb27-2fa3-4f1e-84d9-9df2c5cdaaea None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:19.226878 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-4083fb27-2fa3-4f1e-84d9-9df2c5cdaaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:19.235299 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1322/2634] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:55:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:19.239556 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af3fba-71b9-4774-a137-b21e37337f0a None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:19.249827 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af3fba-71b9-4774-a137-b21e37337f0a None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:19.254896 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77621de-0eb0-4552-8711-b98873f599fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:19.255506 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77621de-0eb0-4552-8711-b98873f599fd admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:19.255786 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77621de-0eb0-4552-8711-b98873f599fd admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:19.256131 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77621de-0eb0-4552-8711-b98873f599fd admin admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:19.256781 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77621de-0eb0-4552-8711-b98873f599fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:55:19.257081 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77621de-0eb0-4552-8711-b98873f599fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:19.258718 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77621de-0eb0-4552-8711-b98873f599fd admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:19.271029 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1313/2635] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:55:19.275620 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083fb27-2fa3-4f1e-84d9-9df2c5cdaaea None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:19.285510 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4083fb27-2fa3-4f1e-84d9-9df2c5cdaaea None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:19.290434 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcc1fa-fa8c-49bf-9702-3aaaeb9870ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:19.291071 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcc1fa-fa8c-49bf-9702-3aaaeb9870ae admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:19.291376 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcc1fa-fa8c-49bf-9702-3aaaeb9870ae admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:19.291675 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcc1fa-fa8c-49bf-9702-3aaaeb9870ae admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:19.292384 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbcc1fa-fa8c-49bf-9702-3aaaeb9870ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:19.294515 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbcc1fa-fa8c-49bf-9702-3aaaeb9870ae admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:19.324193 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1323/2636] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:55:19 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:19.328447 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77621de-0eb0-4552-8711-b98873f599fd admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:19.338701 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77621de-0eb0-4552-8711-b98873f599fd admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:19.397752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a6a8f-1b3f-41b6-9c5d-df9ee6088175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:19.398390 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a6a8f-1b3f-41b6-9c5d-df9ee6088175 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:19.398622 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a6a8f-1b3f-41b6-9c5d-df9ee6088175 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:19.399285 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a6a8f-1b3f-41b6-9c5d-df9ee6088175 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:19.399613 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3a6a8f-1b3f-41b6-9c5d-df9ee6088175 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:19.401590 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3a6a8f-1b3f-41b6-9c5d-df9ee6088175 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:19.423392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1314/2637] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:55:19 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:19.427620 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcc1fa-fa8c-49bf-9702-3aaaeb9870ae admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:19.437944 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcc1fa-fa8c-49bf-9702-3aaaeb9870ae admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:19.442996 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37565a-a294-40df-884b-bff6a00f87ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:19.443577 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37565a-a294-40df-884b-bff6a00f87ed admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:19.443850 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37565a-a294-40df-884b-bff6a00f87ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:19.444118 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37565a-a294-40df-884b-bff6a00f87ed admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:19.444756 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37565a-a294-40df-884b-bff6a00f87ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:19.446378 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37565a-a294-40df-884b-bff6a00f87ed admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:19.456502 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1324/2638] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:19.460602 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a6a8f-1b3f-41b6-9c5d-df9ee6088175 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:19.471191 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a6a8f-1b3f-41b6-9c5d-df9ee6088175 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:19.476611 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a63eac-d00d-441b-b027-fcdb6318a6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:19.477216 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a63eac-d00d-441b-b027-fcdb6318a6c0 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:19.477510 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a63eac-d00d-441b-b027-fcdb6318a6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:19.477812 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a63eac-d00d-441b-b027-fcdb6318a6c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:19.478591 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a63eac-d00d-441b-b027-fcdb6318a6c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:19.480207 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a63eac-d00d-441b-b027-fcdb6318a6c0 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:19.495226 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1315/2639] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:19.496421 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37565a-a294-40df-884b-bff6a00f87ed admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:19.507019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37565a-a294-40df-884b-bff6a00f87ed admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:19.512947 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac93ed-f073-4e7d-8412-7c88aa7d3da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:19.513699 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac93ed-f073-4e7d-8412-7c88aa7d3da8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:19.513978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac93ed-f073-4e7d-8412-7c88aa7d3da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:19.514255 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac93ed-f073-4e7d-8412-7c88aa7d3da8 admin admin] PATH_INFO: `/v3/projects/ffe445bc50994a9ca0204db20b96346b/users/cae5052431dd47948567c224a06c2d55/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:19.529828 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac93ed-f073-4e7d-8412-7c88aa7d3da8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffe445bc50994a9ca0204db20b96346b, user_id=cae5052431dd47948567c224a06c2d55, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:19.532520 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac93ed-f073-4e7d-8412-7c88aa7d3da8 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:19.547357 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1325/2640] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:19 2022] PUT /identity/v3/projects/ffe445bc50994a9ca0204db20b96346b/users/cae5052431dd47948567c224a06c2d55/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:55:19.558035 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27807bb0-04da-4b84-9075-e54e9454ab9f None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:19.558322 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27807bb0-04da-4b84-9075-e54e9454ab9f None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:19.558598 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27807bb0-04da-4b84-9075-e54e9454ab9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:19.586512 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-27807bb0-04da-4b84-9075-e54e9454ab9f None None] MFA Rules not processed for user `cae5052431dd47948567c224a06c2d55`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:19.587730 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-27807bb0-04da-4b84-9075-e54e9454ab9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:19.601023 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:19.658212 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1316/2641] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:55:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:19.662961 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac93ed-f073-4e7d-8412-7c88aa7d3da8 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:19.728737 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac93ed-f073-4e7d-8412-7c88aa7d3da8 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:19.733923 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8db8d-6da4-43df-a37d-742042ffa10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:19.734514 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8db8d-6da4-43df-a37d-742042ffa10d admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:19.734764 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8db8d-6da4-43df-a37d-742042ffa10d admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:19.735033 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8db8d-6da4-43df-a37d-742042ffa10d admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:19.735643 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c8db8d-6da4-43df-a37d-742042ffa10d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:19.737579 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c8db8d-6da4-43df-a37d-742042ffa10d admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:19.768121 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1326/2642] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:55:19 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:19.772629 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27807bb0-04da-4b84-9075-e54e9454ab9f None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:19.783938 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27807bb0-04da-4b84-9075-e54e9454ab9f None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:19.839685 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757b655-d2fb-4fcf-92ca-5fdeff414d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:19.840303 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757b655-d2fb-4fcf-92ca-5fdeff414d9b admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:19.840652 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757b655-d2fb-4fcf-92ca-5fdeff414d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:19.840913 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757b655-d2fb-4fcf-92ca-5fdeff414d9b admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:19.841599 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757b655-d2fb-4fcf-92ca-5fdeff414d9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:19.843559 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757b655-d2fb-4fcf-92ca-5fdeff414d9b admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:19.868882 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1317/2643] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:55:19 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:19.873224 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8db8d-6da4-43df-a37d-742042ffa10d admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:19.884379 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8db8d-6da4-43df-a37d-742042ffa10d admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:19.891269 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154736e2-7dac-4f87-9833-fac58c4086a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:19.891269 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154736e2-7dac-4f87-9833-fac58c4086a9 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:19.891269 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154736e2-7dac-4f87-9833-fac58c4086a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:19.891269 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154736e2-7dac-4f87-9833-fac58c4086a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:19.892027 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154736e2-7dac-4f87-9833-fac58c4086a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:19.893682 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154736e2-7dac-4f87-9833-fac58c4086a9 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:19.905511 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1327/2644] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:19.909944 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757b655-d2fb-4fcf-92ca-5fdeff414d9b admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:19.920739 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757b655-d2fb-4fcf-92ca-5fdeff414d9b admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:19.925792 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41e6c6-6314-40e2-ab5f-2b3859d3872c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:19.926475 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41e6c6-6314-40e2-ab5f-2b3859d3872c admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:19.926776 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41e6c6-6314-40e2-ab5f-2b3859d3872c admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:19.927244 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41e6c6-6314-40e2-ab5f-2b3859d3872c admin admin] PATH_INFO: `/v3/projects/8adc86b9f4684c25870deaca85740277/users/4ebcf27b66914af79bbdf7618b1c0858/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:19.943781 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e41e6c6-6314-40e2-ab5f-2b3859d3872c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8adc86b9f4684c25870deaca85740277, user_id=4ebcf27b66914af79bbdf7618b1c0858, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:19.946534 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e41e6c6-6314-40e2-ab5f-2b3859d3872c admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:19.961752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1318/2645] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:19 2022] PUT /identity/v3/projects/8adc86b9f4684c25870deaca85740277/users/4ebcf27b66914af79bbdf7618b1c0858/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:19.965958 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154736e2-7dac-4f87-9833-fac58c4086a9 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:19.976726 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154736e2-7dac-4f87-9833-fac58c4086a9 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:19.997569 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:20.047324 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6829e142-42fb-4f71-99fa-c6549654dccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:20.047933 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829e142-42fb-4f71-99fa-c6549654dccf admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:20.048207 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829e142-42fb-4f71-99fa-c6549654dccf admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:20.048492 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6829e142-42fb-4f71-99fa-c6549654dccf admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:20.049142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6829e142-42fb-4f71-99fa-c6549654dccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:20.050946 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6829e142-42fb-4f71-99fa-c6549654dccf admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:20.061646 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1328/2646] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:20.066076 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41e6c6-6314-40e2-ab5f-2b3859d3872c admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:20.077313 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41e6c6-6314-40e2-ab5f-2b3859d3872c admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:20.082357 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b47936-979f-40cd-9fc5-a468e153c01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:20.083180 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b47936-979f-40cd-9fc5-a468e153c01b admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:20.083524 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b47936-979f-40cd-9fc5-a468e153c01b admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:20.083860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b47936-979f-40cd-9fc5-a468e153c01b admin admin] PATH_INFO: `/v3/projects/8adc86b9f4684c25870deaca85740277/users/4ebcf27b66914af79bbdf7618b1c0858/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:20.085863 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b47936-979f-40cd-9fc5-a468e153c01b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8adc86b9f4684c25870deaca85740277, user_id=4ebcf27b66914af79bbdf7618b1c0858, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:20.088644 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b47936-979f-40cd-9fc5-a468e153c01b admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:20.100337 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1319/2647] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:20 2022] PUT /identity/v3/projects/8adc86b9f4684c25870deaca85740277/users/4ebcf27b66914af79bbdf7618b1c0858/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:55:20.111502 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25722d82-0d75-482b-8e83-6d60ec86e7b4 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:20.111792 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25722d82-0d75-482b-8e83-6d60ec86e7b4 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:20.112065 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25722d82-0d75-482b-8e83-6d60ec86e7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:20.146621 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-25722d82-0d75-482b-8e83-6d60ec86e7b4 None None] MFA Rules not processed for user `4ebcf27b66914af79bbdf7618b1c0858`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:20.147907 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-25722d82-0d75-482b-8e83-6d60ec86e7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:20.242086 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1329/2648] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:55:20 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:20.249931 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b47936-979f-40cd-9fc5-a468e153c01b admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:20.251933 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-72b47936-979f-40cd-9fc5-a468e153c01b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:20.315930 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b47936-979f-40cd-9fc5-a468e153c01b admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:20.320163 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decb516-ddd7-437d-8266-f1755cff20f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:20.320785 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decb516-ddd7-437d-8266-f1755cff20f8 service cinder] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:20.321068 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decb516-ddd7-437d-8266-f1755cff20f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:20.321432 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decb516-ddd7-437d-8266-f1755cff20f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:20.331908 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5decb516-ddd7-437d-8266-f1755cff20f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:20.333424 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5decb516-ddd7-437d-8266-f1755cff20f8 service cinder] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:20.344186 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1320/2649] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:20 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:20.425184 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25722d82-0d75-482b-8e83-6d60ec86e7b4 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:20.435208 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25722d82-0d75-482b-8e83-6d60ec86e7b4 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:20.438941 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be8ea5-979a-4cb0-9622-7e540d1cd911 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:20.439546 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be8ea5-979a-4cb0-9622-7e540d1cd911 service cinder] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:20.439826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be8ea5-979a-4cb0-9622-7e540d1cd911 service cinder] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:20.440096 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be8ea5-979a-4cb0-9622-7e540d1cd911 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:20.502295 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be8ea5-979a-4cb0-9622-7e540d1cd911 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:20.503800 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be8ea5-979a-4cb0-9622-7e540d1cd911 service cinder] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:20.512881 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1330/2650] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:27.495101 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decb516-ddd7-437d-8266-f1755cff20f8 service cinder] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:27.505742 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:27.562714 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decb516-ddd7-437d-8266-f1755cff20f8 service cinder] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:27.567469 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15fd543-0da8-440a-997c-d4de462c2ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:27.568100 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fd543-0da8-440a-997c-d4de462c2ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:27.568380 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fd543-0da8-440a-997c-d4de462c2ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:27.568649 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15fd543-0da8-440a-997c-d4de462c2ebf admin admin] PATH_INFO: `/v3/users/cae5052431dd47948567c224a06c2d55` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:27.569835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15fd543-0da8-440a-997c-d4de462c2ebf admin admin] RBAC: Authorizing `identity:delete_user(user_id=cae5052431dd47948567c224a06c2d55)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:27.571811 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15fd543-0da8-440a-997c-d4de462c2ebf admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:27.620126 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-e15fd543-0da8-440a-997c-d4de462c2ebf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cae5052431dd47948567c224a06c2d55'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:27.620901 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-e15fd543-0da8-440a-997c-d4de462c2ebf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cae5052431dd47948567c224a06c2d55'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:27.621652 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-e15fd543-0da8-440a-997c-d4de462c2ebf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cae5052431dd47948567c224a06c2d55'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:27.633987 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-e15fd543-0da8-440a-997c-d4de462c2ebf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cae5052431dd47948567c224a06c2d55'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:27.643089 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-e15fd543-0da8-440a-997c-d4de462c2ebf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cae5052431dd47948567c224a06c2d55'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:27.656037 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1321/2651] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:55:27 2022] DELETE /identity/v3/users/cae5052431dd47948567c224a06c2d55 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:27.661313 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d9bfe-7195-4864-a011-6e27d593d170 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:27.661810 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d9bfe-7195-4864-a011-6e27d593d170 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:27.661927 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d9bfe-7195-4864-a011-6e27d593d170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:27.686907 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-1f5d9bfe-7195-4864-a011-6e27d593d170 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:27.688344 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-1f5d9bfe-7195-4864-a011-6e27d593d170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:27.720244 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=100 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:27.750314 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1331/2652] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:55:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:27.760213 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15fd543-0da8-440a-997c-d4de462c2ebf admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:27.761763 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-e15fd543-0da8-440a-997c-d4de462c2ebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:27.828669 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15fd543-0da8-440a-997c-d4de462c2ebf admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:27.834673 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea349d5c-cbe9-4731-a278-191be31ca9e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:27.835266 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea349d5c-cbe9-4731-a278-191be31ca9e6 service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:27.835540 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea349d5c-cbe9-4731-a278-191be31ca9e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:27.835809 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea349d5c-cbe9-4731-a278-191be31ca9e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:27.846364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea349d5c-cbe9-4731-a278-191be31ca9e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:27.848822 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea349d5c-cbe9-4731-a278-191be31ca9e6 service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:27.864688 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1322/2653] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:28.150748 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d9bfe-7195-4864-a011-6e27d593d170 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:28.152413 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-1f5d9bfe-7195-4864-a011-6e27d593d170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:28.166521 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d9bfe-7195-4864-a011-6e27d593d170 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:28.172648 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f6fcd-aeb0-4e55-8b18-c60e822f309b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:28.173376 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f6fcd-aeb0-4e55-8b18-c60e822f309b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:28.173740 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f6fcd-aeb0-4e55-8b18-c60e822f309b admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:28.174073 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f6fcd-aeb0-4e55-8b18-c60e822f309b admin admin] PATH_INFO: `/v3/projects/ffe445bc50994a9ca0204db20b96346b` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:28.175279 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f6fcd-aeb0-4e55-8b18-c60e822f309b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffe445bc50994a9ca0204db20b96346b)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:28.177279 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f6fcd-aeb0-4e55-8b18-c60e822f309b admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:28.231148 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-bb8f6fcd-aeb0-4e55-8b18-c60e822f309b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffe445bc50994a9ca0204db20b96346b', 'request_id': 'req-bb8f6fcd-aeb0-4e55-8b18-c60e822f309b'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:28.237484 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-bb8f6fcd-aeb0-4e55-8b18-c60e822f309b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffe445bc50994a9ca0204db20b96346b', 'request_id': 'req-bb8f6fcd-aeb0-4e55-8b18-c60e822f309b'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:28.246608 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-bb8f6fcd-aeb0-4e55-8b18-c60e822f309b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffe445bc50994a9ca0204db20b96346b', 'request_id': 'req-bb8f6fcd-aeb0-4e55-8b18-c60e822f309b'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:28.257474 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-bb8f6fcd-aeb0-4e55-8b18-c60e822f309b admin admin] The token cache is being invalidate because project ffe445bc50994a9ca0204db20b96346b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:55:28.257756 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-bb8f6fcd-aeb0-4e55-8b18-c60e822f309b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:28.258386 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-bb8f6fcd-aeb0-4e55-8b18-c60e822f309b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:28.259844 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1332/2654] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:55:28 2022] DELETE /identity/v3/projects/ffe445bc50994a9ca0204db20b96346b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:28.263918 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea349d5c-cbe9-4731-a278-191be31ca9e6 service neutron] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:28.274054 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea349d5c-cbe9-4731-a278-191be31ca9e6 service neutron] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:28.304482 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:28.335841 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb6e52-aa9c-4a6b-8315-ec9070e698bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:28.336474 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb6e52-aa9c-4a6b-8315-ec9070e698bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:28.336755 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb6e52-aa9c-4a6b-8315-ec9070e698bd admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:28.337026 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb6e52-aa9c-4a6b-8315-ec9070e698bd admin admin] PATH_INFO: `/v3/users/4ebcf27b66914af79bbdf7618b1c0858` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:28.338206 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb6e52-aa9c-4a6b-8315-ec9070e698bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ebcf27b66914af79bbdf7618b1c0858)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:28.340196 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb6e52-aa9c-4a6b-8315-ec9070e698bd admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:28.389278 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-3fbb6e52-aa9c-4a6b-8315-ec9070e698bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ebcf27b66914af79bbdf7618b1c0858'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:28.389999 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-3fbb6e52-aa9c-4a6b-8315-ec9070e698bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ebcf27b66914af79bbdf7618b1c0858'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:28.390688 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-3fbb6e52-aa9c-4a6b-8315-ec9070e698bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ebcf27b66914af79bbdf7618b1c0858'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:28.403176 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-3fbb6e52-aa9c-4a6b-8315-ec9070e698bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ebcf27b66914af79bbdf7618b1c0858'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:28.411967 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-3fbb6e52-aa9c-4a6b-8315-ec9070e698bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ebcf27b66914af79bbdf7618b1c0858'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:28.425062 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1323/2655] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:55:28 2022] DELETE /identity/v3/users/4ebcf27b66914af79bbdf7618b1c0858 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:28.761769 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f6fcd-aeb0-4e55-8b18-c60e822f309b admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:28.763803 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-bb8f6fcd-aeb0-4e55-8b18-c60e822f309b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:28.777635 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f6fcd-aeb0-4e55-8b18-c60e822f309b admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:28.842005 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb51cb-0946-4483-9c49-6f78b7dbe606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:28.842639 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb51cb-0946-4483-9c49-6f78b7dbe606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:28.842916 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb51cb-0946-4483-9c49-6f78b7dbe606 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:28.843182 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb51cb-0946-4483-9c49-6f78b7dbe606 admin admin] PATH_INFO: `/v3/projects/8adc86b9f4684c25870deaca85740277` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:28.844281 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb51cb-0946-4483-9c49-6f78b7dbe606 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8adc86b9f4684c25870deaca85740277)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:28.846218 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb51cb-0946-4483-9c49-6f78b7dbe606 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:28.894240 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-bdbb51cb-0946-4483-9c49-6f78b7dbe606 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8adc86b9f4684c25870deaca85740277', 'request_id': 'req-bdbb51cb-0946-4483-9c49-6f78b7dbe606'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:28.903116 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-bdbb51cb-0946-4483-9c49-6f78b7dbe606 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8adc86b9f4684c25870deaca85740277', 'request_id': 'req-bdbb51cb-0946-4483-9c49-6f78b7dbe606'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:28.912154 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-bdbb51cb-0946-4483-9c49-6f78b7dbe606 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8adc86b9f4684c25870deaca85740277', 'request_id': 'req-bdbb51cb-0946-4483-9c49-6f78b7dbe606'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:28.913562 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:28.924788 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-bdbb51cb-0946-4483-9c49-6f78b7dbe606 admin admin] The token cache is being invalidate because project 8adc86b9f4684c25870deaca85740277 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:55:28.925078 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-bdbb51cb-0946-4483-9c49-6f78b7dbe606 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:28.925740 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-bdbb51cb-0946-4483-9c49-6f78b7dbe606 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:28.927255 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1333/2656] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:55:28 2022] DELETE /identity/v3/projects/8adc86b9f4684c25870deaca85740277 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:28.932772 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332d792-74c8-49ad-ba96-2ab445c624fb None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:28.933255 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332d792-74c8-49ad-ba96-2ab445c624fb None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:28.933432 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332d792-74c8-49ad-ba96-2ab445c624fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:28.954390 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-7332d792-74c8-49ad-ba96-2ab445c624fb None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:28.955761 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-7332d792-74c8-49ad-ba96-2ab445c624fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:29.023873 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1324/2657] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:29.031715 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1a92a-ecf2-4d43-bb81-51ecfb233a34 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:29.031999 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1a92a-ecf2-4d43-bb81-51ecfb233a34 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:29.032298 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec1a92a-ecf2-4d43-bb81-51ecfb233a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:29.052452 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-bec1a92a-ecf2-4d43-bb81-51ecfb233a34 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:29.053702 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-bec1a92a-ecf2-4d43-bb81-51ecfb233a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:29.062202 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1334/2658] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:55:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:29.066675 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332d792-74c8-49ad-ba96-2ab445c624fb None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:29.077279 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332d792-74c8-49ad-ba96-2ab445c624fb None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:29.083178 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea2060-b95a-4d24-a47b-a1904b1182e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:29.083771 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea2060-b95a-4d24-a47b-a1904b1182e2 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:29.084048 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea2060-b95a-4d24-a47b-a1904b1182e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:29.084314 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea2060-b95a-4d24-a47b-a1904b1182e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:29.084958 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea2060-b95a-4d24-a47b-a1904b1182e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:55:29.085257 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea2060-b95a-4d24-a47b-a1904b1182e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:29.086890 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea2060-b95a-4d24-a47b-a1904b1182e2 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:29.099590 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1325/2659] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:55:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:55:29.104805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1a92a-ecf2-4d43-bb81-51ecfb233a34 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:29.119541 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec1a92a-ecf2-4d43-bb81-51ecfb233a34 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:29.128518 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714fa5c-0f27-47fe-ae72-a122da4b5329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:29.129207 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714fa5c-0f27-47fe-ae72-a122da4b5329 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:29.129624 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714fa5c-0f27-47fe-ae72-a122da4b5329 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:29.129938 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714fa5c-0f27-47fe-ae72-a122da4b5329 admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:29.130565 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714fa5c-0f27-47fe-ae72-a122da4b5329 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:29.132492 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714fa5c-0f27-47fe-ae72-a122da4b5329 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:29.163577 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1335/2660] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:55:29 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:29.168029 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea2060-b95a-4d24-a47b-a1904b1182e2 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:29.179483 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea2060-b95a-4d24-a47b-a1904b1182e2 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:29.212983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:29.236787 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0650f1-026c-416e-8394-7bbd072d6412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:29.237451 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0650f1-026c-416e-8394-7bbd072d6412 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:29.237732 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0650f1-026c-416e-8394-7bbd072d6412 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:29.238001 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0650f1-026c-416e-8394-7bbd072d6412 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:29.238618 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0650f1-026c-416e-8394-7bbd072d6412 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:29.240578 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0650f1-026c-416e-8394-7bbd072d6412 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:29.262604 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1326/2661] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:55:29 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:29.266890 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714fa5c-0f27-47fe-ae72-a122da4b5329 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:29.277261 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714fa5c-0f27-47fe-ae72-a122da4b5329 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:29.281933 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e173b7b-ca81-4870-9891-b0871675d777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:29.282529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e173b7b-ca81-4870-9891-b0871675d777 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:29.282796 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e173b7b-ca81-4870-9891-b0871675d777 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:29.283061 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e173b7b-ca81-4870-9891-b0871675d777 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:29.283690 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e173b7b-ca81-4870-9891-b0871675d777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:29.285286 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e173b7b-ca81-4870-9891-b0871675d777 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:29.295210 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1336/2662] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:55:29.299082 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0650f1-026c-416e-8394-7bbd072d6412 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:29.309551 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0650f1-026c-416e-8394-7bbd072d6412 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:29.315101 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc862d66-3f84-49d5-bdaa-f76fc7340007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:29.315726 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc862d66-3f84-49d5-bdaa-f76fc7340007 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:29.316045 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc862d66-3f84-49d5-bdaa-f76fc7340007 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:29.316313 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc862d66-3f84-49d5-bdaa-f76fc7340007 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:29.316955 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc862d66-3f84-49d5-bdaa-f76fc7340007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:29.318638 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc862d66-3f84-49d5-bdaa-f76fc7340007 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:29.329797 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1327/2663] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:29.333830 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e173b7b-ca81-4870-9891-b0871675d777 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:29.344190 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e173b7b-ca81-4870-9891-b0871675d777 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:29.349302 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661e56c-1ff0-4378-9e64-5fa21f67521e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:29.349971 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661e56c-1ff0-4378-9e64-5fa21f67521e admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:29.350244 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661e56c-1ff0-4378-9e64-5fa21f67521e admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:29.350505 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661e56c-1ff0-4378-9e64-5fa21f67521e admin admin] PATH_INFO: `/v3/projects/239d2367489e4ec28f9f005b8ef73c31/users/488565fe542d44f3b710d4130427d14c/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:29.370153 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5661e56c-1ff0-4378-9e64-5fa21f67521e admin admin] RBAC: Authorizing `identity:create_grant(project_id=239d2367489e4ec28f9f005b8ef73c31, user_id=488565fe542d44f3b710d4130427d14c, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:29.372811 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5661e56c-1ff0-4378-9e64-5fa21f67521e admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:29.387355 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1337/2664] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:29 2022] PUT /identity/v3/projects/239d2367489e4ec28f9f005b8ef73c31/users/488565fe542d44f3b710d4130427d14c/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:29.397942 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fab111-6085-450a-b5b2-ba1f4042c4b5 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:29.398248 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fab111-6085-450a-b5b2-ba1f4042c4b5 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:29.398523 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fab111-6085-450a-b5b2-ba1f4042c4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:29.426109 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-79fab111-6085-450a-b5b2-ba1f4042c4b5 None None] MFA Rules not processed for user `488565fe542d44f3b710d4130427d14c`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:29.427424 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-79fab111-6085-450a-b5b2-ba1f4042c4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:29.495151 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1328/2665] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:55:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:29.500560 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661e56c-1ff0-4378-9e64-5fa21f67521e admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:29.569280 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661e56c-1ff0-4378-9e64-5fa21f67521e admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:29.574742 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca0be2-830d-420e-b5b3-8608a5b2bb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:29.575333 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca0be2-830d-420e-b5b3-8608a5b2bb87 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:29.575606 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca0be2-830d-420e-b5b3-8608a5b2bb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:29.575888 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca0be2-830d-420e-b5b3-8608a5b2bb87 admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:29.576526 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca0be2-830d-420e-b5b3-8608a5b2bb87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:29.578457 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca0be2-830d-420e-b5b3-8608a5b2bb87 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:29.607294 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1338/2666] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:55:29 2022] POST /identity/v3/projects => generated 373 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:29.611491 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fab111-6085-450a-b5b2-ba1f4042c4b5 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:29.622524 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fab111-6085-450a-b5b2-ba1f4042c4b5 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:29.680871 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbdc8a-9f44-46af-b854-7b640512f572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:29.681519 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbdc8a-9f44-46af-b854-7b640512f572 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:29.681807 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbdc8a-9f44-46af-b854-7b640512f572 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:29.682083 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbdc8a-9f44-46af-b854-7b640512f572 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:29.682712 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fbdc8a-9f44-46af-b854-7b640512f572 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:29.684650 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fbdc8a-9f44-46af-b854-7b640512f572 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:29.710454 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1329/2667] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:55:29 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:29.715201 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca0be2-830d-420e-b5b3-8608a5b2bb87 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:29.729461 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca0be2-830d-420e-b5b3-8608a5b2bb87 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:29.735026 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95fa0e1-565d-4a76-8d22-e9118600233b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:29.735623 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fa0e1-565d-4a76-8d22-e9118600233b admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:29.735893 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fa0e1-565d-4a76-8d22-e9118600233b admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:29.736157 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fa0e1-565d-4a76-8d22-e9118600233b admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:29.736791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95fa0e1-565d-4a76-8d22-e9118600233b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:29.738422 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95fa0e1-565d-4a76-8d22-e9118600233b admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:29.749625 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1339/2668] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:29.753803 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbdc8a-9f44-46af-b854-7b640512f572 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:29.764693 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbdc8a-9f44-46af-b854-7b640512f572 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:29.770693 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70990af8-7d2a-4e13-8a7a-34673b736976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:29.771367 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70990af8-7d2a-4e13-8a7a-34673b736976 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:29.771626 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70990af8-7d2a-4e13-8a7a-34673b736976 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:29.771923 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70990af8-7d2a-4e13-8a7a-34673b736976 admin admin] PATH_INFO: `/v3/projects/f1a088769f8242eca2ae4db54c9a5f09/users/45f9ee957f2245458390d8e8ee2e9a26/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:29.788412 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70990af8-7d2a-4e13-8a7a-34673b736976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1a088769f8242eca2ae4db54c9a5f09, user_id=45f9ee957f2245458390d8e8ee2e9a26, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:29.791141 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70990af8-7d2a-4e13-8a7a-34673b736976 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:29.807040 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1330/2669] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:29 2022] PUT /identity/v3/projects/f1a088769f8242eca2ae4db54c9a5f09/users/45f9ee957f2245458390d8e8ee2e9a26/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:29.811219 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95fa0e1-565d-4a76-8d22-e9118600233b admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:29.823323 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95fa0e1-565d-4a76-8d22-e9118600233b admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:29.885018 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b196bb3-b5d6-4fb4-bebc-64f41a3970eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:29.885579 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b196bb3-b5d6-4fb4-bebc-64f41a3970eb admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:29.885863 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b196bb3-b5d6-4fb4-bebc-64f41a3970eb admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:29.886130 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b196bb3-b5d6-4fb4-bebc-64f41a3970eb admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:29.886772 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b196bb3-b5d6-4fb4-bebc-64f41a3970eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:29.888386 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b196bb3-b5d6-4fb4-bebc-64f41a3970eb admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:29.889871 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:29.901688 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1340/2670] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:55:29.905694 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70990af8-7d2a-4e13-8a7a-34673b736976 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:29.916148 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70990af8-7d2a-4e13-8a7a-34673b736976 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:29.920877 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54c9db-711e-4c5a-92db-c822a07e2be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:29.921568 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54c9db-711e-4c5a-92db-c822a07e2be9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:29.921847 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54c9db-711e-4c5a-92db-c822a07e2be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:29.922119 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b54c9db-711e-4c5a-92db-c822a07e2be9 admin admin] PATH_INFO: `/v3/projects/f1a088769f8242eca2ae4db54c9a5f09/users/45f9ee957f2245458390d8e8ee2e9a26/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:29.924075 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b54c9db-711e-4c5a-92db-c822a07e2be9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1a088769f8242eca2ae4db54c9a5f09, user_id=45f9ee957f2245458390d8e8ee2e9a26, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:29.926820 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b54c9db-711e-4c5a-92db-c822a07e2be9 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:29.932730 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:29.939380 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1331/2671] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:29 2022] PUT /identity/v3/projects/f1a088769f8242eca2ae4db54c9a5f09/users/45f9ee957f2245458390d8e8ee2e9a26/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:29.950895 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf20be9-8b00-4d70-9eab-189d4123f146 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:29.951176 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf20be9-8b00-4d70-9eab-189d4123f146 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:29.951448 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf20be9-8b00-4d70-9eab-189d4123f146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:29.980451 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-acf20be9-8b00-4d70-9eab-189d4123f146 None None] MFA Rules not processed for user `45f9ee957f2245458390d8e8ee2e9a26`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:29.981677 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-acf20be9-8b00-4d70-9eab-189d4123f146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:30.049586 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1341/2672] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:55:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:30.061986 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54c9db-711e-4c5a-92db-c822a07e2be9 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:30.063892 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-4b54c9db-711e-4c5a-92db-c822a07e2be9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:30.123290 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b54c9db-711e-4c5a-92db-c822a07e2be9 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:30.127727 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ac3b2-4861-47f4-9434-107f7ca3f4c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:30.128315 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ac3b2-4861-47f4-9434-107f7ca3f4c6 service cinder] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:30.128613 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ac3b2-4861-47f4-9434-107f7ca3f4c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:30.128880 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ac3b2-4861-47f4-9434-107f7ca3f4c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:30.142775 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ac3b2-4861-47f4-9434-107f7ca3f4c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:30.144661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ac3b2-4861-47f4-9434-107f7ca3f4c6 service cinder] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:30.155237 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1332/2673] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:30.586808 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf20be9-8b00-4d70-9eab-189d4123f146 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:30.654573 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf20be9-8b00-4d70-9eab-189d4123f146 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:30.659309 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a65881-5253-4330-a9de-42283fb1113e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:30.659956 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a65881-5253-4330-a9de-42283fb1113e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:30.660266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a65881-5253-4330-a9de-42283fb1113e admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:30.660537 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a65881-5253-4330-a9de-42283fb1113e admin admin] PATH_INFO: `/v3/users/488565fe542d44f3b710d4130427d14c` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:30.661763 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a65881-5253-4330-a9de-42283fb1113e admin admin] RBAC: Authorizing `identity:delete_user(user_id=488565fe542d44f3b710d4130427d14c)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:30.663726 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a65881-5253-4330-a9de-42283fb1113e admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:30.718791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b0a65881-5253-4330-a9de-42283fb1113e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '488565fe542d44f3b710d4130427d14c'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:30.719761 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b0a65881-5253-4330-a9de-42283fb1113e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '488565fe542d44f3b710d4130427d14c'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:30.720862 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b0a65881-5253-4330-a9de-42283fb1113e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '488565fe542d44f3b710d4130427d14c'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:30.735868 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b0a65881-5253-4330-a9de-42283fb1113e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '488565fe542d44f3b710d4130427d14c'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:30.744848 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b0a65881-5253-4330-a9de-42283fb1113e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '488565fe542d44f3b710d4130427d14c'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:30.753270 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:30.757864 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1342/2674] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:55:30 2022] DELETE /identity/v3/users/488565fe542d44f3b710d4130427d14c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:30.762435 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4523cf-146e-464d-9c63-2f524175846b None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:30.762719 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4523cf-146e-464d-9c63-2f524175846b None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:30.762995 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4523cf-146e-464d-9c63-2f524175846b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:30.781846 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-cb4523cf-146e-464d-9c63-2f524175846b None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:30.783040 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-cb4523cf-146e-464d-9c63-2f524175846b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:30.842349 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1333/2675] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:30.854134 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a65881-5253-4330-a9de-42283fb1113e admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:30.855673 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-b0a65881-5253-4330-a9de-42283fb1113e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:30.914160 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a65881-5253-4330-a9de-42283fb1113e admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:30.918728 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f5612-ddf8-4242-8911-8f3a7edcac33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:30.919341 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f5612-ddf8-4242-8911-8f3a7edcac33 service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:30.919618 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f5612-ddf8-4242-8911-8f3a7edcac33 service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:30.919883 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f5612-ddf8-4242-8911-8f3a7edcac33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:30.929967 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f5612-ddf8-4242-8911-8f3a7edcac33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:30.931387 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f5612-ddf8-4242-8911-8f3a7edcac33 service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:30.941092 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1343/2676] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:31.253882 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4523cf-146e-464d-9c63-2f524175846b None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:31.255611 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-cb4523cf-146e-464d-9c63-2f524175846b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:31.272096 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4523cf-146e-464d-9c63-2f524175846b None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:31.277793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e0eb3-f8cf-4b15-b050-9c7f508855b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:31.278509 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e0eb3-f8cf-4b15-b050-9c7f508855b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:31.278851 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e0eb3-f8cf-4b15-b050-9c7f508855b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:31.279234 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e0eb3-f8cf-4b15-b050-9c7f508855b3 admin admin] PATH_INFO: `/v3/projects/239d2367489e4ec28f9f005b8ef73c31` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:31.280637 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e0eb3-f8cf-4b15-b050-9c7f508855b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=239d2367489e4ec28f9f005b8ef73c31)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:31.283009 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e0eb3-f8cf-4b15-b050-9c7f508855b3 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:31.346944 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-670e0eb3-f8cf-4b15-b050-9c7f508855b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '239d2367489e4ec28f9f005b8ef73c31', 'request_id': 'req-670e0eb3-f8cf-4b15-b050-9c7f508855b3'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:31.358356 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-670e0eb3-f8cf-4b15-b050-9c7f508855b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '239d2367489e4ec28f9f005b8ef73c31', 'request_id': 'req-670e0eb3-f8cf-4b15-b050-9c7f508855b3'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:31.364777 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-670e0eb3-f8cf-4b15-b050-9c7f508855b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '239d2367489e4ec28f9f005b8ef73c31', 'request_id': 'req-670e0eb3-f8cf-4b15-b050-9c7f508855b3'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:31.376202 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-670e0eb3-f8cf-4b15-b050-9c7f508855b3 admin admin] The token cache is being invalidate because project 239d2367489e4ec28f9f005b8ef73c31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:55:31.376480 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-670e0eb3-f8cf-4b15-b050-9c7f508855b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:31.377154 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-670e0eb3-f8cf-4b15-b050-9c7f508855b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:31.378693 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1334/2677] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:55:31 2022] DELETE /identity/v3/projects/239d2367489e4ec28f9f005b8ef73c31 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:31.382855 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f5612-ddf8-4242-8911-8f3a7edcac33 service neutron] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:31.392833 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f5612-ddf8-4242-8911-8f3a7edcac33 service neutron] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:31.455384 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed028170-4500-404d-b6bb-a9b9038fd812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:31.455945 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed028170-4500-404d-b6bb-a9b9038fd812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:31.456221 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed028170-4500-404d-b6bb-a9b9038fd812 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:31.456521 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed028170-4500-404d-b6bb-a9b9038fd812 admin admin] PATH_INFO: `/v3/users/45f9ee957f2245458390d8e8ee2e9a26` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:31.458205 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed028170-4500-404d-b6bb-a9b9038fd812 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45f9ee957f2245458390d8e8ee2e9a26)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:31.460837 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed028170-4500-404d-b6bb-a9b9038fd812 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:31.516416 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-ed028170-4500-404d-b6bb-a9b9038fd812 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45f9ee957f2245458390d8e8ee2e9a26'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:31.517074 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-ed028170-4500-404d-b6bb-a9b9038fd812 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45f9ee957f2245458390d8e8ee2e9a26'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:31.517738 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-ed028170-4500-404d-b6bb-a9b9038fd812 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45f9ee957f2245458390d8e8ee2e9a26'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:31.530734 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-ed028170-4500-404d-b6bb-a9b9038fd812 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45f9ee957f2245458390d8e8ee2e9a26'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:31.539341 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-ed028170-4500-404d-b6bb-a9b9038fd812 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45f9ee957f2245458390d8e8ee2e9a26'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:31.554518 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1344/2678] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:55:31 2022] DELETE /identity/v3/users/45f9ee957f2245458390d8e8ee2e9a26 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:55:31.832930 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e0eb3-f8cf-4b15-b050-9c7f508855b3 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:31.834620 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-670e0eb3-f8cf-4b15-b050-9c7f508855b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:31.849247 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e0eb3-f8cf-4b15-b050-9c7f508855b3 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:31.871876 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:31.912997 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4fac9d-4a21-4035-8208-6555a0f71027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:31.913833 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fac9d-4a21-4035-8208-6555a0f71027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:31.914102 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fac9d-4a21-4035-8208-6555a0f71027 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:31.914372 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fac9d-4a21-4035-8208-6555a0f71027 admin admin] PATH_INFO: `/v3/projects/f1a088769f8242eca2ae4db54c9a5f09` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:31.915531 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4fac9d-4a21-4035-8208-6555a0f71027 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1a088769f8242eca2ae4db54c9a5f09)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:31.917527 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4fac9d-4a21-4035-8208-6555a0f71027 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:31.968439 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-5f4fac9d-4a21-4035-8208-6555a0f71027 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1a088769f8242eca2ae4db54c9a5f09', 'request_id': 'req-5f4fac9d-4a21-4035-8208-6555a0f71027'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:31.978870 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-5f4fac9d-4a21-4035-8208-6555a0f71027 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1a088769f8242eca2ae4db54c9a5f09', 'request_id': 'req-5f4fac9d-4a21-4035-8208-6555a0f71027'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:31.986096 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-5f4fac9d-4a21-4035-8208-6555a0f71027 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1a088769f8242eca2ae4db54c9a5f09', 'request_id': 'req-5f4fac9d-4a21-4035-8208-6555a0f71027'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:31.998068 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-5f4fac9d-4a21-4035-8208-6555a0f71027 admin admin] The token cache is being invalidate because project f1a088769f8242eca2ae4db54c9a5f09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:55:31.998366 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-5f4fac9d-4a21-4035-8208-6555a0f71027 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:31.999012 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-5f4fac9d-4a21-4035-8208-6555a0f71027 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:32.000555 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1335/2679] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:55:31 2022] DELETE /identity/v3/projects/f1a088769f8242eca2ae4db54c9a5f09 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:32.006015 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dde67-2eb5-4a03-ae73-efedde961bbd None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:32.006527 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dde67-2eb5-4a03-ae73-efedde961bbd None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:32.006527 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dde67-2eb5-4a03-ae73-efedde961bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:32.027643 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-b97dde67-2eb5-4a03-ae73-efedde961bbd None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:32.028862 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-b97dde67-2eb5-4a03-ae73-efedde961bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:32.046850 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:32.090640 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1345/2680] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:32.099035 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ddd6f-8337-4bcd-ae12-ae38549b18f5 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:32.099322 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ddd6f-8337-4bcd-ae12-ae38549b18f5 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:32.099599 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ddd6f-8337-4bcd-ae12-ae38549b18f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:32.120315 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-d41ddd6f-8337-4bcd-ae12-ae38549b18f5 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:32.121587 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-d41ddd6f-8337-4bcd-ae12-ae38549b18f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:32.130667 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1336/2681] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:32.135122 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97dde67-2eb5-4a03-ae73-efedde961bbd None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:32.145586 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97dde67-2eb5-4a03-ae73-efedde961bbd None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:32.151359 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec8c89-11fd-40ac-b292-3f4c0ebe470b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:32.152001 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec8c89-11fd-40ac-b292-3f4c0ebe470b admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:32.152278 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec8c89-11fd-40ac-b292-3f4c0ebe470b admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:32.152526 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec8c89-11fd-40ac-b292-3f4c0ebe470b admin admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:32.153204 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec8c89-11fd-40ac-b292-3f4c0ebe470b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:55:32.153511 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec8c89-11fd-40ac-b292-3f4c0ebe470b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:32.155169 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec8c89-11fd-40ac-b292-3f4c0ebe470b admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:32.167247 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1346/2682] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:55:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:55:32.171860 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ddd6f-8337-4bcd-ae12-ae38549b18f5 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:32.181360 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ddd6f-8337-4bcd-ae12-ae38549b18f5 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:32.186581 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4e8c7-d1bc-4e3f-b9c8-ecc582c3c029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:32.187206 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4e8c7-d1bc-4e3f-b9c8-ecc582c3c029 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:32.187488 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4e8c7-d1bc-4e3f-b9c8-ecc582c3c029 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:32.187763 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4e8c7-d1bc-4e3f-b9c8-ecc582c3c029 admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:32.188386 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4e8c7-d1bc-4e3f-b9c8-ecc582c3c029 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:32.190341 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e4e8c7-d1bc-4e3f-b9c8-ecc582c3c029 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:32.222817 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1337/2683] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:55:32 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:55:32.225193 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec8c89-11fd-40ac-b292-3f4c0ebe470b admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:32.235934 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec8c89-11fd-40ac-b292-3f4c0ebe470b admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:32.299942 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075e8a2-d830-48c1-9891-aa9ad44324e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:32.300627 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075e8a2-d830-48c1-9891-aa9ad44324e2 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:32.300903 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075e8a2-d830-48c1-9891-aa9ad44324e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:32.301190 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075e8a2-d830-48c1-9891-aa9ad44324e2 admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:32.301911 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075e8a2-d830-48c1-9891-aa9ad44324e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:32.303817 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075e8a2-d830-48c1-9891-aa9ad44324e2 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:32.325529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1347/2684] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:55:32 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:32.329747 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4e8c7-d1bc-4e3f-b9c8-ecc582c3c029 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:32.340636 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4e8c7-d1bc-4e3f-b9c8-ecc582c3c029 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:32.345283 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc360b2-25a7-4f2b-ba51-bc47d88fcb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:32.345947 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc360b2-25a7-4f2b-ba51-bc47d88fcb65 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:32.346628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc360b2-25a7-4f2b-ba51-bc47d88fcb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:32.346628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc360b2-25a7-4f2b-ba51-bc47d88fcb65 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:32.347140 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc360b2-25a7-4f2b-ba51-bc47d88fcb65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:32.349111 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc360b2-25a7-4f2b-ba51-bc47d88fcb65 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:32.359630 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1338/2685] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:55:32.363796 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075e8a2-d830-48c1-9891-aa9ad44324e2 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:32.374214 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075e8a2-d830-48c1-9891-aa9ad44324e2 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:32.379069 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56b52c-1e87-417d-aa80-937a743dceaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:32.379706 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56b52c-1e87-417d-aa80-937a743dceaa admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:32.379988 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56b52c-1e87-417d-aa80-937a743dceaa admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:32.380261 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56b52c-1e87-417d-aa80-937a743dceaa admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:32.380907 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56b52c-1e87-417d-aa80-937a743dceaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:32.382531 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56b52c-1e87-417d-aa80-937a743dceaa admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:32.394662 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1348/2686] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:32.399243 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc360b2-25a7-4f2b-ba51-bc47d88fcb65 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:32.409939 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc360b2-25a7-4f2b-ba51-bc47d88fcb65 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:32.415124 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521a3c3-692d-4d94-b678-505ab870b57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:32.415774 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521a3c3-692d-4d94-b678-505ab870b57c admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:32.416053 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521a3c3-692d-4d94-b678-505ab870b57c admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:32.416327 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521a3c3-692d-4d94-b678-505ab870b57c admin admin] PATH_INFO: `/v3/projects/bf55ef0c6fe04a53ab502535c59870a9/users/3d6b20c44d9648999eceaa6fbdc66ad2/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:32.431719 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521a3c3-692d-4d94-b678-505ab870b57c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf55ef0c6fe04a53ab502535c59870a9, user_id=3d6b20c44d9648999eceaa6fbdc66ad2, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:32.434572 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521a3c3-692d-4d94-b678-505ab870b57c admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:32.449856 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1339/2687] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:32 2022] PUT /identity/v3/projects/bf55ef0c6fe04a53ab502535c59870a9/users/3d6b20c44d9648999eceaa6fbdc66ad2/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:32.460420 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667968cb-7d4f-4e4e-91f9-e9b1a575f992 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:32.460705 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667968cb-7d4f-4e4e-91f9-e9b1a575f992 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:32.460978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667968cb-7d4f-4e4e-91f9-e9b1a575f992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:32.490449 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-667968cb-7d4f-4e4e-91f9-e9b1a575f992 None None] MFA Rules not processed for user `3d6b20c44d9648999eceaa6fbdc66ad2`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:32.491581 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-667968cb-7d4f-4e4e-91f9-e9b1a575f992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:32.558523 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1349/2688] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:55:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:32.564717 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521a3c3-692d-4d94-b678-505ab870b57c admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:32.620553 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:32.633087 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521a3c3-692d-4d94-b678-505ab870b57c admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:32.639218 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f897f-2389-437e-bea5-eb9bf3c15168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:32.639834 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f897f-2389-437e-bea5-eb9bf3c15168 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:32.640117 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f897f-2389-437e-bea5-eb9bf3c15168 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:32.640388 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f897f-2389-437e-bea5-eb9bf3c15168 admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:32.641026 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f897f-2389-437e-bea5-eb9bf3c15168 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:32.643026 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f897f-2389-437e-bea5-eb9bf3c15168 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:32.672776 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1340/2689] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:55:32 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:55:32.677522 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667968cb-7d4f-4e4e-91f9-e9b1a575f992 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:32.689229 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667968cb-7d4f-4e4e-91f9-e9b1a575f992 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:32.703192 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:32.751285 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47d6f9-a577-4896-b457-313bf03dd779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:32.751809 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47d6f9-a577-4896-b457-313bf03dd779 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:32.752082 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47d6f9-a577-4896-b457-313bf03dd779 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:32.752349 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47d6f9-a577-4896-b457-313bf03dd779 admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:32.752961 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d47d6f9-a577-4896-b457-313bf03dd779 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:32.754954 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d47d6f9-a577-4896-b457-313bf03dd779 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:32.777763 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1350/2690] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:55:32 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:32.781990 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f897f-2389-437e-bea5-eb9bf3c15168 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:32.792672 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f897f-2389-437e-bea5-eb9bf3c15168 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:32.798484 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a30f5-196f-4b92-92fc-9f543caf8900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:32.799089 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a30f5-196f-4b92-92fc-9f543caf8900 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:32.799365 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a30f5-196f-4b92-92fc-9f543caf8900 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:32.799636 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7a30f5-196f-4b92-92fc-9f543caf8900 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:32.800262 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a30f5-196f-4b92-92fc-9f543caf8900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:32.801927 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7a30f5-196f-4b92-92fc-9f543caf8900 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:32.813079 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1341/2691] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:32.817410 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47d6f9-a577-4896-b457-313bf03dd779 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:32.827619 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47d6f9-a577-4896-b457-313bf03dd779 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:32.832380 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f024e0-f084-4206-a977-d6af08bc5885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:32.832962 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f024e0-f084-4206-a977-d6af08bc5885 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:32.833235 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f024e0-f084-4206-a977-d6af08bc5885 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:32.833533 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f024e0-f084-4206-a977-d6af08bc5885 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:32.834168 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f024e0-f084-4206-a977-d6af08bc5885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:32.835733 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f024e0-f084-4206-a977-d6af08bc5885 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:32.845780 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1351/2692] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:55:32.850473 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a30f5-196f-4b92-92fc-9f543caf8900 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:32.860696 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7a30f5-196f-4b92-92fc-9f543caf8900 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:32.865665 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2918018-8ded-47cb-8f8f-688aa656e17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:32.866315 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2918018-8ded-47cb-8f8f-688aa656e17f admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:32.866592 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2918018-8ded-47cb-8f8f-688aa656e17f admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:32.866866 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2918018-8ded-47cb-8f8f-688aa656e17f admin admin] PATH_INFO: `/v3/projects/dcef2a9a3ab94b95b5a547b16d631286/users/ed72dcca56724d7c93e6fd9ca1549018/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:32.882670 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2918018-8ded-47cb-8f8f-688aa656e17f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcef2a9a3ab94b95b5a547b16d631286, user_id=ed72dcca56724d7c93e6fd9ca1549018, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:32.885429 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2918018-8ded-47cb-8f8f-688aa656e17f admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:32.900710 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1342/2693] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:32 2022] PUT /identity/v3/projects/dcef2a9a3ab94b95b5a547b16d631286/users/ed72dcca56724d7c93e6fd9ca1549018/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:55:32.912441 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed2ed2-eeb3-42d5-ae44-30457900add6 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:32.912730 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed2ed2-eeb3-42d5-ae44-30457900add6 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:32.913003 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed2ed2-eeb3-42d5-ae44-30457900add6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:32.942623 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-62ed2ed2-eeb3-42d5-ae44-30457900add6 None None] MFA Rules not processed for user `ed72dcca56724d7c93e6fd9ca1549018`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:32.943840 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-62ed2ed2-eeb3-42d5-ae44-30457900add6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:33.012769 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1352/2694] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:55:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:33.017538 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2918018-8ded-47cb-8f8f-688aa656e17f admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:33.088213 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2918018-8ded-47cb-8f8f-688aa656e17f admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:33.094042 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936633b-1dba-4309-b339-15b4ce28a8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:33.094640 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936633b-1dba-4309-b339-15b4ce28a8ea admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:33.094915 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936633b-1dba-4309-b339-15b4ce28a8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:33.095189 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936633b-1dba-4309-b339-15b4ce28a8ea admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:33.095831 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936633b-1dba-4309-b339-15b4ce28a8ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:33.097751 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936633b-1dba-4309-b339-15b4ce28a8ea admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:33.126487 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1343/2695] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:55:33 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:33.132751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed2ed2-eeb3-42d5-ae44-30457900add6 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:33.144345 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed2ed2-eeb3-42d5-ae44-30457900add6 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:33.203886 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9d12b-0ed6-4781-a6b1-ca6633d814a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:33.204498 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9d12b-0ed6-4781-a6b1-ca6633d814a7 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:33.204775 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9d12b-0ed6-4781-a6b1-ca6633d814a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:33.205044 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9d12b-0ed6-4781-a6b1-ca6633d814a7 admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:33.205707 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9d12b-0ed6-4781-a6b1-ca6633d814a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:33.207661 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9d12b-0ed6-4781-a6b1-ca6633d814a7 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:33.231695 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1353/2696] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:55:33 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:33.235921 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936633b-1dba-4309-b339-15b4ce28a8ea admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:33.246658 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936633b-1dba-4309-b339-15b4ce28a8ea admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:33.251703 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceffbce-e93a-4482-902e-a8c29f490d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:33.252302 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceffbce-e93a-4482-902e-a8c29f490d6e admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:33.252580 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceffbce-e93a-4482-902e-a8c29f490d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:33.252855 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceffbce-e93a-4482-902e-a8c29f490d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:33.253538 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceffbce-e93a-4482-902e-a8c29f490d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:33.255142 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceffbce-e93a-4482-902e-a8c29f490d6e admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:33.270236 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1344/2697] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:33.274458 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9d12b-0ed6-4781-a6b1-ca6633d814a7 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:33.284476 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9d12b-0ed6-4781-a6b1-ca6633d814a7 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:33.290040 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136446c-536b-40d2-86c6-d6ef4b744149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:33.290040 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136446c-536b-40d2-86c6-d6ef4b744149 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:33.290308 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136446c-536b-40d2-86c6-d6ef4b744149 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:33.290561 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136446c-536b-40d2-86c6-d6ef4b744149 admin admin] PATH_INFO: `/v3/projects/80319e11c6f64f2a95165118d83034fc/users/635b18f2ae3c40cca8dae702b334f770/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:33.303060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:33.306445 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4136446c-536b-40d2-86c6-d6ef4b744149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80319e11c6f64f2a95165118d83034fc, user_id=635b18f2ae3c40cca8dae702b334f770, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:33.309693 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4136446c-536b-40d2-86c6-d6ef4b744149 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:33.324549 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1354/2698] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:33 2022] PUT /identity/v3/projects/80319e11c6f64f2a95165118d83034fc/users/635b18f2ae3c40cca8dae702b334f770/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:33.328705 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceffbce-e93a-4482-902e-a8c29f490d6e admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:33.339199 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceffbce-e93a-4482-902e-a8c29f490d6e admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:33.405170 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73bba95-ccdd-4586-bb48-a28ece34a618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:33.405808 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bba95-ccdd-4586-bb48-a28ece34a618 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:33.406122 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bba95-ccdd-4586-bb48-a28ece34a618 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:33.406353 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73bba95-ccdd-4586-bb48-a28ece34a618 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:33.407001 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73bba95-ccdd-4586-bb48-a28ece34a618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:33.408612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73bba95-ccdd-4586-bb48-a28ece34a618 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:33.419407 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1345/2699] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:33.423668 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136446c-536b-40d2-86c6-d6ef4b744149 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:33.435045 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136446c-536b-40d2-86c6-d6ef4b744149 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:33.440760 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e4b5c-181e-4f7f-9e52-c78545fac7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:33.441429 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e4b5c-181e-4f7f-9e52-c78545fac7d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:33.441707 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e4b5c-181e-4f7f-9e52-c78545fac7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:33.442020 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e4b5c-181e-4f7f-9e52-c78545fac7d8 admin admin] PATH_INFO: `/v3/projects/80319e11c6f64f2a95165118d83034fc/users/635b18f2ae3c40cca8dae702b334f770/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:33.443998 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e4b5c-181e-4f7f-9e52-c78545fac7d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80319e11c6f64f2a95165118d83034fc, user_id=635b18f2ae3c40cca8dae702b334f770, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:33.446658 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e4b5c-181e-4f7f-9e52-c78545fac7d8 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:33.457698 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1355/2700] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:33 2022] PUT /identity/v3/projects/80319e11c6f64f2a95165118d83034fc/users/635b18f2ae3c40cca8dae702b334f770/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:33.468014 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495df3dd-c7cd-4109-b439-b6534c0a1bd7 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:33.468301 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495df3dd-c7cd-4109-b439-b6534c0a1bd7 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:33.468571 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495df3dd-c7cd-4109-b439-b6534c0a1bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:33.489752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:33.498179 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-495df3dd-c7cd-4109-b439-b6534c0a1bd7 None None] MFA Rules not processed for user `635b18f2ae3c40cca8dae702b334f770`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:33.500137 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-495df3dd-c7cd-4109-b439-b6534c0a1bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:33.570866 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1346/2701] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:55:33 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:33.582039 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e4b5c-181e-4f7f-9e52-c78545fac7d8 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:33.583829 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-879e4b5c-181e-4f7f-9e52-c78545fac7d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:33.640892 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e4b5c-181e-4f7f-9e52-c78545fac7d8 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:33.645393 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9435472-ccf5-47ec-8da0-1227dfa8a376 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:33.645994 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9435472-ccf5-47ec-8da0-1227dfa8a376 service cinder] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:33.646250 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9435472-ccf5-47ec-8da0-1227dfa8a376 service cinder] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:33.646532 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9435472-ccf5-47ec-8da0-1227dfa8a376 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:33.703404 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9435472-ccf5-47ec-8da0-1227dfa8a376 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:33.704829 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9435472-ccf5-47ec-8da0-1227dfa8a376 service cinder] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:33.713762 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1356/2702] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:35.236618 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495df3dd-c7cd-4109-b439-b6534c0a1bd7 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:35.238849 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-495df3dd-c7cd-4109-b439-b6534c0a1bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:35.252699 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495df3dd-c7cd-4109-b439-b6534c0a1bd7 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:35.257195 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c338f-7f4d-45fa-a66e-419c7e97e3fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:35.257868 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c338f-7f4d-45fa-a66e-419c7e97e3fe service cinder] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:35.258142 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c338f-7f4d-45fa-a66e-419c7e97e3fe service cinder] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:35.258407 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c338f-7f4d-45fa-a66e-419c7e97e3fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:35.321172 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c338f-7f4d-45fa-a66e-419c7e97e3fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:35.322602 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c338f-7f4d-45fa-a66e-419c7e97e3fe service cinder] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:35.331812 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1347/2703] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:35.471794 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf07056-1737-499c-a88b-efba92f138e1 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:35.472377 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf07056-1737-499c-a88b-efba92f138e1 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:35.472377 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf07056-1737-499c-a88b-efba92f138e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:35.493323 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-2cf07056-1737-499c-a88b-efba92f138e1 None None] MFA Rules not processed for user `c737c4586910476eafead0dfd4d9bc4c`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:35.494971 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-2cf07056-1737-499c-a88b-efba92f138e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:35.556511 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1357/2704] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 24 04:55:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:35.569178 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c338f-7f4d-45fa-a66e-419c7e97e3fe service cinder] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:35.570655 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-c46c338f-7f4d-45fa-a66e-419c7e97e3fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:35.643607 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c338f-7f4d-45fa-a66e-419c7e97e3fe service cinder] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:35.649405 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a14c1-f4fa-4c9a-be68-467ca2455d79 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ebb5105220438693118d734c9fda70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:35.650003 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a14c1-f4fa-4c9a-be68-467ca2455d79 service swift] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:35.650329 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a14c1-f4fa-4c9a-be68-467ca2455d79 service swift] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:35.650601 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a14c1-f4fa-4c9a-be68-467ca2455d79 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:35.658999 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a14c1-f4fa-4c9a-be68-467ca2455d79 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:35.660644 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a14c1-f4fa-4c9a-be68-467ca2455d79 service swift] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:35.669035 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1348/2705] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 24 04:55:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:55:35.960745 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf07056-1737-499c-a88b-efba92f138e1 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:35.972366 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf07056-1737-499c-a88b-efba92f138e1 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:35.979547 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9bf1dc-e760-4bbc-9463-e77a843817b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:35.980355 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bf1dc-e760-4bbc-9463-e77a843817b7 service cinder] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:35.980695 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bf1dc-e760-4bbc-9463-e77a843817b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:35.981030 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bf1dc-e760-4bbc-9463-e77a843817b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:35.991794 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9bf1dc-e760-4bbc-9463-e77a843817b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:35.993252 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9bf1dc-e760-4bbc-9463-e77a843817b7 service cinder] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:36.004188 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1358/2706] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:35 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:40.002515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a14c1-f4fa-4c9a-be68-467ca2455d79 service swift] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:40.034011 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=100 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:40.079516 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a14c1-f4fa-4c9a-be68-467ca2455d79 service swift] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:40.084670 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e445de-1803-4d9e-af7b-b81bcbdff601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:40.085487 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e445de-1803-4d9e-af7b-b81bcbdff601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:40.085778 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e445de-1803-4d9e-af7b-b81bcbdff601 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:40.086053 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e445de-1803-4d9e-af7b-b81bcbdff601 admin admin] PATH_INFO: `/v3/users/3d6b20c44d9648999eceaa6fbdc66ad2` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:40.087205 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e445de-1803-4d9e-af7b-b81bcbdff601 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d6b20c44d9648999eceaa6fbdc66ad2)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:40.089298 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e445de-1803-4d9e-af7b-b81bcbdff601 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:40.156016 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-70e445de-1803-4d9e-af7b-b81bcbdff601 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d6b20c44d9648999eceaa6fbdc66ad2'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:40.157311 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-70e445de-1803-4d9e-af7b-b81bcbdff601 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d6b20c44d9648999eceaa6fbdc66ad2'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:40.158808 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-70e445de-1803-4d9e-af7b-b81bcbdff601 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d6b20c44d9648999eceaa6fbdc66ad2'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:40.175353 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-70e445de-1803-4d9e-af7b-b81bcbdff601 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d6b20c44d9648999eceaa6fbdc66ad2'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:40.186261 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-70e445de-1803-4d9e-af7b-b81bcbdff601 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d6b20c44d9648999eceaa6fbdc66ad2'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:40.201462 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1349/2707] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:55:40 2022] DELETE /identity/v3/users/3d6b20c44d9648999eceaa6fbdc66ad2 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:40.205842 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233fe96-4e2b-4116-83f5-067c14d3aa8a None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:40.206300 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233fe96-4e2b-4116-83f5-067c14d3aa8a None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:40.206383 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233fe96-4e2b-4116-83f5-067c14d3aa8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:40.226748 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-9233fe96-4e2b-4116-83f5-067c14d3aa8a None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:40.228126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-9233fe96-4e2b-4116-83f5-067c14d3aa8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:40.249041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:40.293590 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1359/2708] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:55:40.304232 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e445de-1803-4d9e-af7b-b81bcbdff601 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:40.305777 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-70e445de-1803-4d9e-af7b-b81bcbdff601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:40.378035 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e445de-1803-4d9e-af7b-b81bcbdff601 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:40.383653 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a0b00-4f7c-4a93-b841-16e30c40d86f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:40.384278 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a0b00-4f7c-4a93-b841-16e30c40d86f service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:40.384556 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a0b00-4f7c-4a93-b841-16e30c40d86f service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:40.384828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a0b00-4f7c-4a93-b841-16e30c40d86f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:40.395032 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a0b00-4f7c-4a93-b841-16e30c40d86f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:40.396820 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a0b00-4f7c-4a93-b841-16e30c40d86f service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:40.409106 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1350/2709] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:40.762921 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233fe96-4e2b-4116-83f5-067c14d3aa8a None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:40.764892 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-9233fe96-4e2b-4116-83f5-067c14d3aa8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:40.789817 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233fe96-4e2b-4116-83f5-067c14d3aa8a None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:40.796187 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f25f5-53bf-4db1-8c9c-eb49281132fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:40.796964 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f25f5-53bf-4db1-8c9c-eb49281132fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:40.797116 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f25f5-53bf-4db1-8c9c-eb49281132fc admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:40.797422 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f25f5-53bf-4db1-8c9c-eb49281132fc admin admin] PATH_INFO: `/v3/projects/bf55ef0c6fe04a53ab502535c59870a9` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:40.798791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f25f5-53bf-4db1-8c9c-eb49281132fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf55ef0c6fe04a53ab502535c59870a9)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:40.801037 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f25f5-53bf-4db1-8c9c-eb49281132fc admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:40.869056 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-ee8f25f5-53bf-4db1-8c9c-eb49281132fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf55ef0c6fe04a53ab502535c59870a9', 'request_id': 'req-ee8f25f5-53bf-4db1-8c9c-eb49281132fc'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:40.888206 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-ee8f25f5-53bf-4db1-8c9c-eb49281132fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf55ef0c6fe04a53ab502535c59870a9', 'request_id': 'req-ee8f25f5-53bf-4db1-8c9c-eb49281132fc'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:40.919469 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-ee8f25f5-53bf-4db1-8c9c-eb49281132fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf55ef0c6fe04a53ab502535c59870a9', 'request_id': 'req-ee8f25f5-53bf-4db1-8c9c-eb49281132fc'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:40.948118 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-ee8f25f5-53bf-4db1-8c9c-eb49281132fc admin admin] The token cache is being invalidate because project bf55ef0c6fe04a53ab502535c59870a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:55:40.948486 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-ee8f25f5-53bf-4db1-8c9c-eb49281132fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:40.949679 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-ee8f25f5-53bf-4db1-8c9c-eb49281132fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:40.951336 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1360/2710] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:55:40 2022] DELETE /identity/v3/projects/bf55ef0c6fe04a53ab502535c59870a9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:40.956692 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a0b00-4f7c-4a93-b841-16e30c40d86f service neutron] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:40.967818 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a0b00-4f7c-4a93-b841-16e30c40d86f service neutron] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:41.155922 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:41.178326 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb78f39-1a1b-4cec-ae62-ed572afdd39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:41.179128 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb78f39-1a1b-4cec-ae62-ed572afdd39f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:41.179552 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb78f39-1a1b-4cec-ae62-ed572afdd39f admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:41.179910 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb78f39-1a1b-4cec-ae62-ed572afdd39f admin admin] PATH_INFO: `/v3/users/ed72dcca56724d7c93e6fd9ca1549018` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:41.181158 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb78f39-1a1b-4cec-ae62-ed572afdd39f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed72dcca56724d7c93e6fd9ca1549018)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:41.183186 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb78f39-1a1b-4cec-ae62-ed572afdd39f admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:41.241985 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-4eb78f39-1a1b-4cec-ae62-ed572afdd39f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed72dcca56724d7c93e6fd9ca1549018'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:41.242905 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-4eb78f39-1a1b-4cec-ae62-ed572afdd39f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed72dcca56724d7c93e6fd9ca1549018'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:41.243709 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-4eb78f39-1a1b-4cec-ae62-ed572afdd39f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed72dcca56724d7c93e6fd9ca1549018'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:41.261735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-4eb78f39-1a1b-4cec-ae62-ed572afdd39f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed72dcca56724d7c93e6fd9ca1549018'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:41.271120 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-4eb78f39-1a1b-4cec-ae62-ed572afdd39f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed72dcca56724d7c93e6fd9ca1549018'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:41.285506 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1351/2711] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:55:40 2022] DELETE /identity/v3/users/ed72dcca56724d7c93e6fd9ca1549018 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:41.604105 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f25f5-53bf-4db1-8c9c-eb49281132fc admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:41.606051 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-ee8f25f5-53bf-4db1-8c9c-eb49281132fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:41.621707 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f25f5-53bf-4db1-8c9c-eb49281132fc admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:41.686083 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c6088-ebfe-41af-9f42-1a63870d7515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:41.686860 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c6088-ebfe-41af-9f42-1a63870d7515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:41.687203 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c6088-ebfe-41af-9f42-1a63870d7515 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:41.687561 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c6088-ebfe-41af-9f42-1a63870d7515 admin admin] PATH_INFO: `/v3/projects/dcef2a9a3ab94b95b5a547b16d631286` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:41.688776 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c6088-ebfe-41af-9f42-1a63870d7515 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcef2a9a3ab94b95b5a547b16d631286)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:41.690807 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c6088-ebfe-41af-9f42-1a63870d7515 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:41.743999 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-9e9c6088-ebfe-41af-9f42-1a63870d7515 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcef2a9a3ab94b95b5a547b16d631286', 'request_id': 'req-9e9c6088-ebfe-41af-9f42-1a63870d7515'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:41.745257 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:41.752044 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-9e9c6088-ebfe-41af-9f42-1a63870d7515 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcef2a9a3ab94b95b5a547b16d631286', 'request_id': 'req-9e9c6088-ebfe-41af-9f42-1a63870d7515'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:41.763707 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-9e9c6088-ebfe-41af-9f42-1a63870d7515 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcef2a9a3ab94b95b5a547b16d631286', 'request_id': 'req-9e9c6088-ebfe-41af-9f42-1a63870d7515'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:41.775006 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-9e9c6088-ebfe-41af-9f42-1a63870d7515 admin admin] The token cache is being invalidate because project dcef2a9a3ab94b95b5a547b16d631286 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:55:41.775294 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-9e9c6088-ebfe-41af-9f42-1a63870d7515 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:41.775924 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-9e9c6088-ebfe-41af-9f42-1a63870d7515 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:41.783873 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1361/2712] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:55:41 2022] DELETE /identity/v3/projects/dcef2a9a3ab94b95b5a547b16d631286 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:41.784070 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb78f39-1a1b-4cec-ae62-ed572afdd39f admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:41.784602 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-4eb78f39-1a1b-4cec-ae62-ed572afdd39f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:41.798679 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb78f39-1a1b-4cec-ae62-ed572afdd39f admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:41.868173 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ba968-6194-44e2-bf09-60fd46689418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:41.869833 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ba968-6194-44e2-bf09-60fd46689418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:41.870127 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ba968-6194-44e2-bf09-60fd46689418 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:41.871266 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ba968-6194-44e2-bf09-60fd46689418 admin admin] PATH_INFO: `/v3/users/635b18f2ae3c40cca8dae702b334f770` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:41.872992 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ba968-6194-44e2-bf09-60fd46689418 admin admin] RBAC: Authorizing `identity:delete_user(user_id=635b18f2ae3c40cca8dae702b334f770)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:41.875313 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ba968-6194-44e2-bf09-60fd46689418 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:41.949596 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-353ba968-6194-44e2-bf09-60fd46689418 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '635b18f2ae3c40cca8dae702b334f770'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:41.950248 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-353ba968-6194-44e2-bf09-60fd46689418 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '635b18f2ae3c40cca8dae702b334f770'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:41.950844 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-353ba968-6194-44e2-bf09-60fd46689418 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '635b18f2ae3c40cca8dae702b334f770'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:41.967934 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-353ba968-6194-44e2-bf09-60fd46689418 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '635b18f2ae3c40cca8dae702b334f770'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:41.971185 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:41.983467 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-353ba968-6194-44e2-bf09-60fd46689418 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '635b18f2ae3c40cca8dae702b334f770'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:42.002293 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1352/2713] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:55:41 2022] DELETE /identity/v3/users/635b18f2ae3c40cca8dae702b334f770 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:55:42.352950 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c6088-ebfe-41af-9f42-1a63870d7515 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:42.354849 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-9e9c6088-ebfe-41af-9f42-1a63870d7515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:42.385101 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c6088-ebfe-41af-9f42-1a63870d7515 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:42.456615 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6899ff6-7cc5-417c-bb31-34c66945daa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:42.457794 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6899ff6-7cc5-417c-bb31-34c66945daa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:42.458149 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6899ff6-7cc5-417c-bb31-34c66945daa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:42.458428 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6899ff6-7cc5-417c-bb31-34c66945daa0 admin admin] PATH_INFO: `/v3/projects/80319e11c6f64f2a95165118d83034fc` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:42.459587 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6899ff6-7cc5-417c-bb31-34c66945daa0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80319e11c6f64f2a95165118d83034fc)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:42.461713 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6899ff6-7cc5-417c-bb31-34c66945daa0 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:42.515898 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-c6899ff6-7cc5-417c-bb31-34c66945daa0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80319e11c6f64f2a95165118d83034fc', 'request_id': 'req-c6899ff6-7cc5-417c-bb31-34c66945daa0'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:42.523680 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-c6899ff6-7cc5-417c-bb31-34c66945daa0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80319e11c6f64f2a95165118d83034fc', 'request_id': 'req-c6899ff6-7cc5-417c-bb31-34c66945daa0'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:42.533068 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-c6899ff6-7cc5-417c-bb31-34c66945daa0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80319e11c6f64f2a95165118d83034fc', 'request_id': 'req-c6899ff6-7cc5-417c-bb31-34c66945daa0'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:42.545712 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-c6899ff6-7cc5-417c-bb31-34c66945daa0 admin admin] The token cache is being invalidate because project 80319e11c6f64f2a95165118d83034fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:55:42.546038 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-c6899ff6-7cc5-417c-bb31-34c66945daa0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:42.546679 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-c6899ff6-7cc5-417c-bb31-34c66945daa0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:42.549380 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1362/2714] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:55:42 2022] DELETE /identity/v3/projects/80319e11c6f64f2a95165118d83034fc => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:55:42.556958 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53912a2f-ac4e-4743-bab7-a946b1345ef9 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:42.557526 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53912a2f-ac4e-4743-bab7-a946b1345ef9 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:42.557628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53912a2f-ac4e-4743-bab7-a946b1345ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:42.584580 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-53912a2f-ac4e-4743-bab7-a946b1345ef9 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:42.585873 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-53912a2f-ac4e-4743-bab7-a946b1345ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:42.677585 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1353/2715] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:42.686616 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed5444-717f-4e85-82a2-739f61d7bd34 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:42.687154 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed5444-717f-4e85-82a2-739f61d7bd34 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:42.687263 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed5444-717f-4e85-82a2-739f61d7bd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:42.709075 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-78ed5444-717f-4e85-82a2-739f61d7bd34 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:42.710359 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-78ed5444-717f-4e85-82a2-739f61d7bd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:42.722767 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1363/2716] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:42.727625 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53912a2f-ac4e-4743-bab7-a946b1345ef9 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:42.739660 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53912a2f-ac4e-4743-bab7-a946b1345ef9 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:42.745187 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45db1a-cca1-41a9-bbc3-df5ca29030a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:42.746003 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45db1a-cca1-41a9-bbc3-df5ca29030a4 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:42.746288 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45db1a-cca1-41a9-bbc3-df5ca29030a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:42.746563 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45db1a-cca1-41a9-bbc3-df5ca29030a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:42.747342 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45db1a-cca1-41a9-bbc3-df5ca29030a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:55:42.747641 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45db1a-cca1-41a9-bbc3-df5ca29030a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:42.749256 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45db1a-cca1-41a9-bbc3-df5ca29030a4 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:42.763710 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1354/2717] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:55:42.768081 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed5444-717f-4e85-82a2-739f61d7bd34 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:42.780838 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed5444-717f-4e85-82a2-739f61d7bd34 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:42.786277 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce986b4-dbc1-4968-939d-1d1f6feea86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:42.786890 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce986b4-dbc1-4968-939d-1d1f6feea86f admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:42.787163 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce986b4-dbc1-4968-939d-1d1f6feea86f admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:42.787433 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce986b4-dbc1-4968-939d-1d1f6feea86f admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:42.788071 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce986b4-dbc1-4968-939d-1d1f6feea86f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:42.791722 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce986b4-dbc1-4968-939d-1d1f6feea86f admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:42.830982 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1364/2718] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:55:42 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:55:42.835683 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45db1a-cca1-41a9-bbc3-df5ca29030a4 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:42.846683 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45db1a-cca1-41a9-bbc3-df5ca29030a4 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:42.914012 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da6ac5-fd37-4658-8d37-c6c5c27c7151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:42.915842 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da6ac5-fd37-4658-8d37-c6c5c27c7151 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:42.916170 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da6ac5-fd37-4658-8d37-c6c5c27c7151 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:42.916446 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da6ac5-fd37-4658-8d37-c6c5c27c7151 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:42.917148 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da6ac5-fd37-4658-8d37-c6c5c27c7151 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:42.919198 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da6ac5-fd37-4658-8d37-c6c5c27c7151 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:42.943506 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1355/2719] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:55:42 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:42.948015 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce986b4-dbc1-4968-939d-1d1f6feea86f admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:42.962309 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce986b4-dbc1-4968-939d-1d1f6feea86f admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:42.967935 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9e9be-175b-4187-b26d-026c864a189d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:42.968642 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9e9be-175b-4187-b26d-026c864a189d admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:42.968979 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9e9be-175b-4187-b26d-026c864a189d admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:42.969371 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9e9be-175b-4187-b26d-026c864a189d admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:42.970076 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c9e9be-175b-4187-b26d-026c864a189d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:42.971734 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c9e9be-175b-4187-b26d-026c864a189d admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:42.986286 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1365/2720] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:42.990162 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da6ac5-fd37-4658-8d37-c6c5c27c7151 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:43.003661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da6ac5-fd37-4658-8d37-c6c5c27c7151 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:43.009010 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad476e-574e-4813-be23-8a6f25dd79fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:43.009773 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad476e-574e-4813-be23-8a6f25dd79fe admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:43.010147 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad476e-574e-4813-be23-8a6f25dd79fe admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:43.010505 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad476e-574e-4813-be23-8a6f25dd79fe admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:43.011255 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad476e-574e-4813-be23-8a6f25dd79fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:43.012995 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad476e-574e-4813-be23-8a6f25dd79fe admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:43.024619 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1356/2721] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:55:43.028769 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9e9be-175b-4187-b26d-026c864a189d admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:43.039933 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9e9be-175b-4187-b26d-026c864a189d admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:43.044689 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce4925-3962-437f-894d-c820cca845f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:43.045373 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce4925-3962-437f-894d-c820cca845f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:43.045737 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce4925-3962-437f-894d-c820cca845f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:43.045992 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce4925-3962-437f-894d-c820cca845f1 admin admin] PATH_INFO: `/v3/projects/0ce235f4d35a46b897606264a8797272/users/b8c113a374c5465f962a235bd1a61a5f/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:43.062580 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce4925-3962-437f-894d-c820cca845f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ce235f4d35a46b897606264a8797272, user_id=b8c113a374c5465f962a235bd1a61a5f, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:43.065236 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce4925-3962-437f-894d-c820cca845f1 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:43.084696 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1366/2722] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:43 2022] PUT /identity/v3/projects/0ce235f4d35a46b897606264a8797272/users/b8c113a374c5465f962a235bd1a61a5f/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:43.096564 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8e6f4-1c8a-4bd6-88a0-7775f35dacfc None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:43.096844 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8e6f4-1c8a-4bd6-88a0-7775f35dacfc None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:43.097116 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8e6f4-1c8a-4bd6-88a0-7775f35dacfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:43.149429 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-c7d8e6f4-1c8a-4bd6-88a0-7775f35dacfc None None] MFA Rules not processed for user `b8c113a374c5465f962a235bd1a61a5f`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:43.157807 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-c7d8e6f4-1c8a-4bd6-88a0-7775f35dacfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:43.217742 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:43.258585 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1357/2723] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:55:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:43.267191 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce4925-3962-437f-894d-c820cca845f1 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:43.269010 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-97ce4925-3962-437f-894d-c820cca845f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:43.279258 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:43.343972 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce4925-3962-437f-894d-c820cca845f1 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:43.348560 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86045db-a9d1-4de9-9f7a-1a4a7e94f2ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:43.349257 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86045db-a9d1-4de9-9f7a-1a4a7e94f2ac service cinder] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:43.349655 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86045db-a9d1-4de9-9f7a-1a4a7e94f2ac service cinder] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:43.350012 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86045db-a9d1-4de9-9f7a-1a4a7e94f2ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:43.359110 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86045db-a9d1-4de9-9f7a-1a4a7e94f2ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:43.360565 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86045db-a9d1-4de9-9f7a-1a4a7e94f2ac service cinder] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:43.372053 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1367/2724] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:46.044649 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8e6f4-1c8a-4bd6-88a0-7775f35dacfc None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:46.111499 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8e6f4-1c8a-4bd6-88a0-7775f35dacfc None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:46.116648 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851621b-4c79-473e-950e-575c68a34508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:46.117275 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851621b-4c79-473e-950e-575c68a34508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:46.117673 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851621b-4c79-473e-950e-575c68a34508 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:46.117952 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851621b-4c79-473e-950e-575c68a34508 admin admin] PATH_INFO: `/v3/users/b8c113a374c5465f962a235bd1a61a5f` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:46.119105 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851621b-4c79-473e-950e-575c68a34508 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8c113a374c5465f962a235bd1a61a5f)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:46.121050 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851621b-4c79-473e-950e-575c68a34508 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:46.178163 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-c851621b-4c79-473e-950e-575c68a34508 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8c113a374c5465f962a235bd1a61a5f'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:46.178853 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-c851621b-4c79-473e-950e-575c68a34508 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8c113a374c5465f962a235bd1a61a5f'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:46.179457 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-c851621b-4c79-473e-950e-575c68a34508 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8c113a374c5465f962a235bd1a61a5f'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:46.191456 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-c851621b-4c79-473e-950e-575c68a34508 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8c113a374c5465f962a235bd1a61a5f'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:46.200812 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-c851621b-4c79-473e-950e-575c68a34508 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8c113a374c5465f962a235bd1a61a5f'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:46.219178 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1358/2725] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:55:46 2022] DELETE /identity/v3/users/b8c113a374c5465f962a235bd1a61a5f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:46.225229 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a458f-01b8-4fe9-b263-1d9f2701e8a0 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:46.225761 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a458f-01b8-4fe9-b263-1d9f2701e8a0 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:46.225761 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a458f-01b8-4fe9-b263-1d9f2701e8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:46.249464 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-e92a458f-01b8-4fe9-b263-1d9f2701e8a0 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:46.251055 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-e92a458f-01b8-4fe9-b263-1d9f2701e8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:46.325847 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1368/2726] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:46.336009 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851621b-4c79-473e-950e-575c68a34508 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:46.337818 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-c851621b-4c79-473e-950e-575c68a34508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:46.399019 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851621b-4c79-473e-950e-575c68a34508 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:46.403321 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f1faf-198f-4bf5-8bcc-094e397987c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:46.403933 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f1faf-198f-4bf5-8bcc-094e397987c2 service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:46.404210 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f1faf-198f-4bf5-8bcc-094e397987c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:46.404478 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f1faf-198f-4bf5-8bcc-094e397987c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:46.415439 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f1faf-198f-4bf5-8bcc-094e397987c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:46.416914 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f1faf-198f-4bf5-8bcc-094e397987c2 service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:46.427062 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1359/2727] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:46.712686 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a458f-01b8-4fe9-b263-1d9f2701e8a0 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:46.714332 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-e92a458f-01b8-4fe9-b263-1d9f2701e8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:46.730111 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a458f-01b8-4fe9-b263-1d9f2701e8a0 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:46.736606 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe042be2-068d-458c-91c0-af16ad5ada91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:46.737190 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe042be2-068d-458c-91c0-af16ad5ada91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:46.737542 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe042be2-068d-458c-91c0-af16ad5ada91 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:46.737904 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe042be2-068d-458c-91c0-af16ad5ada91 admin admin] PATH_INFO: `/v3/projects/0ce235f4d35a46b897606264a8797272` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:46.739169 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe042be2-068d-458c-91c0-af16ad5ada91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ce235f4d35a46b897606264a8797272)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:46.741263 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe042be2-068d-458c-91c0-af16ad5ada91 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:46.792776 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-fe042be2-068d-458c-91c0-af16ad5ada91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ce235f4d35a46b897606264a8797272', 'request_id': 'req-fe042be2-068d-458c-91c0-af16ad5ada91'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:46.799223 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-fe042be2-068d-458c-91c0-af16ad5ada91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ce235f4d35a46b897606264a8797272', 'request_id': 'req-fe042be2-068d-458c-91c0-af16ad5ada91'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:46.807698 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-fe042be2-068d-458c-91c0-af16ad5ada91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ce235f4d35a46b897606264a8797272', 'request_id': 'req-fe042be2-068d-458c-91c0-af16ad5ada91'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:46.818560 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-fe042be2-068d-458c-91c0-af16ad5ada91 admin admin] The token cache is being invalidate because project 0ce235f4d35a46b897606264a8797272 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:55:46.818848 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-fe042be2-068d-458c-91c0-af16ad5ada91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:46.819515 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-fe042be2-068d-458c-91c0-af16ad5ada91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:46.821018 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1369/2728] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:55:46 2022] DELETE /identity/v3/projects/0ce235f4d35a46b897606264a8797272 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:46.825888 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc16a2-e719-4a2c-a640-7096051ddbac None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:46.826177 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc16a2-e719-4a2c-a640-7096051ddbac None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:46.826551 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc16a2-e719-4a2c-a640-7096051ddbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:46.834414 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:46.848955 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-7ffc16a2-e719-4a2c-a640-7096051ddbac None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:46.850203 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-7ffc16a2-e719-4a2c-a640-7096051ddbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:46.910668 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1360/2729] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:46.918670 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a85109-4751-4132-b761-012708bc3452 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:46.919027 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a85109-4751-4132-b761-012708bc3452 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:46.919393 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a85109-4751-4132-b761-012708bc3452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:46.939608 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-15a85109-4751-4132-b761-012708bc3452 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:46.940817 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-15a85109-4751-4132-b761-012708bc3452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:46.948893 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1370/2730] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:46.952953 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc16a2-e719-4a2c-a640-7096051ddbac None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:46.962629 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc16a2-e719-4a2c-a640-7096051ddbac None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:46.967056 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b0357-4698-4ddd-9b3c-0bccfd61b508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:46.967650 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b0357-4698-4ddd-9b3c-0bccfd61b508 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:46.967944 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b0357-4698-4ddd-9b3c-0bccfd61b508 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:46.968197 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b0357-4698-4ddd-9b3c-0bccfd61b508 admin admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:46.968843 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b0357-4698-4ddd-9b3c-0bccfd61b508 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:55:46.969143 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b0357-4698-4ddd-9b3c-0bccfd61b508 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:46.970778 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b0357-4698-4ddd-9b3c-0bccfd61b508 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:46.990468 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1361/2731] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:55:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:55:46.994889 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a85109-4751-4132-b761-012708bc3452 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:47.004468 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a85109-4751-4132-b761-012708bc3452 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:47.009701 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac24ca2-7efb-4e36-b4d6-a8000bce842a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:47.010294 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac24ca2-7efb-4e36-b4d6-a8000bce842a admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:47.010570 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac24ca2-7efb-4e36-b4d6-a8000bce842a admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:47.010837 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac24ca2-7efb-4e36-b4d6-a8000bce842a admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:47.011466 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac24ca2-7efb-4e36-b4d6-a8000bce842a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:47.013392 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac24ca2-7efb-4e36-b4d6-a8000bce842a admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:47.043519 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1371/2732] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:55:46 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:47.047851 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b0357-4698-4ddd-9b3c-0bccfd61b508 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:47.058801 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b0357-4698-4ddd-9b3c-0bccfd61b508 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:47.119122 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fce840-1e77-47cd-a028-0d86c6f03c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:47.119733 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fce840-1e77-47cd-a028-0d86c6f03c4a admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:47.120010 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fce840-1e77-47cd-a028-0d86c6f03c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:47.120279 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fce840-1e77-47cd-a028-0d86c6f03c4a admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:47.120889 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fce840-1e77-47cd-a028-0d86c6f03c4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:47.122878 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fce840-1e77-47cd-a028-0d86c6f03c4a admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:47.149209 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1362/2733] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:55:47 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:47.155068 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac24ca2-7efb-4e36-b4d6-a8000bce842a admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:47.161991 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:47.169184 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac24ca2-7efb-4e36-b4d6-a8000bce842a admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:47.175959 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5a956-d69d-4ba5-8fdb-14e935cbf49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:47.176604 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5a956-d69d-4ba5-8fdb-14e935cbf49b admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:47.176848 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5a956-d69d-4ba5-8fdb-14e935cbf49b admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:47.177205 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db5a956-d69d-4ba5-8fdb-14e935cbf49b admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:47.177950 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db5a956-d69d-4ba5-8fdb-14e935cbf49b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:47.179549 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db5a956-d69d-4ba5-8fdb-14e935cbf49b admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:47.190264 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1372/2734] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:47.194446 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fce840-1e77-47cd-a028-0d86c6f03c4a admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:47.205167 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fce840-1e77-47cd-a028-0d86c6f03c4a admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:47.211110 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34f194-bcfe-41da-bbaf-bbdfeb38e524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:47.211711 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34f194-bcfe-41da-bbaf-bbdfeb38e524 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:47.211990 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34f194-bcfe-41da-bbaf-bbdfeb38e524 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:47.212260 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34f194-bcfe-41da-bbaf-bbdfeb38e524 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:47.212902 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34f194-bcfe-41da-bbaf-bbdfeb38e524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:47.214632 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34f194-bcfe-41da-bbaf-bbdfeb38e524 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:47.226211 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1363/2735] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:47.230677 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5a956-d69d-4ba5-8fdb-14e935cbf49b admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:47.241194 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db5a956-d69d-4ba5-8fdb-14e935cbf49b admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:47.246573 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128da2f5-13f0-40c3-9632-50c66c8f3bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:47.247249 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128da2f5-13f0-40c3-9632-50c66c8f3bf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:47.247530 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128da2f5-13f0-40c3-9632-50c66c8f3bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:47.247808 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128da2f5-13f0-40c3-9632-50c66c8f3bf3 admin admin] PATH_INFO: `/v3/projects/3a9237a53a8a4d42b25d1666ef19c2d5/users/cf39aa1c38574c0e9217a42bca716783/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:47.263242 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128da2f5-13f0-40c3-9632-50c66c8f3bf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a9237a53a8a4d42b25d1666ef19c2d5, user_id=cf39aa1c38574c0e9217a42bca716783, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:47.265961 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128da2f5-13f0-40c3-9632-50c66c8f3bf3 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:47.281979 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1373/2736] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:47 2022] PUT /identity/v3/projects/3a9237a53a8a4d42b25d1666ef19c2d5/users/cf39aa1c38574c0e9217a42bca716783/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:47.287898 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b7a17-4aa8-490e-a7fd-f1137e41d048 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:47.288263 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b7a17-4aa8-490e-a7fd-f1137e41d048 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:47.288659 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b7a17-4aa8-490e-a7fd-f1137e41d048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:47.311601 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-bf6b7a17-4aa8-490e-a7fd-f1137e41d048 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:47.312830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-bf6b7a17-4aa8-490e-a7fd-f1137e41d048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:47.376259 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1364/2737] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:55:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:47.386814 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128da2f5-13f0-40c3-9632-50c66c8f3bf3 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:47.389297 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-128da2f5-13f0-40c3-9632-50c66c8f3bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:47.448867 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128da2f5-13f0-40c3-9632-50c66c8f3bf3 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:47.452921 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b8b49-6b01-4f5a-bf6e-c403dcf146b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:47.453558 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b8b49-6b01-4f5a-bf6e-c403dcf146b9 service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:47.453825 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b8b49-6b01-4f5a-bf6e-c403dcf146b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:47.454099 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b8b49-6b01-4f5a-bf6e-c403dcf146b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:47.463653 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b8b49-6b01-4f5a-bf6e-c403dcf146b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:47.465067 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b8b49-6b01-4f5a-bf6e-c403dcf146b9 service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:47.474921 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1374/2738] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:48.162485 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afa838-0046-41c1-9ca4-69f795f4cda8 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:48.162969 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afa838-0046-41c1-9ca4-69f795f4cda8 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:48.163152 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afa838-0046-41c1-9ca4-69f795f4cda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:48.183611 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:48.195617 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-c0afa838-0046-41c1-9ca4-69f795f4cda8 None None] MFA Rules not processed for user `cf39aa1c38574c0e9217a42bca716783`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:48.198515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-c0afa838-0046-41c1-9ca4-69f795f4cda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:48.276496 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1365/2739] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:55:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:48.283582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b8b49-6b01-4f5a-bf6e-c403dcf146b9 service neutron] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:48.285896 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-638b8b49-6b01-4f5a-bf6e-c403dcf146b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:48.353610 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b8b49-6b01-4f5a-bf6e-c403dcf146b9 service neutron] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:48.357248 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ecf2ba-3697-4432-8664-7f827eee0f2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:48.357887 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ecf2ba-3697-4432-8664-7f827eee0f2d service cinder] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:48.358165 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ecf2ba-3697-4432-8664-7f827eee0f2d service cinder] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:48.358431 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ecf2ba-3697-4432-8664-7f827eee0f2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:48.367863 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ecf2ba-3697-4432-8664-7f827eee0f2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:48.369424 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ecf2ba-3697-4432-8664-7f827eee0f2d service cinder] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:48.379096 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1375/2740] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:48.802718 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a4c5a-405a-4448-9bec-30dbb0d1a917 None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:48.803001 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a4c5a-405a-4448-9bec-30dbb0d1a917 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:48.803302 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a4c5a-405a-4448-9bec-30dbb0d1a917 None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:48.804729 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1366/2741] 10.222.0.49 () {54 vars in 921 bytes} [Wed Aug 24 04:55:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:55:48.811393 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e03aa-a735-4345-a871-31bdcd4d774f None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:48.811749 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e03aa-a735-4345-a871-31bdcd4d774f None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:48.812091 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e03aa-a735-4345-a871-31bdcd4d774f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:48.833325 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-0c1e03aa-a735-4345-a871-31bdcd4d774f None None] MFA Rules not processed for user `9dc9a3cf381e4a2da36ed82b407a2d94`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:48.834578 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-0c1e03aa-a735-4345-a871-31bdcd4d774f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:48.905448 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1376/2742] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Aug 24 04:55:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:55:48.917288 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a4c5a-405a-4448-9bec-30dbb0d1a917 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:48.919363 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-d21a4c5a-405a-4448-9bec-30dbb0d1a917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:48.984817 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a4c5a-405a-4448-9bec-30dbb0d1a917 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:48.988732 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7780507-ebea-4270-baf9-78e8fd7a8ab3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be44ea93247420d994e24912a9ac32e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:48.989443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7780507-ebea-4270-baf9-78e8fd7a8ab3 service glance] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:48.989708 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7780507-ebea-4270-baf9-78e8fd7a8ab3 service glance] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:48.989975 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7780507-ebea-4270-baf9-78e8fd7a8ab3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:49.001220 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7780507-ebea-4270-baf9-78e8fd7a8ab3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:49.002699 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7780507-ebea-4270-baf9-78e8fd7a8ab3 service glance] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:49.014327 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1367/2743] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:49.088735 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044caa7-36fc-420e-ade9-748c4f8972a0 None None] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:49.089032 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044caa7-36fc-420e-ade9-748c4f8972a0 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:49.089359 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044caa7-36fc-420e-ade9-748c4f8972a0 None None] PATH_INFO: `/` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:49.090751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1377/2744] 10.222.0.49 () {54 vars in 921 bytes} [Wed Aug 24 04:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:55:49.096074 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977008f-99c5-4a71-b570-b058af809b6a None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:49.096398 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977008f-99c5-4a71-b570-b058af809b6a None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:49.096722 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977008f-99c5-4a71-b570-b058af809b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:49.118234 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-b977008f-99c5-4a71-b570-b058af809b6a None None] MFA Rules not processed for user `087c0311906a4987b294729706a08810`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:49.119720 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-b977008f-99c5-4a71-b570-b058af809b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:49.126711 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1368/2745] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Aug 24 04:55:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:49.138693 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044caa7-36fc-420e-ade9-748c4f8972a0 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:49.140629 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-f044caa7-36fc-420e-ade9-748c4f8972a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:49.150198 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:49.157867 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044caa7-36fc-420e-ade9-748c4f8972a0 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:49.162177 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f49c611-160f-45d5-8a30-9ab7ababb2cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:49.162789 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49c611-160f-45d5-8a30-9ab7ababb2cb service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:49.163065 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49c611-160f-45d5-8a30-9ab7ababb2cb service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:49.163332 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f49c611-160f-45d5-8a30-9ab7ababb2cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:49.171490 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f49c611-160f-45d5-8a30-9ab7ababb2cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:49.172969 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f49c611-160f-45d5-8a30-9ab7ababb2cb service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:49.181310 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1378/2746] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:49.269114 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e29526-a485-47cd-8664-492ad38c923d None None] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:49.269570 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e29526-a485-47cd-8664-492ad38c923d None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:49.269708 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e29526-a485-47cd-8664-492ad38c923d None None] PATH_INFO: `/` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:49.271097 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1369/2747] 10.222.0.49 () {54 vars in 921 bytes} [Wed Aug 24 04:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:55:49.276415 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655a599-420f-40bb-ac8a-23f585617395 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:49.276699 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655a599-420f-40bb-ac8a-23f585617395 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:49.276968 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655a599-420f-40bb-ac8a-23f585617395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:49.297898 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-7655a599-420f-40bb-ac8a-23f585617395 None None] MFA Rules not processed for user `9dc9a3cf381e4a2da36ed82b407a2d94`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:49.299744 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-7655a599-420f-40bb-ac8a-23f585617395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:49.310253 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1379/2748] 10.222.0.49 () {58 vars in 1018 bytes} [Wed Aug 24 04:55:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:49.321549 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e29526-a485-47cd-8664-492ad38c923d None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:49.337963 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e29526-a485-47cd-8664-492ad38c923d None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:49.342436 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654e81e-271b-4e1c-9deb-7a4f3e59d67e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:49.343031 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654e81e-271b-4e1c-9deb-7a4f3e59d67e service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:49.343312 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654e81e-271b-4e1c-9deb-7a4f3e59d67e service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:49.343585 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654e81e-271b-4e1c-9deb-7a4f3e59d67e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:49.355522 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654e81e-271b-4e1c-9deb-7a4f3e59d67e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:49.356972 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654e81e-271b-4e1c-9deb-7a4f3e59d67e service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:49.368199 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1370/2749] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:49.795756 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40a9a0-14c1-4f78-86ee-33662d36faa2 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:49.796041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40a9a0-14c1-4f78-86ee-33662d36faa2 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:49.796335 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b40a9a0-14c1-4f78-86ee-33662d36faa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:49.815126 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-2b40a9a0-14c1-4f78-86ee-33662d36faa2 None None] MFA Rules not processed for user `cf39aa1c38574c0e9217a42bca716783`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:49.816358 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-2b40a9a0-14c1-4f78-86ee-33662d36faa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:49.824073 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1380/2750] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:55:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:52.002805 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1718ba-d69b-4a6f-b949-54e7daf683fa None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:52.003364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1718ba-d69b-4a6f-b949-54e7daf683fa None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:52.003364 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1718ba-d69b-4a6f-b949-54e7daf683fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:52.024534 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-5c1718ba-d69b-4a6f-b949-54e7daf683fa None None] MFA Rules not processed for user `c737c4586910476eafead0dfd4d9bc4c`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:52.025771 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-5c1718ba-d69b-4a6f-b949-54e7daf683fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:52.081767 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1371/2751] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 24 04:55:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:52.104024 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b40a9a0-14c1-4f78-86ee-33662d36faa2 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:52.105499 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-2b40a9a0-14c1-4f78-86ee-33662d36faa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:52.195894 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b40a9a0-14c1-4f78-86ee-33662d36faa2 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:52.201379 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4671de80-5cf7-41da-a274-f2e0d55668aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ebb5105220438693118d734c9fda70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:52.202017 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671de80-5cf7-41da-a274-f2e0d55668aa service swift] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:52.202919 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671de80-5cf7-41da-a274-f2e0d55668aa service swift] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:52.202919 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4671de80-5cf7-41da-a274-f2e0d55668aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:52.212318 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671de80-5cf7-41da-a274-f2e0d55668aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:52.213967 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4671de80-5cf7-41da-a274-f2e0d55668aa service swift] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:52.222190 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1381/2752] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 24 04:55:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:55:53.039512 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1718ba-d69b-4a6f-b949-54e7daf683fa None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:53.042204 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-5c1718ba-d69b-4a6f-b949-54e7daf683fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:53.068380 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1718ba-d69b-4a6f-b949-54e7daf683fa None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:53.075458 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5925fc9-8aed-4347-9654-ac3f0d1456b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:53.076554 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5925fc9-8aed-4347-9654-ac3f0d1456b0 service nova] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:53.076833 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5925fc9-8aed-4347-9654-ac3f0d1456b0 service nova] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:53.077107 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5925fc9-8aed-4347-9654-ac3f0d1456b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:53.079126 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-d5925fc9-8aed-4347-9654-ac3f0d1456b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:53.092993 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5925fc9-8aed-4347-9654-ac3f0d1456b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:53.094629 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5925fc9-8aed-4347-9654-ac3f0d1456b0 service nova] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:53.105569 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1372/2753] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:56:02.220292 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=42 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:03.101047 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=94 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:09.063463 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91eb2bc-dfb1-4eea-829b-b70b973b31bd None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:09.063973 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91eb2bc-dfb1-4eea-829b-b70b973b31bd None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:09.063973 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91eb2bc-dfb1-4eea-829b-b70b973b31bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:09.086086 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-c91eb2bc-dfb1-4eea-829b-b70b973b31bd None None] MFA Rules not processed for user `c737c4586910476eafead0dfd4d9bc4c`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:56:09.087327 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-c91eb2bc-dfb1-4eea-829b-b70b973b31bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:09.095939 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1382/2754] 10.222.0.49 () {58 vars in 967 bytes} [Wed Aug 24 04:56:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:56:09.108595 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5925fc9-8aed-4347-9654-ac3f0d1456b0 service nova] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:09.120741 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5925fc9-8aed-4347-9654-ac3f0d1456b0 service nova] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:09.126886 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58830e96-7591-4498-b9b7-670b3cc3b4af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ebb5105220438693118d734c9fda70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:09.127623 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58830e96-7591-4498-b9b7-670b3cc3b4af service swift] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:09.128057 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58830e96-7591-4498-b9b7-670b3cc3b4af service swift] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:09.128416 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58830e96-7591-4498-b9b7-670b3cc3b4af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:09.143939 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58830e96-7591-4498-b9b7-670b3cc3b4af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:09.145580 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58830e96-7591-4498-b9b7-670b3cc3b4af service swift] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:09.155042 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1373/2755] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 24 04:56:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:56:19.080819 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=3 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:19.150861 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=6 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:29.252734 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc5ec4-d876-4fea-a81d-45551ef154e7 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:29.253239 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc5ec4-d876-4fea-a81d-45551ef154e7 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:29.253351 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dc5ec4-d876-4fea-a81d-45551ef154e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:29.275434 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-f9dc5ec4-d876-4fea-a81d-45551ef154e7 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:56:29.276561 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-f9dc5ec4-d876-4fea-a81d-45551ef154e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:29.286834 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1383/2756] 10.222.0.72 () {58 vars in 1016 bytes} [Wed Aug 24 04:56:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:56:29.311291 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58830e96-7591-4498-b9b7-670b3cc3b4af service swift] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:29.313199 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-58830e96-7591-4498-b9b7-670b3cc3b4af service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:29.333895 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58830e96-7591-4498-b9b7-670b3cc3b4af service swift] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:29.344884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce3f11-ef15-430f-b482-1b6e5e7987f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:29.345794 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce3f11-ef15-430f-b482-1b6e5e7987f4 service nova] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:29.346168 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce3f11-ef15-430f-b482-1b6e5e7987f4 service nova] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:29.346554 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce3f11-ef15-430f-b482-1b6e5e7987f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:29.357282 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce3f11-ef15-430f-b482-1b6e5e7987f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:29.358891 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce3f11-ef15-430f-b482-1b6e5e7987f4 service nova] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:29.370838 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1374/2757] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:56:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:56:32.312457 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fe305-9e53-4a6f-b241-3702294f5bac None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:32.312972 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fe305-9e53-4a6f-b241-3702294f5bac None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:32.312972 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fe305-9e53-4a6f-b241-3702294f5bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:32.334366 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-b42fe305-9e53-4a6f-b241-3702294f5bac None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:56:32.335637 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-b42fe305-9e53-4a6f-b241-3702294f5bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:32.344885 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1384/2758] 10.222.0.72 () {58 vars in 1016 bytes} [Wed Aug 24 04:56:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:56:32.368303 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce3f11-ef15-430f-b482-1b6e5e7987f4 service nova] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:32.381008 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce3f11-ef15-430f-b482-1b6e5e7987f4 service nova] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:32.388420 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4200c-9459-4a53-8435-8e27daa6a511 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:32.389045 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4200c-9459-4a53-8435-8e27daa6a511 service nova] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:32.389324 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4200c-9459-4a53-8435-8e27daa6a511 service nova] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:32.389632 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4200c-9459-4a53-8435-8e27daa6a511 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:32.398925 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4200c-9459-4a53-8435-8e27daa6a511 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:32.400521 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d4200c-9459-4a53-8435-8e27daa6a511 service nova] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:32.411920 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1375/2759] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:56:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:56:35.585861 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f975ce-48c4-4871-8fa3-316b94a39832 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:35.586426 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f975ce-48c4-4871-8fa3-316b94a39832 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:35.586426 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f975ce-48c4-4871-8fa3-316b94a39832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:35.607822 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-80f975ce-48c4-4871-8fa3-316b94a39832 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:56:35.609827 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-80f975ce-48c4-4871-8fa3-316b94a39832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:35.620199 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1385/2760] 10.222.0.72 () {58 vars in 1016 bytes} [Wed Aug 24 04:56:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:56:35.644119 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4200c-9459-4a53-8435-8e27daa6a511 service nova] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:35.656286 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4200c-9459-4a53-8435-8e27daa6a511 service nova] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:35.663504 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8d2d2-a0d8-405a-957c-a900587af69b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:35.664160 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8d2d2-a0d8-405a-957c-a900587af69b service nova] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:35.664338 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8d2d2-a0d8-405a-957c-a900587af69b service nova] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:35.664635 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8d2d2-a0d8-405a-957c-a900587af69b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:35.673791 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8d2d2-a0d8-405a-957c-a900587af69b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:35.675400 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8d2d2-a0d8-405a-957c-a900587af69b service nova] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:35.685397 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1376/2761] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:56:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:56:38.665895 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c038e-3fa8-49da-96ce-ed1dbc029f13 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:38.666309 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c038e-3fa8-49da-96ce-ed1dbc029f13 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:38.666603 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c038e-3fa8-49da-96ce-ed1dbc029f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:38.688681 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-cc9c038e-3fa8-49da-96ce-ed1dbc029f13 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:56:38.690503 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-cc9c038e-3fa8-49da-96ce-ed1dbc029f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:38.700149 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1386/2762] 10.222.0.72 () {58 vars in 1016 bytes} [Wed Aug 24 04:56:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:56:38.726453 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8d2d2-a0d8-405a-957c-a900587af69b service nova] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:38.739152 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8d2d2-a0d8-405a-957c-a900587af69b service nova] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:38.746461 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129afdf9-8b98-44bd-933d-19b0c1fa345c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:38.747068 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129afdf9-8b98-44bd-933d-19b0c1fa345c service nova] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:38.747340 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129afdf9-8b98-44bd-933d-19b0c1fa345c service nova] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:38.747587 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129afdf9-8b98-44bd-933d-19b0c1fa345c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:38.757359 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129afdf9-8b98-44bd-933d-19b0c1fa345c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:38.758983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129afdf9-8b98-44bd-933d-19b0c1fa345c service nova] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:38.771139 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1377/2763] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:56:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:56:40.679133 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c038e-3fa8-49da-96ce-ed1dbc029f13 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:40.692789 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c038e-3fa8-49da-96ce-ed1dbc029f13 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:40.698495 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4630b-133b-45cd-9c29-b3008d76b010 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:40.699136 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4630b-133b-45cd-9c29-b3008d76b010 service nova] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:40.699414 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4630b-133b-45cd-9c29-b3008d76b010 service nova] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:40.699688 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4630b-133b-45cd-9c29-b3008d76b010 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:40.701429 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-d3e4630b-133b-45cd-9c29-b3008d76b010 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:40.713836 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4630b-133b-45cd-9c29-b3008d76b010 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:40.715436 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4630b-133b-45cd-9c29-b3008d76b010 service nova] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:40.730585 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1387/2764] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:56:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:56:42.863171 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e47d82-abfd-47e6-94ea-f5a334d29633 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:42.863695 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e47d82-abfd-47e6-94ea-f5a334d29633 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:42.863695 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e47d82-abfd-47e6-94ea-f5a334d29633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:42.884169 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-52e47d82-abfd-47e6-94ea-f5a334d29633 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:56:42.885499 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-52e47d82-abfd-47e6-94ea-f5a334d29633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:42.894682 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1378/2765] 10.222.0.72 () {58 vars in 1016 bytes} [Wed Aug 24 04:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:56:42.915802 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4630b-133b-45cd-9c29-b3008d76b010 service nova] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:42.927748 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4630b-133b-45cd-9c29-b3008d76b010 service nova] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:42.933830 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664d749-d1cf-4fa9-afdc-5a213445a633 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:42.934483 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664d749-d1cf-4fa9-afdc-5a213445a633 service nova] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:42.934765 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664d749-d1cf-4fa9-afdc-5a213445a633 service nova] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:42.935036 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664d749-d1cf-4fa9-afdc-5a213445a633 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:42.944157 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a664d749-d1cf-4fa9-afdc-5a213445a633 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:42.945905 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a664d749-d1cf-4fa9-afdc-5a213445a633 service nova] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:42.955726 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1388/2766] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:56:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:56:46.032797 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c8869-a6ee-4e83-bdbe-1bd3cc66240c None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:46.033309 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c8869-a6ee-4e83-bdbe-1bd3cc66240c None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:46.033436 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c8869-a6ee-4e83-bdbe-1bd3cc66240c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:46.053882 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-518c8869-a6ee-4e83-bdbe-1bd3cc66240c None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:56:46.055110 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-518c8869-a6ee-4e83-bdbe-1bd3cc66240c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:46.064499 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1379/2767] 10.222.0.72 () {58 vars in 1016 bytes} [Wed Aug 24 04:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:56:46.088707 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664d749-d1cf-4fa9-afdc-5a213445a633 service nova] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:46.100986 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664d749-d1cf-4fa9-afdc-5a213445a633 service nova] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:46.108016 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b76e3-a6f6-4cca-b054-58aae81985e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:46.108619 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b76e3-a6f6-4cca-b054-58aae81985e9 service nova] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:46.108896 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b76e3-a6f6-4cca-b054-58aae81985e9 service nova] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:46.109166 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b76e3-a6f6-4cca-b054-58aae81985e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:46.118108 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b76e3-a6f6-4cca-b054-58aae81985e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:46.119692 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b76e3-a6f6-4cca-b054-58aae81985e9 service nova] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:46.129773 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1389/2768] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:56:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:56:48.609835 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c8869-a6ee-4e83-bdbe-1bd3cc66240c None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:48.611305 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-518c8869-a6ee-4e83-bdbe-1bd3cc66240c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:48.624821 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c8869-a6ee-4e83-bdbe-1bd3cc66240c None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:48.630050 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3cbd4b-b9b0-4822-9ee8-baf4c7a2e970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:48.630699 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cbd4b-b9b0-4822-9ee8-baf4c7a2e970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:48.630982 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cbd4b-b9b0-4822-9ee8-baf4c7a2e970 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:48.631256 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cbd4b-b9b0-4822-9ee8-baf4c7a2e970 admin admin] PATH_INFO: `/v3/users/d85ea8509d2342eebb50f04f11c0a99f` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:48.632484 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3cbd4b-b9b0-4822-9ee8-baf4c7a2e970 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d85ea8509d2342eebb50f04f11c0a99f)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:48.634482 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3cbd4b-b9b0-4822-9ee8-baf4c7a2e970 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:48.685709 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-1f3cbd4b-b9b0-4822-9ee8-baf4c7a2e970 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd85ea8509d2342eebb50f04f11c0a99f'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:48.694801 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-1f3cbd4b-b9b0-4822-9ee8-baf4c7a2e970 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd85ea8509d2342eebb50f04f11c0a99f'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:48.695516 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-1f3cbd4b-b9b0-4822-9ee8-baf4c7a2e970 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd85ea8509d2342eebb50f04f11c0a99f'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:48.709408 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-1f3cbd4b-b9b0-4822-9ee8-baf4c7a2e970 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd85ea8509d2342eebb50f04f11c0a99f'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:48.718790 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-1f3cbd4b-b9b0-4822-9ee8-baf4c7a2e970 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd85ea8509d2342eebb50f04f11c0a99f'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:48.732917 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1380/2769] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:56:48 2022] DELETE /identity/v3/users/d85ea8509d2342eebb50f04f11c0a99f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:56:48.908971 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b76e3-a6f6-4cca-b054-58aae81985e9 service nova] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:48.920416 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b76e3-a6f6-4cca-b054-58aae81985e9 service nova] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:48.980614 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b840a-4147-4bf4-bbd2-28731495649d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:48.981248 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b840a-4147-4bf4-bbd2-28731495649d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:48.981557 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b840a-4147-4bf4-bbd2-28731495649d admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:48.981831 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b840a-4147-4bf4-bbd2-28731495649d admin admin] PATH_INFO: `/v3/projects/b555d885bdfc4f3c8fd295c14a46c2c1` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:48.982956 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b840a-4147-4bf4-bbd2-28731495649d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b555d885bdfc4f3c8fd295c14a46c2c1)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:48.984904 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b840a-4147-4bf4-bbd2-28731495649d admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:49.033277 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-5a5b840a-4147-4bf4-bbd2-28731495649d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b555d885bdfc4f3c8fd295c14a46c2c1', 'request_id': 'req-5a5b840a-4147-4bf4-bbd2-28731495649d'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:49.040681 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-5a5b840a-4147-4bf4-bbd2-28731495649d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b555d885bdfc4f3c8fd295c14a46c2c1', 'request_id': 'req-5a5b840a-4147-4bf4-bbd2-28731495649d'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:49.051684 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-5a5b840a-4147-4bf4-bbd2-28731495649d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b555d885bdfc4f3c8fd295c14a46c2c1', 'request_id': 'req-5a5b840a-4147-4bf4-bbd2-28731495649d'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:49.069323 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-5a5b840a-4147-4bf4-bbd2-28731495649d admin admin] The token cache is being invalidate because project b555d885bdfc4f3c8fd295c14a46c2c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:56:49.069791 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-5a5b840a-4147-4bf4-bbd2-28731495649d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:49.070517 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-5a5b840a-4147-4bf4-bbd2-28731495649d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:49.072493 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1390/2770] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:56:48 2022] DELETE /identity/v3/projects/b555d885bdfc4f3c8fd295c14a46c2c1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:56:49.076648 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3cbd4b-b9b0-4822-9ee8-baf4c7a2e970 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:49.078190 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-1f3cbd4b-b9b0-4822-9ee8-baf4c7a2e970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:49.092505 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3cbd4b-b9b0-4822-9ee8-baf4c7a2e970 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:49.162448 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675031f8-12f7-4ea9-90a8-6d41fe8b3422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:49.163253 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675031f8-12f7-4ea9-90a8-6d41fe8b3422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:49.163602 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675031f8-12f7-4ea9-90a8-6d41fe8b3422 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:49.163945 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675031f8-12f7-4ea9-90a8-6d41fe8b3422 admin admin] PATH_INFO: `/v3/users/39afaa1dd0b048a8a43e2e987a347ebf` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:49.165153 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675031f8-12f7-4ea9-90a8-6d41fe8b3422 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39afaa1dd0b048a8a43e2e987a347ebf)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:49.167276 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675031f8-12f7-4ea9-90a8-6d41fe8b3422 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:49.173424 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:49.225747 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-675031f8-12f7-4ea9-90a8-6d41fe8b3422 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39afaa1dd0b048a8a43e2e987a347ebf'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:49.226394 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-675031f8-12f7-4ea9-90a8-6d41fe8b3422 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39afaa1dd0b048a8a43e2e987a347ebf'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:49.226972 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-675031f8-12f7-4ea9-90a8-6d41fe8b3422 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39afaa1dd0b048a8a43e2e987a347ebf'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:49.238875 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-675031f8-12f7-4ea9-90a8-6d41fe8b3422 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39afaa1dd0b048a8a43e2e987a347ebf'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:49.248181 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-675031f8-12f7-4ea9-90a8-6d41fe8b3422 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39afaa1dd0b048a8a43e2e987a347ebf'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:49.261497 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1381/2771] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:56:49 2022] DELETE /identity/v3/users/39afaa1dd0b048a8a43e2e987a347ebf => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:56:49.449490 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b840a-4147-4bf4-bbd2-28731495649d admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:49.450916 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-5a5b840a-4147-4bf4-bbd2-28731495649d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:49.466710 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b840a-4147-4bf4-bbd2-28731495649d admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:49.488982 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:49.529019 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d74501-3a90-44de-9bf4-15f3d86cc16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:49.529682 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d74501-3a90-44de-9bf4-15f3d86cc16c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:49.529952 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d74501-3a90-44de-9bf4-15f3d86cc16c admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:49.530217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d74501-3a90-44de-9bf4-15f3d86cc16c admin admin] PATH_INFO: `/v3/projects/0264c4f9176346cca09bfc2ab58a3f9f` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:49.531310 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d74501-3a90-44de-9bf4-15f3d86cc16c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0264c4f9176346cca09bfc2ab58a3f9f)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:49.533212 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d74501-3a90-44de-9bf4-15f3d86cc16c admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:49.581565 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-a2d74501-3a90-44de-9bf4-15f3d86cc16c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0264c4f9176346cca09bfc2ab58a3f9f', 'request_id': 'req-a2d74501-3a90-44de-9bf4-15f3d86cc16c'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:49.588653 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-a2d74501-3a90-44de-9bf4-15f3d86cc16c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0264c4f9176346cca09bfc2ab58a3f9f', 'request_id': 'req-a2d74501-3a90-44de-9bf4-15f3d86cc16c'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:49.599185 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-a2d74501-3a90-44de-9bf4-15f3d86cc16c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0264c4f9176346cca09bfc2ab58a3f9f', 'request_id': 'req-a2d74501-3a90-44de-9bf4-15f3d86cc16c'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:49.611172 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-a2d74501-3a90-44de-9bf4-15f3d86cc16c admin admin] The token cache is being invalidate because project 0264c4f9176346cca09bfc2ab58a3f9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:56:49.611373 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-a2d74501-3a90-44de-9bf4-15f3d86cc16c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:49.612082 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-a2d74501-3a90-44de-9bf4-15f3d86cc16c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:49.613728 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1391/2772] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:56:49 2022] DELETE /identity/v3/projects/0264c4f9176346cca09bfc2ab58a3f9f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:56:59.257688 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:59.607820 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:01.307179 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bec40-67cf-4c1d-b120-e3b1fc8771b7 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:01.311049 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bec40-67cf-4c1d-b120-e3b1fc8771b7 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:01.311295 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794bec40-67cf-4c1d-b120-e3b1fc8771b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:01.331663 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-794bec40-67cf-4c1d-b120-e3b1fc8771b7 None None] MFA Rules not processed for user `cf39aa1c38574c0e9217a42bca716783`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:57:01.333097 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-794bec40-67cf-4c1d-b120-e3b1fc8771b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:57:01.391407 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1382/2773] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:57:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:57:01.700771 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d74501-3a90-44de-9bf4-15f3d86cc16c admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:57:01.702415 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-a2d74501-3a90-44de-9bf4-15f3d86cc16c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:57:01.763806 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d74501-3a90-44de-9bf4-15f3d86cc16c admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:57:01.767544 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95538405-dfb2-48eb-a56a-e27a9dd24e26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:57:01.768172 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95538405-dfb2-48eb-a56a-e27a9dd24e26 service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:01.768447 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95538405-dfb2-48eb-a56a-e27a9dd24e26 service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:01.768713 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95538405-dfb2-48eb-a56a-e27a9dd24e26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:01.770715 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-95538405-dfb2-48eb-a56a-e27a9dd24e26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:57:01.785745 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95538405-dfb2-48eb-a56a-e27a9dd24e26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:57:01.787205 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95538405-dfb2-48eb-a56a-e27a9dd24e26 service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:57:01.795956 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1392/2774] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:57:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:57:02.903930 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784dd31-82b3-49ed-a426-b2066c941e73 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:02.904496 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784dd31-82b3-49ed-a426-b2066c941e73 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:02.904496 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784dd31-82b3-49ed-a426-b2066c941e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:02.931786 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-a784dd31-82b3-49ed-a426-b2066c941e73 None None] MFA Rules not processed for user `859775d2666a49feb933b86261391684`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:57:02.933555 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-a784dd31-82b3-49ed-a426-b2066c941e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:57:02.996680 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1383/2775] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:57:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:57:11.791980 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=26 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:12.989032 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=50 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:14.806903 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4d482-0223-4556-818b-bf7ec6169057 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:14.807484 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4d482-0223-4556-818b-bf7ec6169057 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:14.807484 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4d482-0223-4556-818b-bf7ec6169057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:14.832988 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-11d4d482-0223-4556-818b-bf7ec6169057 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:57:14.834436 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-11d4d482-0223-4556-818b-bf7ec6169057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:57:14.909131 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1393/2776] 10.222.0.72 () {58 vars in 1016 bytes} [Wed Aug 24 04:57:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:57:14.931775 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784dd31-82b3-49ed-a426-b2066c941e73 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:57:14.934720 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-a784dd31-82b3-49ed-a426-b2066c941e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:57:15.027066 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784dd31-82b3-49ed-a426-b2066c941e73 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:57:15.034476 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b279512-0f35-4521-9257-33dda57b9d8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:57:15.035886 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b279512-0f35-4521-9257-33dda57b9d8c service nova] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:15.036255 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b279512-0f35-4521-9257-33dda57b9d8c service nova] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:15.036749 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b279512-0f35-4521-9257-33dda57b9d8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:15.048916 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b279512-0f35-4521-9257-33dda57b9d8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:57:15.050559 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b279512-0f35-4521-9257-33dda57b9d8c service nova] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:57:15.061106 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1384/2777] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:57:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:57:18.066409 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd1a94-5b87-4853-8314-9ad11ad27a14 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:18.067114 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd1a94-5b87-4853-8314-9ad11ad27a14 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:18.067114 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd1a94-5b87-4853-8314-9ad11ad27a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:18.090165 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-09cd1a94-5b87-4853-8314-9ad11ad27a14 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:57:18.091371 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-09cd1a94-5b87-4853-8314-9ad11ad27a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:57:18.101207 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1394/2778] 10.222.0.72 () {58 vars in 1016 bytes} [Wed Aug 24 04:57:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:57:18.123077 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b279512-0f35-4521-9257-33dda57b9d8c service nova] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:57:18.124733 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-0b279512-0f35-4521-9257-33dda57b9d8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:57:18.140949 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b279512-0f35-4521-9257-33dda57b9d8c service nova] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:57:18.148267 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adcba19-7ed2-4dfc-85ec-0dab6770d690 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:57:18.148883 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcba19-7ed2-4dfc-85ec-0dab6770d690 service nova] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:18.149186 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcba19-7ed2-4dfc-85ec-0dab6770d690 service nova] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:18.149470 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcba19-7ed2-4dfc-85ec-0dab6770d690 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:18.158387 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adcba19-7ed2-4dfc-85ec-0dab6770d690 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:57:18.159981 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adcba19-7ed2-4dfc-85ec-0dab6770d690 service nova] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:57:18.169659 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1385/2779] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:57:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:57:21.160684 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a62611-5770-40c8-b94d-8303cf110010 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:21.161233 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a62611-5770-40c8-b94d-8303cf110010 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:21.161233 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a62611-5770-40c8-b94d-8303cf110010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:21.181859 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-93a62611-5770-40c8-b94d-8303cf110010 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:57:21.183060 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-93a62611-5770-40c8-b94d-8303cf110010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:57:21.191829 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1395/2780] 10.222.0.72 () {58 vars in 1016 bytes} [Wed Aug 24 04:57:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:57:21.214118 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adcba19-7ed2-4dfc-85ec-0dab6770d690 service nova] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:57:21.226446 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adcba19-7ed2-4dfc-85ec-0dab6770d690 service nova] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:57:21.233299 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2cda0-8204-4df3-8b0c-fc6ab819ba0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:57:21.234000 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2cda0-8204-4df3-8b0c-fc6ab819ba0f service nova] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:21.234281 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2cda0-8204-4df3-8b0c-fc6ab819ba0f service nova] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:21.234551 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b2cda0-8204-4df3-8b0c-fc6ab819ba0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:21.243555 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2cda0-8204-4df3-8b0c-fc6ab819ba0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:57:21.245150 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b2cda0-8204-4df3-8b0c-fc6ab819ba0f service nova] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:57:21.255843 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1386/2781] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:57:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:57:24.345838 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a2c38-0b8e-4a72-bfa7-730e51c7982b None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:24.346687 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a2c38-0b8e-4a72-bfa7-730e51c7982b None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:24.346687 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a2c38-0b8e-4a72-bfa7-730e51c7982b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:24.377450 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-b98a2c38-0b8e-4a72-bfa7-730e51c7982b None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:57:24.378654 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-b98a2c38-0b8e-4a72-bfa7-730e51c7982b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:57:24.388192 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1396/2782] 10.222.0.72 () {58 vars in 1016 bytes} [Wed Aug 24 04:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:57:24.410817 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2cda0-8204-4df3-8b0c-fc6ab819ba0f service nova] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:57:24.422660 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b2cda0-8204-4df3-8b0c-fc6ab819ba0f service nova] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:57:24.429749 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b278f-6c75-4e28-a276-c9c40f77ff77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:57:24.430349 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b278f-6c75-4e28-a276-c9c40f77ff77 service nova] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:24.430627 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b278f-6c75-4e28-a276-c9c40f77ff77 service nova] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:24.430904 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5b278f-6c75-4e28-a276-c9c40f77ff77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:24.439636 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b278f-6c75-4e28-a276-c9c40f77ff77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:57:24.441218 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5b278f-6c75-4e28-a276-c9c40f77ff77 service nova] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:57:24.451312 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1387/2783] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:57:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:57:27.522753 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5e6cc-0a56-448b-aca7-3ee03de865ee None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:27.523348 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5e6cc-0a56-448b-aca7-3ee03de865ee None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:27.523348 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5e6cc-0a56-448b-aca7-3ee03de865ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:27.614529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-96e5e6cc-0a56-448b-aca7-3ee03de865ee None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:57:27.615756 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-96e5e6cc-0a56-448b-aca7-3ee03de865ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:57:27.667015 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1397/2784] 10.222.0.72 () {58 vars in 1016 bytes} [Wed Aug 24 04:57:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:57:27.690986 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b278f-6c75-4e28-a276-c9c40f77ff77 service nova] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:57:27.761915 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5b278f-6c75-4e28-a276-c9c40f77ff77 service nova] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:57:27.768135 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af425b2-846d-40b8-94f1-159b50df454b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:57:27.768792 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af425b2-846d-40b8-94f1-159b50df454b service nova] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:27.769070 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af425b2-846d-40b8-94f1-159b50df454b service nova] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:27.769355 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af425b2-846d-40b8-94f1-159b50df454b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:27.777806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af425b2-846d-40b8-94f1-159b50df454b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:57:27.779436 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af425b2-846d-40b8-94f1-159b50df454b service nova] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:57:27.789176 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1388/2785] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:57:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:57:37.664720 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=81 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:37.785010 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=82 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:57.011104 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5e6cc-0a56-448b-aca7-3ee03de865ee None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:57:57.013884 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-96e5e6cc-0a56-448b-aca7-3ee03de865ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:57:57.030049 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5e6cc-0a56-448b-aca7-3ee03de865ee None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:57:57.035117 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1152db-9e31-422d-93f6-66631ec8c055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:57:57.035751 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1152db-9e31-422d-93f6-66631ec8c055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:57.035932 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1152db-9e31-422d-93f6-66631ec8c055 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:57.036199 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1152db-9e31-422d-93f6-66631ec8c055 admin admin] PATH_INFO: `/v3/users/cf39aa1c38574c0e9217a42bca716783` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:57.037447 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1152db-9e31-422d-93f6-66631ec8c055 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf39aa1c38574c0e9217a42bca716783)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:57:57.039258 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1152db-9e31-422d-93f6-66631ec8c055 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:57:57.091910 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-ac1152db-9e31-422d-93f6-66631ec8c055 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf39aa1c38574c0e9217a42bca716783'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:57.092653 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-ac1152db-9e31-422d-93f6-66631ec8c055 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf39aa1c38574c0e9217a42bca716783'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:57.093271 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-ac1152db-9e31-422d-93f6-66631ec8c055 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf39aa1c38574c0e9217a42bca716783'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:57.106350 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-ac1152db-9e31-422d-93f6-66631ec8c055 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf39aa1c38574c0e9217a42bca716783'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:57.114898 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-ac1152db-9e31-422d-93f6-66631ec8c055 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf39aa1c38574c0e9217a42bca716783'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:57.128459 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1398/2786] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:57:57 2022] DELETE /identity/v3/users/cf39aa1c38574c0e9217a42bca716783 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:57:57.317528 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af425b2-846d-40b8-94f1-159b50df454b service nova] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:57:57.336676 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af425b2-846d-40b8-94f1-159b50df454b service nova] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:57:57.395729 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c92131-e2d3-4805-ae0a-bca5570ee201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:57:57.396394 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c92131-e2d3-4805-ae0a-bca5570ee201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:57.396674 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c92131-e2d3-4805-ae0a-bca5570ee201 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:57.396945 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c92131-e2d3-4805-ae0a-bca5570ee201 admin admin] PATH_INFO: `/v3/projects/3a9237a53a8a4d42b25d1666ef19c2d5` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:57.398098 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c92131-e2d3-4805-ae0a-bca5570ee201 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a9237a53a8a4d42b25d1666ef19c2d5)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:57:57.400200 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c92131-e2d3-4805-ae0a-bca5570ee201 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:57:57.444378 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-d5c92131-e2d3-4805-ae0a-bca5570ee201 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a9237a53a8a4d42b25d1666ef19c2d5', 'request_id': 'req-d5c92131-e2d3-4805-ae0a-bca5570ee201'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:57.452765 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-d5c92131-e2d3-4805-ae0a-bca5570ee201 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a9237a53a8a4d42b25d1666ef19c2d5', 'request_id': 'req-d5c92131-e2d3-4805-ae0a-bca5570ee201'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:57.459013 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-d5c92131-e2d3-4805-ae0a-bca5570ee201 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a9237a53a8a4d42b25d1666ef19c2d5', 'request_id': 'req-d5c92131-e2d3-4805-ae0a-bca5570ee201'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:57.470041 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-d5c92131-e2d3-4805-ae0a-bca5570ee201 admin admin] The token cache is being invalidate because project 3a9237a53a8a4d42b25d1666ef19c2d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:57:57.470325 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-d5c92131-e2d3-4805-ae0a-bca5570ee201 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:57.470972 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-d5c92131-e2d3-4805-ae0a-bca5570ee201 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:57.472522 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1389/2787] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:57:57 2022] DELETE /identity/v3/projects/3a9237a53a8a4d42b25d1666ef19c2d5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:58:07.124736 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:58:07.466920 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:58:12.590335 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57195ec7-d07e-4b9a-813c-d3456b1f9f98 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:12.590826 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57195ec7-d07e-4b9a-813c-d3456b1f9f98 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:12.590935 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57195ec7-d07e-4b9a-813c-d3456b1f9f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:12.621692 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-57195ec7-d07e-4b9a-813c-d3456b1f9f98 None None] MFA Rules not processed for user `c737c4586910476eafead0dfd4d9bc4c`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:58:12.622908 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-57195ec7-d07e-4b9a-813c-d3456b1f9f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:58:12.688962 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1399/2788] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 24 04:58:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:58:12.741818 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c92131-e2d3-4805-ae0a-bca5570ee201 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:58:12.743293 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-d5c92131-e2d3-4805-ae0a-bca5570ee201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:58:12.815137 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c92131-e2d3-4805-ae0a-bca5570ee201 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:58:12.821376 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf9421-175c-42f6-82c8-ba5caad3cea0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ebb5105220438693118d734c9fda70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:58:12.821710 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf9421-175c-42f6-82c8-ba5caad3cea0 service swift] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:12.821828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf9421-175c-42f6-82c8-ba5caad3cea0 service swift] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:12.822079 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf9421-175c-42f6-82c8-ba5caad3cea0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:12.830712 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf9421-175c-42f6-82c8-ba5caad3cea0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:58:12.832328 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf9421-175c-42f6-82c8-ba5caad3cea0 service swift] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:58:12.840735 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1390/2789] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 24 04:58:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:58:22.681606 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=29 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:58:22.837765 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=32 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:58:27.660123 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2095742-efd9-4101-9ebe-e7607e1f1f5a None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:27.660648 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2095742-efd9-4101-9ebe-e7607e1f1f5a None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:27.660648 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2095742-efd9-4101-9ebe-e7607e1f1f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:27.680907 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-a2095742-efd9-4101-9ebe-e7607e1f1f5a None None] MFA Rules not processed for user `c737c4586910476eafead0dfd4d9bc4c`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:58:27.682805 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-a2095742-efd9-4101-9ebe-e7607e1f1f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:58:27.691272 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1400/2790] 10.222.0.49 () {58 vars in 1009 bytes} [Wed Aug 24 04:58:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:58:27.705856 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf9421-175c-42f6-82c8-ba5caad3cea0 service swift] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:58:27.726220 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf9421-175c-42f6-82c8-ba5caad3cea0 service swift] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:58:27.732937 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfdcb3-6de7-4789-928f-98cc2a4e9407 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ebb5105220438693118d734c9fda70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:58:27.733573 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfdcb3-6de7-4789-928f-98cc2a4e9407 service swift] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:27.733851 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfdcb3-6de7-4789-928f-98cc2a4e9407 service swift] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:27.734123 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfdcb3-6de7-4789-928f-98cc2a4e9407 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:27.743901 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dfdcb3-6de7-4789-928f-98cc2a4e9407 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:58:27.745544 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dfdcb3-6de7-4789-928f-98cc2a4e9407 service swift] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:58:27.754603 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1391/2791] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 24 04:58:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:58:37.597131 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2095742-efd9-4101-9ebe-e7607e1f1f5a None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:58:37.599202 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-a2095742-efd9-4101-9ebe-e7607e1f1f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:58:37.696686 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2095742-efd9-4101-9ebe-e7607e1f1f5a None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:58:37.702753 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3536d0e-ca19-4df3-868e-3a9b9891d2dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf1b960a2eb4e5e9ada736b5f3f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:58:37.703394 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3536d0e-ca19-4df3-868e-3a9b9891d2dd service placement] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:37.703671 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3536d0e-ca19-4df3-868e-3a9b9891d2dd service placement] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:37.703942 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3536d0e-ca19-4df3-868e-3a9b9891d2dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:37.705721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-e3536d0e-ca19-4df3-868e-3a9b9891d2dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:58:37.717508 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3536d0e-ca19-4df3-868e-3a9b9891d2dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:58:37.719103 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3536d0e-ca19-4df3-868e-3a9b9891d2dd service placement] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:58:37.729558 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1401/2792] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:58:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:58:37.750876 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=6 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:58:42.873598 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f246bbe-a4ca-4a87-adb1-628421cf791b None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:42.874219 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f246bbe-a4ca-4a87-adb1-628421cf791b None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:42.874219 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f246bbe-a4ca-4a87-adb1-628421cf791b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:42.894992 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-0f246bbe-a4ca-4a87-adb1-628421cf791b None None] MFA Rules not processed for user `c737c4586910476eafead0dfd4d9bc4c`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:58:42.896070 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-0f246bbe-a4ca-4a87-adb1-628421cf791b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:58:42.904435 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1392/2793] 10.222.0.49 () {58 vars in 967 bytes} [Wed Aug 24 04:58:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:58:42.918772 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3536d0e-ca19-4df3-868e-3a9b9891d2dd service placement] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:58:42.930271 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3536d0e-ca19-4df3-868e-3a9b9891d2dd service placement] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:58:42.935440 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d0e8e-c33e-47c3-bfe1-601317155c05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7ebb5105220438693118d734c9fda70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:58:42.936039 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d0e8e-c33e-47c3-bfe1-601317155c05 service swift] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:42.936317 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d0e8e-c33e-47c3-bfe1-601317155c05 service swift] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:42.936586 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d0e8e-c33e-47c3-bfe1-601317155c05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:42.945129 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d0e8e-c33e-47c3-bfe1-601317155c05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:58:42.946798 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d0e8e-c33e-47c3-bfe1-601317155c05 service swift] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:58:42.955387 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1402/2794] 10.222.0.49 () {60 vars in 1384 bytes} [Wed Aug 24 04:58:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:58:52.889622 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=3 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:58:52.952323 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=50 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:24.879760 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f246bbe-a4ca-4a87-adb1-628421cf791b None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:24.881429 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-0f246bbe-a4ca-4a87-adb1-628421cf791b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:24.962880 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f246bbe-a4ca-4a87-adb1-628421cf791b None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:24.967301 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b3dc8-04b0-41ca-993e-f53c03e71d9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:24.967923 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b3dc8-04b0-41ca-993e-f53c03e71d9e service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:24.968351 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b3dc8-04b0-41ca-993e-f53c03e71d9e service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:24.968629 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b3dc8-04b0-41ca-993e-f53c03e71d9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:24.970695 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-918b3dc8-04b0-41ca-993e-f53c03e71d9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:25.035463 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b3dc8-04b0-41ca-993e-f53c03e71d9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:25.036850 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b3dc8-04b0-41ca-993e-f53c03e71d9e service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:25.049531 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1393/2795] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:59:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:59:26.578156 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d0e8e-c33e-47c3-bfe1-601317155c05 service swift] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:26.590569 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d0e8e-c33e-47c3-bfe1-601317155c05 service swift] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:26.596857 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd835bb-b8ad-4d2b-8532-e1994dfd26c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf1b960a2eb4e5e9ada736b5f3f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:26.597463 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd835bb-b8ad-4d2b-8532-e1994dfd26c0 service placement] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:26.597771 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd835bb-b8ad-4d2b-8532-e1994dfd26c0 service placement] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:26.598064 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd835bb-b8ad-4d2b-8532-e1994dfd26c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:26.600121 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-fbd835bb-b8ad-4d2b-8532-e1994dfd26c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:26.613829 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd835bb-b8ad-4d2b-8532-e1994dfd26c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:26.615461 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd835bb-b8ad-4d2b-8532-e1994dfd26c0 service placement] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:26.626534 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1403/2796] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:59:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:59:26.633073 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b3dc8-04b0-41ca-993e-f53c03e71d9e service neutron] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:26.634647 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-918b3dc8-04b0-41ca-993e-f53c03e71d9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:26.649419 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b3dc8-04b0-41ca-993e-f53c03e71d9e service neutron] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:26.655175 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f6811-11f2-439d-8e53-e6fc64b0cc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:26.655829 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f6811-11f2-439d-8e53-e6fc64b0cc97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:26.656111 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f6811-11f2-439d-8e53-e6fc64b0cc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:26.656388 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f6811-11f2-439d-8e53-e6fc64b0cc97 admin admin] PATH_INFO: `/v3/users/859775d2666a49feb933b86261391684` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:26.657582 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f6811-11f2-439d-8e53-e6fc64b0cc97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=859775d2666a49feb933b86261391684)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:26.659628 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f6811-11f2-439d-8e53-e6fc64b0cc97 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:26.713822 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-c77f6811-11f2-439d-8e53-e6fc64b0cc97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '859775d2666a49feb933b86261391684'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:26.714427 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-c77f6811-11f2-439d-8e53-e6fc64b0cc97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '859775d2666a49feb933b86261391684'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:26.715036 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-c77f6811-11f2-439d-8e53-e6fc64b0cc97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '859775d2666a49feb933b86261391684'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:26.727012 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-c77f6811-11f2-439d-8e53-e6fc64b0cc97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '859775d2666a49feb933b86261391684'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:26.736918 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-c77f6811-11f2-439d-8e53-e6fc64b0cc97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '859775d2666a49feb933b86261391684'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:26.749516 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1394/2797] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 04:59:26 2022] DELETE /identity/v3/users/859775d2666a49feb933b86261391684 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:59:26.947478 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd835bb-b8ad-4d2b-8532-e1994dfd26c0 service placement] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:26.958998 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd835bb-b8ad-4d2b-8532-e1994dfd26c0 service placement] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:27.015526 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546abdc3-8d11-46d8-ac60-f0aeaea81afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:27.016113 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546abdc3-8d11-46d8-ac60-f0aeaea81afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:27.016382 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546abdc3-8d11-46d8-ac60-f0aeaea81afa admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:27.016684 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546abdc3-8d11-46d8-ac60-f0aeaea81afa admin admin] PATH_INFO: `/v3/projects/3945040b058b41ab8c08d5e861d277fd` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:27.017814 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546abdc3-8d11-46d8-ac60-f0aeaea81afa admin admin] RBAC: Authorizing `identity:delete_project(project_id=3945040b058b41ab8c08d5e861d277fd)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:27.019761 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546abdc3-8d11-46d8-ac60-f0aeaea81afa admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:27.067109 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-546abdc3-8d11-46d8-ac60-f0aeaea81afa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3945040b058b41ab8c08d5e861d277fd', 'request_id': 'req-546abdc3-8d11-46d8-ac60-f0aeaea81afa'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:27.073386 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-546abdc3-8d11-46d8-ac60-f0aeaea81afa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3945040b058b41ab8c08d5e861d277fd', 'request_id': 'req-546abdc3-8d11-46d8-ac60-f0aeaea81afa'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:27.082462 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-546abdc3-8d11-46d8-ac60-f0aeaea81afa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3945040b058b41ab8c08d5e861d277fd', 'request_id': 'req-546abdc3-8d11-46d8-ac60-f0aeaea81afa'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:27.095883 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-546abdc3-8d11-46d8-ac60-f0aeaea81afa admin admin] The token cache is being invalidate because project 3945040b058b41ab8c08d5e861d277fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:59:27.096190 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-546abdc3-8d11-46d8-ac60-f0aeaea81afa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:27.096911 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-546abdc3-8d11-46d8-ac60-f0aeaea81afa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:27.098496 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1404/2798] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 04:59:26 2022] DELETE /identity/v3/projects/3945040b058b41ab8c08d5e861d277fd => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:59:27.103876 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e4829-7968-45ea-8651-95190b87fe68 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:27.104109 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e4829-7968-45ea-8651-95190b87fe68 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:27.104386 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e4829-7968-45ea-8651-95190b87fe68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:27.113267 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:27.127590 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-771e4829-7968-45ea-8651-95190b87fe68 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:59:27.128887 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-771e4829-7968-45ea-8651-95190b87fe68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:27.189651 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1395/2799] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:59:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:59:27.198654 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfe403-9656-460d-b69b-e455f9660d5e None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:27.198940 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfe403-9656-460d-b69b-e455f9660d5e None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:27.199215 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfe403-9656-460d-b69b-e455f9660d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:27.220524 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-39dfe403-9656-460d-b69b-e455f9660d5e None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:59:27.221903 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-39dfe403-9656-460d-b69b-e455f9660d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:27.231200 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1405/2800] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:59:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:59:27.235738 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e4829-7968-45ea-8651-95190b87fe68 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:27.246263 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e4829-7968-45ea-8651-95190b87fe68 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:27.251167 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53dc6f-6079-40a0-8e7e-23cb2da94a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:27.251765 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53dc6f-6079-40a0-8e7e-23cb2da94a65 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:27.252040 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53dc6f-6079-40a0-8e7e-23cb2da94a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:27.252305 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53dc6f-6079-40a0-8e7e-23cb2da94a65 admin admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:27.252964 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53dc6f-6079-40a0-8e7e-23cb2da94a65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:59:27.253258 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53dc6f-6079-40a0-8e7e-23cb2da94a65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:27.255171 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53dc6f-6079-40a0-8e7e-23cb2da94a65 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:27.267022 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1396/2801] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 04:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:59:27.271541 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dfe403-9656-460d-b69b-e455f9660d5e None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:27.281248 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dfe403-9656-460d-b69b-e455f9660d5e None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:27.287190 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983534d0-4a4c-4eb2-b7b9-5a66d3d0c502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:27.287817 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983534d0-4a4c-4eb2-b7b9-5a66d3d0c502 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:27.288094 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983534d0-4a4c-4eb2-b7b9-5a66d3d0c502 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:27.288361 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983534d0-4a4c-4eb2-b7b9-5a66d3d0c502 admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:27.289004 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983534d0-4a4c-4eb2-b7b9-5a66d3d0c502 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:27.290994 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983534d0-4a4c-4eb2-b7b9-5a66d3d0c502 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:27.341040 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1406/2802] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 04:59:27 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:59:27.342519 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53dc6f-6079-40a0-8e7e-23cb2da94a65 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:27.352762 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53dc6f-6079-40a0-8e7e-23cb2da94a65 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:27.414142 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a62f73-3131-490e-9105-ba3cf3801c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:27.414876 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a62f73-3131-490e-9105-ba3cf3801c80 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:27.415274 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a62f73-3131-490e-9105-ba3cf3801c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:27.415645 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a62f73-3131-490e-9105-ba3cf3801c80 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:27.416624 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a62f73-3131-490e-9105-ba3cf3801c80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:27.419666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a62f73-3131-490e-9105-ba3cf3801c80 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:27.444752 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1397/2803] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 04:59:27 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:59:27.449154 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983534d0-4a4c-4eb2-b7b9-5a66d3d0c502 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:27.460258 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983534d0-4a4c-4eb2-b7b9-5a66d3d0c502 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:27.465954 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88d315-46bf-4d4e-89c8-b2a0a6959fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:27.466571 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88d315-46bf-4d4e-89c8-b2a0a6959fed admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:27.466845 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88d315-46bf-4d4e-89c8-b2a0a6959fed admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:27.467117 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88d315-46bf-4d4e-89c8-b2a0a6959fed admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:27.467769 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88d315-46bf-4d4e-89c8-b2a0a6959fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:27.469364 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88d315-46bf-4d4e-89c8-b2a0a6959fed admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:27.480280 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1407/2804] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:59:27.484537 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a62f73-3131-490e-9105-ba3cf3801c80 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:27.495422 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a62f73-3131-490e-9105-ba3cf3801c80 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:27.500682 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090b1a2-4da7-432e-9019-609ba77b590e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:27.501305 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090b1a2-4da7-432e-9019-609ba77b590e admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:27.501612 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090b1a2-4da7-432e-9019-609ba77b590e admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:27.501886 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090b1a2-4da7-432e-9019-609ba77b590e admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:27.502536 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090b1a2-4da7-432e-9019-609ba77b590e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:27.504166 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090b1a2-4da7-432e-9019-609ba77b590e admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:27.516311 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1398/2805] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 04:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:59:27.520748 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88d315-46bf-4d4e-89c8-b2a0a6959fed admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:27.531170 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88d315-46bf-4d4e-89c8-b2a0a6959fed admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:27.536720 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13449d04-790c-4c29-82a2-4d9c894772d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:27.537428 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13449d04-790c-4c29-82a2-4d9c894772d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:27.537697 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13449d04-790c-4c29-82a2-4d9c894772d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:27.537981 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13449d04-790c-4c29-82a2-4d9c894772d5 admin admin] PATH_INFO: `/v3/projects/f58e8b4d90a74d4294f636c832aeae86/users/f84e50d96b11464ebe121ea15e2dd81b/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:27.554186 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13449d04-790c-4c29-82a2-4d9c894772d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f58e8b4d90a74d4294f636c832aeae86, user_id=f84e50d96b11464ebe121ea15e2dd81b, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:27.556884 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13449d04-790c-4c29-82a2-4d9c894772d5 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:27.573227 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1408/2806] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 04:59:27 2022] PUT /identity/v3/projects/f58e8b4d90a74d4294f636c832aeae86/users/f84e50d96b11464ebe121ea15e2dd81b/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:59:27.578443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e548f-25d3-4c6b-aa64-90a565c6c5aa None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:27.578732 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e548f-25d3-4c6b-aa64-90a565c6c5aa None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:27.579037 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e548f-25d3-4c6b-aa64-90a565c6c5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:27.598341 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-392e548f-25d3-4c6b-aa64-90a565c6c5aa None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:59:27.599518 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-392e548f-25d3-4c6b-aa64-90a565c6c5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:27.663515 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1399/2807] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:59:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:59:27.675500 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13449d04-790c-4c29-82a2-4d9c894772d5 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:27.677859 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-13449d04-790c-4c29-82a2-4d9c894772d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:27.687176 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:27.743577 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13449d04-790c-4c29-82a2-4d9c894772d5 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:27.747384 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4adc5fc-b996-48bd-a605-d2b8ddb2b7c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:27.747989 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adc5fc-b996-48bd-a605-d2b8ddb2b7c9 service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:27.748262 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adc5fc-b996-48bd-a605-d2b8ddb2b7c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:27.748529 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adc5fc-b996-48bd-a605-d2b8ddb2b7c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:27.757941 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4adc5fc-b996-48bd-a605-d2b8ddb2b7c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:27.759379 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4adc5fc-b996-48bd-a605-d2b8ddb2b7c9 service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:27.768712 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1409/2808] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:59:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:59:31.707436 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3102d1-b30f-4054-9113-b5cd4f5c7f65 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:31.708035 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3102d1-b30f-4054-9113-b5cd4f5c7f65 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:31.708166 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3102d1-b30f-4054-9113-b5cd4f5c7f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:31.730677 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:31.743246 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-ab3102d1-b30f-4054-9113-b5cd4f5c7f65 None None] MFA Rules not processed for user `f84e50d96b11464ebe121ea15e2dd81b`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:59:31.744550 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-ab3102d1-b30f-4054-9113-b5cd4f5c7f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:31.817746 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1400/2809] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:59:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:59:31.832680 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4adc5fc-b996-48bd-a605-d2b8ddb2b7c9 service neutron] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:31.834448 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-a4adc5fc-b996-48bd-a605-d2b8ddb2b7c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:31.926915 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4adc5fc-b996-48bd-a605-d2b8ddb2b7c9 service neutron] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:31.951478 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224ded9-c85d-464f-87fb-d3bb558cbb1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:31.952352 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224ded9-c85d-464f-87fb-d3bb558cbb1f service nova] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:31.952633 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224ded9-c85d-464f-87fb-d3bb558cbb1f service nova] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:31.952908 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224ded9-c85d-464f-87fb-d3bb558cbb1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:31.965781 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4224ded9-c85d-464f-87fb-d3bb558cbb1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:31.967322 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4224ded9-c85d-464f-87fb-d3bb558cbb1f service nova] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:31.976473 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1410/2810] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:59:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:59:34.274452 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a931d-6ffe-4920-a1f9-a35eec82ebc2 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:34.275182 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a931d-6ffe-4920-a1f9-a35eec82ebc2 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:34.275182 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a931d-6ffe-4920-a1f9-a35eec82ebc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:34.297025 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-dd0a931d-6ffe-4920-a1f9-a35eec82ebc2 None None] MFA Rules not processed for user `f84e50d96b11464ebe121ea15e2dd81b`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:59:34.298306 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-dd0a931d-6ffe-4920-a1f9-a35eec82ebc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:34.306195 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1401/2811] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 04:59:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:59:34.350721 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224ded9-c85d-464f-87fb-d3bb558cbb1f service nova] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:34.352298 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-4224ded9-c85d-464f-87fb-d3bb558cbb1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:34.414413 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224ded9-c85d-464f-87fb-d3bb558cbb1f service nova] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:34.418823 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e4a11-e1d5-42a8-89a2-b2510937000c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be44ea93247420d994e24912a9ac32e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:34.419618 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e4a11-e1d5-42a8-89a2-b2510937000c service glance] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:34.419896 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e4a11-e1d5-42a8-89a2-b2510937000c service glance] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:34.420174 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e4a11-e1d5-42a8-89a2-b2510937000c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:34.422099 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-4e8e4a11-e1d5-42a8-89a2-b2510937000c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:34.437885 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e4a11-e1d5-42a8-89a2-b2510937000c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:34.439795 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e4a11-e1d5-42a8-89a2-b2510937000c service glance] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:34.453225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1411/2812] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:59:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:59:35.123536 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a931d-6ffe-4920-a1f9-a35eec82ebc2 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:35.138495 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a931d-6ffe-4920-a1f9-a35eec82ebc2 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:35.142384 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419be07-07df-4886-a64e-3911e550bb03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:35.143152 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419be07-07df-4886-a64e-3911e550bb03 service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:35.143415 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419be07-07df-4886-a64e-3911e550bb03 service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:35.143541 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419be07-07df-4886-a64e-3911e550bb03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:35.148399 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-0419be07-07df-4886-a64e-3911e550bb03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:35.177811 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0419be07-07df-4886-a64e-3911e550bb03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:35.179323 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0419be07-07df-4886-a64e-3911e550bb03 service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:35.192084 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1402/2813] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 04:59:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:59:44.448533 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=89 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:45.186144 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=37 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:28.666148 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48693586-ae57-4d36-afda-28ffe63d48d4 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:28.666713 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48693586-ae57-4d36-afda-28ffe63d48d4 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:28.666713 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48693586-ae57-4d36-afda-28ffe63d48d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:28.685693 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-48693586-ae57-4d36-afda-28ffe63d48d4 None None] MFA Rules not processed for user `f84e50d96b11464ebe121ea15e2dd81b`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:28.686898 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-48693586-ae57-4d36-afda-28ffe63d48d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:28.694356 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1412/2814] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 05:00:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:00:29.018729 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419be07-07df-4886-a64e-3911e550bb03 service neutron] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:29.027963 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419be07-07df-4886-a64e-3911e550bb03 service neutron] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:29.032465 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2b820-b591-43e4-860b-6a956a83b9de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:29.033051 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2b820-b591-43e4-860b-6a956a83b9de service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:29.033347 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2b820-b591-43e4-860b-6a956a83b9de service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:29.033590 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2b820-b591-43e4-860b-6a956a83b9de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:29.035692 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-c2f2b820-b591-43e4-860b-6a956a83b9de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:29.045916 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2b820-b591-43e4-860b-6a956a83b9de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:29.047348 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2b820-b591-43e4-860b-6a956a83b9de service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:29.055677 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1403/2815] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 05:00:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:00:29.417159 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48693586-ae57-4d36-afda-28ffe63d48d4 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:29.418710 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-48693586-ae57-4d36-afda-28ffe63d48d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:29.500543 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48693586-ae57-4d36-afda-28ffe63d48d4 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:29.506456 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a1da0-24a2-4e28-afaf-9b9cdd28f8a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf1b960a2eb4e5e9ada736b5f3f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:29.507155 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a1da0-24a2-4e28-afaf-9b9cdd28f8a0 service placement] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:29.507438 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a1da0-24a2-4e28-afaf-9b9cdd28f8a0 service placement] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:29.507709 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371a1da0-24a2-4e28-afaf-9b9cdd28f8a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:29.509549 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-371a1da0-24a2-4e28-afaf-9b9cdd28f8a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:29.523553 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a1da0-24a2-4e28-afaf-9b9cdd28f8a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:29.525134 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371a1da0-24a2-4e28-afaf-9b9cdd28f8a0 service placement] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:29.534935 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1413/2816] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 05:00:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:00:31.783451 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2b820-b591-43e4-860b-6a956a83b9de service neutron] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:31.792350 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2b820-b591-43e4-860b-6a956a83b9de service neutron] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:31.795977 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144d25b-878a-4dac-9b2f-44f148be5e4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:31.796578 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144d25b-878a-4dac-9b2f-44f148be5e4d service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:31.796855 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144d25b-878a-4dac-9b2f-44f148be5e4d service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:31.797125 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144d25b-878a-4dac-9b2f-44f148be5e4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:31.799327 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-2144d25b-878a-4dac-9b2f-44f148be5e4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:31.809116 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2144d25b-878a-4dac-9b2f-44f148be5e4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:31.810641 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2144d25b-878a-4dac-9b2f-44f148be5e4d service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:31.818523 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1404/2817] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 05:00:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:00:37.863774 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a1da0-24a2-4e28-afaf-9b9cdd28f8a0 service placement] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:37.865288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-371a1da0-24a2-4e28-afaf-9b9cdd28f8a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:37.880786 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371a1da0-24a2-4e28-afaf-9b9cdd28f8a0 service placement] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:37.886365 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d1028-31d4-4e2c-b9ee-39a5dcef19e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:37.886972 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d1028-31d4-4e2c-b9ee-39a5dcef19e8 service nova] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:37.887252 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d1028-31d4-4e2c-b9ee-39a5dcef19e8 service nova] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:37.887519 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d1028-31d4-4e2c-b9ee-39a5dcef19e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:37.889280 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-e43d1028-31d4-4e2c-b9ee-39a5dcef19e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:37.901928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d1028-31d4-4e2c-b9ee-39a5dcef19e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:37.903565 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d1028-31d4-4e2c-b9ee-39a5dcef19e8 service nova] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:37.915167 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1414/2818] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 05:00:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:00:41.815158 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=12 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:47.910571 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=41 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:29.232577 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d685de-fc2a-4540-afb2-f9b87318a88f None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:01:29.233152 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d685de-fc2a-4540-afb2-f9b87318a88f None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:01:29.233152 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d685de-fc2a-4540-afb2-f9b87318a88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:01:29.252779 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-53d685de-fc2a-4540-afb2-f9b87318a88f None None] MFA Rules not processed for user `f84e50d96b11464ebe121ea15e2dd81b`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:01:29.254062 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-53d685de-fc2a-4540-afb2-f9b87318a88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:01:29.261469 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1405/2819] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 05:01:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:01:39.247266 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=3 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:40.933194 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d1028-31d4-4e2c-b9ee-39a5dcef19e8 service nova] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:01:40.945381 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d1028-31d4-4e2c-b9ee-39a5dcef19e8 service nova] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:01:40.951292 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741224a-b500-4f29-9232-ffe2b1972fc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc9a3cf381e4a2da36ed82b407a2d94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:01:40.951977 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741224a-b500-4f29-9232-ffe2b1972fc0 service nova] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:01:40.952329 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741224a-b500-4f29-9232-ffe2b1972fc0 service nova] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:01:40.952687 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741224a-b500-4f29-9232-ffe2b1972fc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:01:40.954623 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-6741224a-b500-4f29-9232-ffe2b1972fc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:01:40.967473 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741224a-b500-4f29-9232-ffe2b1972fc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:01:40.969123 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741224a-b500-4f29-9232-ffe2b1972fc0 service nova] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:01:40.980508 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1415/2820] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 05:01:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:01:50.975734 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=6 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:28.182336 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc8544-fbc9-44e2-871a-dc6eb0854f9b None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:28.182890 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc8544-fbc9-44e2-871a-dc6eb0854f9b None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:28.182890 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc8544-fbc9-44e2-871a-dc6eb0854f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:28.202782 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-bbbc8544-fbc9-44e2-871a-dc6eb0854f9b None None] MFA Rules not processed for user `f84e50d96b11464ebe121ea15e2dd81b`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:02:28.204064 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-bbbc8544-fbc9-44e2-871a-dc6eb0854f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:28.213092 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1406/2821] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 05:02:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:02:28.529676 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741224a-b500-4f29-9232-ffe2b1972fc0 service nova] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:28.539849 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741224a-b500-4f29-9232-ffe2b1972fc0 service nova] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:28.544487 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561cc08-fae2-4fa9-b195-81258112e16c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:28.545083 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561cc08-fae2-4fa9-b195-81258112e16c service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:28.545378 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561cc08-fae2-4fa9-b195-81258112e16c service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:28.545648 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561cc08-fae2-4fa9-b195-81258112e16c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:28.547766 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-b561cc08-fae2-4fa9-b195-81258112e16c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:28.557962 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561cc08-fae2-4fa9-b195-81258112e16c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:28.559402 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561cc08-fae2-4fa9-b195-81258112e16c service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:28.568122 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1416/2822] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 05:02:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:02:38.197143 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=3 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:38.564076 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=6 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:32.180269 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc8544-fbc9-44e2-871a-dc6eb0854f9b None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:32.190956 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc8544-fbc9-44e2-871a-dc6eb0854f9b None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:32.196313 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06030c06-941d-4cd9-8b47-cd918675b28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:32.196778 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06030c06-941d-4cd9-8b47-cd918675b28d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:32.197048 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06030c06-941d-4cd9-8b47-cd918675b28d admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:32.197299 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06030c06-941d-4cd9-8b47-cd918675b28d admin admin] PATH_INFO: `/v3/users/f84e50d96b11464ebe121ea15e2dd81b` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:32.198450 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06030c06-941d-4cd9-8b47-cd918675b28d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f84e50d96b11464ebe121ea15e2dd81b)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:32.200366 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06030c06-941d-4cd9-8b47-cd918675b28d admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:32.252308 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-06030c06-941d-4cd9-8b47-cd918675b28d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f84e50d96b11464ebe121ea15e2dd81b'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:32.253052 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-06030c06-941d-4cd9-8b47-cd918675b28d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f84e50d96b11464ebe121ea15e2dd81b'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:32.253871 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-06030c06-941d-4cd9-8b47-cd918675b28d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f84e50d96b11464ebe121ea15e2dd81b'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:32.267132 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-06030c06-941d-4cd9-8b47-cd918675b28d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f84e50d96b11464ebe121ea15e2dd81b'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:32.276713 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-06030c06-941d-4cd9-8b47-cd918675b28d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f84e50d96b11464ebe121ea15e2dd81b'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:32.289143 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1407/2823] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 05:03:32 2022] DELETE /identity/v3/users/f84e50d96b11464ebe121ea15e2dd81b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:03:32.474477 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561cc08-fae2-4fa9-b195-81258112e16c service neutron] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:32.487589 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561cc08-fae2-4fa9-b195-81258112e16c service neutron] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:32.548061 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71747799-13fc-402e-a8f7-1cfdc96e64d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:32.548689 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71747799-13fc-402e-a8f7-1cfdc96e64d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:32.548964 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71747799-13fc-402e-a8f7-1cfdc96e64d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:32.549233 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71747799-13fc-402e-a8f7-1cfdc96e64d3 admin admin] PATH_INFO: `/v3/projects/f58e8b4d90a74d4294f636c832aeae86` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:32.550426 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71747799-13fc-402e-a8f7-1cfdc96e64d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f58e8b4d90a74d4294f636c832aeae86)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:32.552330 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71747799-13fc-402e-a8f7-1cfdc96e64d3 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:32.599998 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-71747799-13fc-402e-a8f7-1cfdc96e64d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f58e8b4d90a74d4294f636c832aeae86', 'request_id': 'req-71747799-13fc-402e-a8f7-1cfdc96e64d3'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:32.606131 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-71747799-13fc-402e-a8f7-1cfdc96e64d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f58e8b4d90a74d4294f636c832aeae86', 'request_id': 'req-71747799-13fc-402e-a8f7-1cfdc96e64d3'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:32.614984 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-71747799-13fc-402e-a8f7-1cfdc96e64d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f58e8b4d90a74d4294f636c832aeae86', 'request_id': 'req-71747799-13fc-402e-a8f7-1cfdc96e64d3'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:32.625132 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-71747799-13fc-402e-a8f7-1cfdc96e64d3 admin admin] The token cache is being invalidate because project f58e8b4d90a74d4294f636c832aeae86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:03:32.625442 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-71747799-13fc-402e-a8f7-1cfdc96e64d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:32.626068 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-71747799-13fc-402e-a8f7-1cfdc96e64d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:32.627558 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1417/2824] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 05:03:32 2022] DELETE /identity/v3/projects/f58e8b4d90a74d4294f636c832aeae86 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:03:32.633269 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3fb51-3cd4-4f69-ab8e-a302586d3e41 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:32.633751 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3fb51-3cd4-4f69-ab8e-a302586d3e41 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:32.634174 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3fb51-3cd4-4f69-ab8e-a302586d3e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:32.653729 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-78c3fb51-3cd4-4f69-ab8e-a302586d3e41 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:03:32.654974 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-78c3fb51-3cd4-4f69-ab8e-a302586d3e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:32.724002 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1408/2825] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 05:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:03:32.784212 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db88b54-7d5d-4403-adc6-83c37015a3c3 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:32.784510 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db88b54-7d5d-4403-adc6-83c37015a3c3 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:32.784808 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db88b54-7d5d-4403-adc6-83c37015a3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:32.805583 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-8db88b54-7d5d-4403-adc6-83c37015a3c3 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:03:32.806814 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-8db88b54-7d5d-4403-adc6-83c37015a3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:32.816448 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1418/2826] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 05:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:03:32.820976 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3fb51-3cd4-4f69-ab8e-a302586d3e41 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:32.832010 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3fb51-3cd4-4f69-ab8e-a302586d3e41 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:32.837974 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2167c15-5dda-4cb7-bc05-f5c13d69f7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:32.838575 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2167c15-5dda-4cb7-bc05-f5c13d69f7f8 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:32.838854 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2167c15-5dda-4cb7-bc05-f5c13d69f7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:32.839144 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2167c15-5dda-4cb7-bc05-f5c13d69f7f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:32.839790 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2167c15-5dda-4cb7-bc05-f5c13d69f7f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:03:32.840082 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2167c15-5dda-4cb7-bc05-f5c13d69f7f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:32.841741 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2167c15-5dda-4cb7-bc05-f5c13d69f7f8 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:32.855144 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1409/2827] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 05:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:03:32.859687 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db88b54-7d5d-4403-adc6-83c37015a3c3 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:32.869234 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db88b54-7d5d-4403-adc6-83c37015a3c3 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:32.874318 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56829b8a-39df-487e-a6ff-9bcbcdaec188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:32.874918 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56829b8a-39df-487e-a6ff-9bcbcdaec188 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:32.875200 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56829b8a-39df-487e-a6ff-9bcbcdaec188 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:32.875476 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56829b8a-39df-487e-a6ff-9bcbcdaec188 admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:32.876102 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56829b8a-39df-487e-a6ff-9bcbcdaec188 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:32.878059 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56829b8a-39df-487e-a6ff-9bcbcdaec188 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:32.911424 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1419/2828] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 05:03:32 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:03:32.915509 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2167c15-5dda-4cb7-bc05-f5c13d69f7f8 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:32.926566 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2167c15-5dda-4cb7-bc05-f5c13d69f7f8 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:32.988807 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf7211-9586-4f37-8ec1-073b2c4f1993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:32.989446 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf7211-9586-4f37-8ec1-073b2c4f1993 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:32.989732 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf7211-9586-4f37-8ec1-073b2c4f1993 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:32.990021 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf7211-9586-4f37-8ec1-073b2c4f1993 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:32.990647 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf7211-9586-4f37-8ec1-073b2c4f1993 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:32.992606 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf7211-9586-4f37-8ec1-073b2c4f1993 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:33.000968 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:33.023883 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1410/2829] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 05:03:32 2022] POST /identity/v3/users => generated 289 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:03:33.024940 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56829b8a-39df-487e-a6ff-9bcbcdaec188 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:33.036499 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56829b8a-39df-487e-a6ff-9bcbcdaec188 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:33.041692 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9162a-fe26-4160-b061-3f9e4cb47be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:33.042321 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9162a-fe26-4160-b061-3f9e4cb47be6 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:33.042593 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9162a-fe26-4160-b061-3f9e4cb47be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:33.042844 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9162a-fe26-4160-b061-3f9e4cb47be6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:33.043489 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9162a-fe26-4160-b061-3f9e4cb47be6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:33.045087 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9162a-fe26-4160-b061-3f9e4cb47be6 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:33.055629 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1420/2830] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 05:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:03:33.059955 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf7211-9586-4f37-8ec1-073b2c4f1993 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:33.070540 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf7211-9586-4f37-8ec1-073b2c4f1993 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:33.075530 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb297d9-613d-4316-a656-7b84e2a6d05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:33.076123 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb297d9-613d-4316-a656-7b84e2a6d05b admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:33.076403 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb297d9-613d-4316-a656-7b84e2a6d05b admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:33.076678 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb297d9-613d-4316-a656-7b84e2a6d05b admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:33.077317 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb297d9-613d-4316-a656-7b84e2a6d05b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:33.078949 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb297d9-613d-4316-a656-7b84e2a6d05b admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:33.090443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1411/2831] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 05:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:03:33.094574 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9162a-fe26-4160-b061-3f9e4cb47be6 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:33.105058 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9162a-fe26-4160-b061-3f9e4cb47be6 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:33.110077 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00fbd3c-b2e6-4dcd-8a9e-1c8c08570027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:33.110656 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fbd3c-b2e6-4dcd-8a9e-1c8c08570027 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:33.110936 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fbd3c-b2e6-4dcd-8a9e-1c8c08570027 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:33.111211 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fbd3c-b2e6-4dcd-8a9e-1c8c08570027 admin admin] PATH_INFO: `/v3/projects/b15de790048549e89a03312bcddf51a0/users/5c6fd606a7104d3ab9589b13a4b67ec8/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:33.125962 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00fbd3c-b2e6-4dcd-8a9e-1c8c08570027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b15de790048549e89a03312bcddf51a0, user_id=5c6fd606a7104d3ab9589b13a4b67ec8, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:33.128695 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00fbd3c-b2e6-4dcd-8a9e-1c8c08570027 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:33.144097 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1421/2832] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 05:03:33 2022] PUT /identity/v3/projects/b15de790048549e89a03312bcddf51a0/users/5c6fd606a7104d3ab9589b13a4b67ec8/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:03:33.154207 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb97f96-e4b1-4966-8311-caa8a6a04f1e None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:33.154490 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb97f96-e4b1-4966-8311-caa8a6a04f1e None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:33.154762 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb97f96-e4b1-4966-8311-caa8a6a04f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:33.186594 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-1fb97f96-e4b1-4966-8311-caa8a6a04f1e None None] MFA Rules not processed for user `5c6fd606a7104d3ab9589b13a4b67ec8`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:03:33.188148 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-1fb97f96-e4b1-4966-8311-caa8a6a04f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:33.263716 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1412/2833] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 05:03:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:03:33.268613 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00fbd3c-b2e6-4dcd-8a9e-1c8c08570027 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:33.302080 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:33.337094 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00fbd3c-b2e6-4dcd-8a9e-1c8c08570027 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:33.342295 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567c51a-bb2f-4919-8beb-8e0dadec24db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:33.343018 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567c51a-bb2f-4919-8beb-8e0dadec24db admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:33.343296 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567c51a-bb2f-4919-8beb-8e0dadec24db admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:33.343571 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6567c51a-bb2f-4919-8beb-8e0dadec24db admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:33.344255 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6567c51a-bb2f-4919-8beb-8e0dadec24db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:33.346211 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6567c51a-bb2f-4919-8beb-8e0dadec24db admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:33.374941 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1422/2834] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 05:03:33 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:03:33.379232 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb97f96-e4b1-4966-8311-caa8a6a04f1e None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:33.391405 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb97f96-e4b1-4966-8311-caa8a6a04f1e None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:33.464065 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bac411-a799-476e-b2e0-cee79f7cf465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:33.464672 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bac411-a799-476e-b2e0-cee79f7cf465 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:33.464953 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bac411-a799-476e-b2e0-cee79f7cf465 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:33.465220 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bac411-a799-476e-b2e0-cee79f7cf465 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:33.465884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bac411-a799-476e-b2e0-cee79f7cf465 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:33.467817 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bac411-a799-476e-b2e0-cee79f7cf465 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:33.494538 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1413/2835] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 05:03:33 2022] POST /identity/v3/users => generated 295 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:03:33.498537 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567c51a-bb2f-4919-8beb-8e0dadec24db admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:33.509423 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6567c51a-bb2f-4919-8beb-8e0dadec24db admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:33.514430 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5d3c9-6aa4-4b69-9d80-b7ca20026f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:33.515026 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5d3c9-6aa4-4b69-9d80-b7ca20026f78 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:33.515307 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5d3c9-6aa4-4b69-9d80-b7ca20026f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:33.515579 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5d3c9-6aa4-4b69-9d80-b7ca20026f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:33.516346 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5d3c9-6aa4-4b69-9d80-b7ca20026f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:33.518055 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5d3c9-6aa4-4b69-9d80-b7ca20026f78 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:33.529525 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1423/2836] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 05:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:03:33.533982 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bac411-a799-476e-b2e0-cee79f7cf465 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:33.544793 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bac411-a799-476e-b2e0-cee79f7cf465 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:33.549611 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2c7cb-5088-4043-8f6c-806c55ffedff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:33.550379 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2c7cb-5088-4043-8f6c-806c55ffedff admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:33.550660 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2c7cb-5088-4043-8f6c-806c55ffedff admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:33.550934 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb2c7cb-5088-4043-8f6c-806c55ffedff admin admin] PATH_INFO: `/v3/projects/dda706c073394d739833e58528615d05/users/f4f467f10a874940b9426d711567c62d/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:33.567325 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb2c7cb-5088-4043-8f6c-806c55ffedff admin admin] RBAC: Authorizing `identity:create_grant(project_id=dda706c073394d739833e58528615d05, user_id=f4f467f10a874940b9426d711567c62d, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:33.570065 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb2c7cb-5088-4043-8f6c-806c55ffedff admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:33.588247 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1414/2837] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 05:03:33 2022] PUT /identity/v3/projects/dda706c073394d739833e58528615d05/users/f4f467f10a874940b9426d711567c62d/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:03:33.594476 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5d3c9-6aa4-4b69-9d80-b7ca20026f78 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:33.605986 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5d3c9-6aa4-4b69-9d80-b7ca20026f78 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:33.664062 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21906b-a24d-4600-9c45-87100754c2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:33.664592 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21906b-a24d-4600-9c45-87100754c2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:33.664869 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21906b-a24d-4600-9c45-87100754c2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:33.665136 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21906b-a24d-4600-9c45-87100754c2d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:33.665817 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21906b-a24d-4600-9c45-87100754c2d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:33.667445 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21906b-a24d-4600-9c45-87100754c2d1 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:33.677544 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1424/2838] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 05:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:03:33.681971 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2c7cb-5088-4043-8f6c-806c55ffedff admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:33.692725 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb2c7cb-5088-4043-8f6c-806c55ffedff admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:33.698025 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525028d0-a76f-42c8-a51e-05c39144dbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:33.698709 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525028d0-a76f-42c8-a51e-05c39144dbcd admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:33.698998 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525028d0-a76f-42c8-a51e-05c39144dbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:33.699267 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525028d0-a76f-42c8-a51e-05c39144dbcd admin admin] PATH_INFO: `/v3/projects/dda706c073394d739833e58528615d05/users/f4f467f10a874940b9426d711567c62d/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:33.701421 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525028d0-a76f-42c8-a51e-05c39144dbcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dda706c073394d739833e58528615d05, user_id=f4f467f10a874940b9426d711567c62d, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:33.704131 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525028d0-a76f-42c8-a51e-05c39144dbcd admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:33.715627 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1415/2839] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 05:03:33 2022] PUT /identity/v3/projects/dda706c073394d739833e58528615d05/users/f4f467f10a874940b9426d711567c62d/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:03:33.726424 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4da7f3-066c-48b2-b2b4-afef118ff8b6 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:33.726736 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4da7f3-066c-48b2-b2b4-afef118ff8b6 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:33.727012 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4da7f3-066c-48b2-b2b4-afef118ff8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:33.756525 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-de4da7f3-066c-48b2-b2b4-afef118ff8b6 None None] MFA Rules not processed for user `f4f467f10a874940b9426d711567c62d`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:03:33.757824 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-de4da7f3-066c-48b2-b2b4-afef118ff8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:33.830511 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1425/2840] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 05:03:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:03:33.842211 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525028d0-a76f-42c8-a51e-05c39144dbcd admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:33.844151 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-525028d0-a76f-42c8-a51e-05c39144dbcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:33.868650 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:33.924553 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525028d0-a76f-42c8-a51e-05c39144dbcd admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:33.928290 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa6970-4d4c-4437-bc37-1e111ed00191 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:33.928875 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa6970-4d4c-4437-bc37-1e111ed00191 service cinder] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:33.929160 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa6970-4d4c-4437-bc37-1e111ed00191 service cinder] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:33.929449 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa6970-4d4c-4437-bc37-1e111ed00191 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:33.984375 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa6970-4d4c-4437-bc37-1e111ed00191 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:33.985873 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa6970-4d4c-4437-bc37-1e111ed00191 service cinder] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:33.994654 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1416/2841] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 05:03:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:03:35.367835 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4da7f3-066c-48b2-b2b4-afef118ff8b6 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:35.369991 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-de4da7f3-066c-48b2-b2b4-afef118ff8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:35.387176 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4da7f3-066c-48b2-b2b4-afef118ff8b6 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:35.391276 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df788a01-e590-43c0-8867-81f3762d1b4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:35.391869 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df788a01-e590-43c0-8867-81f3762d1b4a service cinder] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:35.392142 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df788a01-e590-43c0-8867-81f3762d1b4a service cinder] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:35.392409 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df788a01-e590-43c0-8867-81f3762d1b4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:35.402166 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df788a01-e590-43c0-8867-81f3762d1b4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:35.403599 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df788a01-e590-43c0-8867-81f3762d1b4a service cinder] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:35.413226 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1426/2842] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 05:03:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:03:39.243151 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa6970-4d4c-4437-bc37-1e111ed00191 service cinder] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:39.313770 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa6970-4d4c-4437-bc37-1e111ed00191 service cinder] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:39.318715 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27dab15-79e7-4ff2-a429-ba051c0a5dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:39.319313 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27dab15-79e7-4ff2-a429-ba051c0a5dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:39.319619 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27dab15-79e7-4ff2-a429-ba051c0a5dab admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:39.319892 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27dab15-79e7-4ff2-a429-ba051c0a5dab admin admin] PATH_INFO: `/v3/users/5c6fd606a7104d3ab9589b13a4b67ec8` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:39.321058 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27dab15-79e7-4ff2-a429-ba051c0a5dab admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c6fd606a7104d3ab9589b13a4b67ec8)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:39.323022 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27dab15-79e7-4ff2-a429-ba051c0a5dab admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:39.372801 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-d27dab15-79e7-4ff2-a429-ba051c0a5dab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c6fd606a7104d3ab9589b13a4b67ec8'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:39.373484 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-d27dab15-79e7-4ff2-a429-ba051c0a5dab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c6fd606a7104d3ab9589b13a4b67ec8'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:39.374143 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-d27dab15-79e7-4ff2-a429-ba051c0a5dab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c6fd606a7104d3ab9589b13a4b67ec8'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:39.381528 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:39.388884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-d27dab15-79e7-4ff2-a429-ba051c0a5dab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c6fd606a7104d3ab9589b13a4b67ec8'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:39.398159 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-d27dab15-79e7-4ff2-a429-ba051c0a5dab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c6fd606a7104d3ab9589b13a4b67ec8'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:39.411683 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1417/2843] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 05:03:39 2022] DELETE /identity/v3/users/5c6fd606a7104d3ab9589b13a4b67ec8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:03:39.417358 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092f516-53f0-4942-ab56-849e20ecabf9 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:39.418132 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092f516-53f0-4942-ab56-849e20ecabf9 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:39.418301 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092f516-53f0-4942-ab56-849e20ecabf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:39.441717 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-5092f516-53f0-4942-ab56-849e20ecabf9 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:03:39.442928 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-5092f516-53f0-4942-ab56-849e20ecabf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:39.447165 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:39.510332 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1427/2844] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 05:03:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:03:39.523093 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27dab15-79e7-4ff2-a429-ba051c0a5dab admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:39.524828 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-d27dab15-79e7-4ff2-a429-ba051c0a5dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:39.585360 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27dab15-79e7-4ff2-a429-ba051c0a5dab admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:39.589561 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61358541-51b6-4025-8262-350351a2f8db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:39.590163 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61358541-51b6-4025-8262-350351a2f8db service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:39.590437 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61358541-51b6-4025-8262-350351a2f8db service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:39.590702 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61358541-51b6-4025-8262-350351a2f8db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:39.601013 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61358541-51b6-4025-8262-350351a2f8db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:39.602553 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61358541-51b6-4025-8262-350351a2f8db service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:39.612401 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1418/2845] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 05:03:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:03:39.886113 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092f516-53f0-4942-ab56-849e20ecabf9 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:39.887767 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-5092f516-53f0-4942-ab56-849e20ecabf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:39.901843 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092f516-53f0-4942-ab56-849e20ecabf9 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:39.907586 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3496d26-91aa-42d1-82ff-59d87c37d3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:39.908205 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3496d26-91aa-42d1-82ff-59d87c37d3c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:39.908478 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3496d26-91aa-42d1-82ff-59d87c37d3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:39.908746 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3496d26-91aa-42d1-82ff-59d87c37d3c3 admin admin] PATH_INFO: `/v3/projects/b15de790048549e89a03312bcddf51a0` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:39.909998 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3496d26-91aa-42d1-82ff-59d87c37d3c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b15de790048549e89a03312bcddf51a0)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:39.911953 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3496d26-91aa-42d1-82ff-59d87c37d3c3 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:39.963206 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b3496d26-91aa-42d1-82ff-59d87c37d3c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b15de790048549e89a03312bcddf51a0', 'request_id': 'req-b3496d26-91aa-42d1-82ff-59d87c37d3c3'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:39.969132 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b3496d26-91aa-42d1-82ff-59d87c37d3c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b15de790048549e89a03312bcddf51a0', 'request_id': 'req-b3496d26-91aa-42d1-82ff-59d87c37d3c3'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:39.978264 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b3496d26-91aa-42d1-82ff-59d87c37d3c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b15de790048549e89a03312bcddf51a0', 'request_id': 'req-b3496d26-91aa-42d1-82ff-59d87c37d3c3'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:39.989185 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b3496d26-91aa-42d1-82ff-59d87c37d3c3 admin admin] The token cache is being invalidate because project b15de790048549e89a03312bcddf51a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:03:39.989573 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b3496d26-91aa-42d1-82ff-59d87c37d3c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:39.990228 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b3496d26-91aa-42d1-82ff-59d87c37d3c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:39.991817 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1428/2846] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 05:03:39 2022] DELETE /identity/v3/projects/b15de790048549e89a03312bcddf51a0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:03:39.995868 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61358541-51b6-4025-8262-350351a2f8db service neutron] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:40.005623 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61358541-51b6-4025-8262-350351a2f8db service neutron] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:40.065667 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7160da22-3e03-44ee-8d7c-ab0bc184e75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:40.066304 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160da22-3e03-44ee-8d7c-ab0bc184e75e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:40.066585 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160da22-3e03-44ee-8d7c-ab0bc184e75e admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:40.066861 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7160da22-3e03-44ee-8d7c-ab0bc184e75e admin admin] PATH_INFO: `/v3/users/f4f467f10a874940b9426d711567c62d` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:40.068009 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160da22-3e03-44ee-8d7c-ab0bc184e75e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4f467f10a874940b9426d711567c62d)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:40.069986 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7160da22-3e03-44ee-8d7c-ab0bc184e75e admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:40.119201 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-7160da22-3e03-44ee-8d7c-ab0bc184e75e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4f467f10a874940b9426d711567c62d'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:40.119843 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-7160da22-3e03-44ee-8d7c-ab0bc184e75e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4f467f10a874940b9426d711567c62d'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:40.120452 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-7160da22-3e03-44ee-8d7c-ab0bc184e75e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4f467f10a874940b9426d711567c62d'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:40.133189 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-7160da22-3e03-44ee-8d7c-ab0bc184e75e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4f467f10a874940b9426d711567c62d'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:40.141943 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-7160da22-3e03-44ee-8d7c-ab0bc184e75e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4f467f10a874940b9426d711567c62d'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:40.147679 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:40.159537 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1419/2847] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 05:03:39 2022] DELETE /identity/v3/users/f4f467f10a874940b9426d711567c62d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:03:40.451597 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3496d26-91aa-42d1-82ff-59d87c37d3c3 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:40.454291 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-b3496d26-91aa-42d1-82ff-59d87c37d3c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:40.475859 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3496d26-91aa-42d1-82ff-59d87c37d3c3 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:40.534522 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f179b9-4814-4474-8b19-d0cc77c068ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:40.535075 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f179b9-4814-4474-8b19-d0cc77c068ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:40.535355 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f179b9-4814-4474-8b19-d0cc77c068ca admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:40.535680 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f179b9-4814-4474-8b19-d0cc77c068ca admin admin] PATH_INFO: `/v3/projects/dda706c073394d739833e58528615d05` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:40.536861 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f179b9-4814-4474-8b19-d0cc77c068ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=dda706c073394d739833e58528615d05)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:40.538850 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f179b9-4814-4474-8b19-d0cc77c068ca admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:40.584017 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:40.596226 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-60f179b9-4814-4474-8b19-d0cc77c068ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dda706c073394d739833e58528615d05', 'request_id': 'req-60f179b9-4814-4474-8b19-d0cc77c068ca'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:40.603261 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-60f179b9-4814-4474-8b19-d0cc77c068ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dda706c073394d739833e58528615d05', 'request_id': 'req-60f179b9-4814-4474-8b19-d0cc77c068ca'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:40.612800 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-60f179b9-4814-4474-8b19-d0cc77c068ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dda706c073394d739833e58528615d05', 'request_id': 'req-60f179b9-4814-4474-8b19-d0cc77c068ca'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:40.623907 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-60f179b9-4814-4474-8b19-d0cc77c068ca admin admin] The token cache is being invalidate because project dda706c073394d739833e58528615d05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:03:40.624190 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-60f179b9-4814-4474-8b19-d0cc77c068ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:40.624827 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-60f179b9-4814-4474-8b19-d0cc77c068ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:40.626403 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1429/2848] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 05:03:40 2022] DELETE /identity/v3/projects/dda706c073394d739833e58528615d05 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:03:40.631842 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f23505-2a7c-47d8-b216-de3f0da38413 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:40.632308 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f23505-2a7c-47d8-b216-de3f0da38413 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:40.632430 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f23505-2a7c-47d8-b216-de3f0da38413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:40.653862 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-82f23505-2a7c-47d8-b216-de3f0da38413 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:03:40.655699 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-82f23505-2a7c-47d8-b216-de3f0da38413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:40.720508 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1420/2849] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 05:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:03:40.728539 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af2ddc-bc96-449a-844c-0dc3586efb25 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:40.728851 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af2ddc-bc96-449a-844c-0dc3586efb25 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:40.729151 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af2ddc-bc96-449a-844c-0dc3586efb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:40.752020 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-b4af2ddc-bc96-449a-844c-0dc3586efb25 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:03:40.753272 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-b4af2ddc-bc96-449a-844c-0dc3586efb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:40.762423 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1430/2850] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 05:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:03:40.767297 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f23505-2a7c-47d8-b216-de3f0da38413 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:40.778027 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f23505-2a7c-47d8-b216-de3f0da38413 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:40.779153 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af2ddc-bc96-449a-844c-0dc3586efb25 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:40.780620 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-b4af2ddc-bc96-449a-844c-0dc3586efb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:40.783478 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f226ebe-9f41-4e0a-86ec-11d99156c67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:40.784113 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f226ebe-9f41-4e0a-86ec-11d99156c67c admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:40.784392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f226ebe-9f41-4e0a-86ec-11d99156c67c admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:40.784720 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f226ebe-9f41-4e0a-86ec-11d99156c67c admin admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:40.785320 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f226ebe-9f41-4e0a-86ec-11d99156c67c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:03:40.785761 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f226ebe-9f41-4e0a-86ec-11d99156c67c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:40.787350 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f226ebe-9f41-4e0a-86ec-11d99156c67c admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:40.799254 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1421/2851] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 05:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:03:40.803292 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f226ebe-9f41-4e0a-86ec-11d99156c67c admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:40.812794 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f226ebe-9f41-4e0a-86ec-11d99156c67c admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:40.817386 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0eaa4-9468-4f14-9017-b4998778f506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:40.818015 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0eaa4-9468-4f14-9017-b4998778f506 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:40.818311 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0eaa4-9468-4f14-9017-b4998778f506 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:40.818568 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0eaa4-9468-4f14-9017-b4998778f506 admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:40.819173 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0eaa4-9468-4f14-9017-b4998778f506 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:40.821061 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0eaa4-9468-4f14-9017-b4998778f506 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:40.849314 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1422/2852] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 05:03:40 2022] POST /identity/v3/projects => generated 393 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:03:40.853819 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0eaa4-9468-4f14-9017-b4998778f506 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:40.854531 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af2ddc-bc96-449a-844c-0dc3586efb25 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:40.917225 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88c632-67cf-4478-8b07-70e541448079 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf1b960a2eb4e5e9ada736b5f3f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:40.917957 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88c632-67cf-4478-8b07-70e541448079 service placement] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:40.918151 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0eaa4-9468-4f14-9017-b4998778f506 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:40.918267 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88c632-67cf-4478-8b07-70e541448079 service placement] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:40.918489 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88c632-67cf-4478-8b07-70e541448079 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:40.920288 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-5d88c632-67cf-4478-8b07-70e541448079 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:40.922866 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff612a3-612f-45f5-84f9-5dc65a5be273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:40.923469 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff612a3-612f-45f5-84f9-5dc65a5be273 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:40.923751 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff612a3-612f-45f5-84f9-5dc65a5be273 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:40.924023 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff612a3-612f-45f5-84f9-5dc65a5be273 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:40.924759 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff612a3-612f-45f5-84f9-5dc65a5be273 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:40.926784 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff612a3-612f-45f5-84f9-5dc65a5be273 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:40.932447 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88c632-67cf-4478-8b07-70e541448079 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:40.934082 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88c632-67cf-4478-8b07-70e541448079 service placement] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:40.944552 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1431/2853] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 05:03:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:03:40.952262 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1423/2854] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 05:03:40 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:03:40.953291 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88c632-67cf-4478-8b07-70e541448079 service placement] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:40.964272 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88c632-67cf-4478-8b07-70e541448079 service placement] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:40.969096 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c87db1-7bf6-4c6c-b8f7-2c555a04f338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:40.969728 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c87db1-7bf6-4c6c-b8f7-2c555a04f338 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:40.970007 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c87db1-7bf6-4c6c-b8f7-2c555a04f338 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:40.970280 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c87db1-7bf6-4c6c-b8f7-2c555a04f338 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:40.970920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c87db1-7bf6-4c6c-b8f7-2c555a04f338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:40.972837 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c87db1-7bf6-4c6c-b8f7-2c555a04f338 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:40.983010 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1432/2855] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 05:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:03:40.987348 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff612a3-612f-45f5-84f9-5dc65a5be273 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:40.998253 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff612a3-612f-45f5-84f9-5dc65a5be273 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:41.004217 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db05a9-1a35-4659-895b-b5296e7559d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:41.004955 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db05a9-1a35-4659-895b-b5296e7559d3 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:41.005237 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db05a9-1a35-4659-895b-b5296e7559d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:41.005544 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db05a9-1a35-4659-895b-b5296e7559d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:41.006222 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db05a9-1a35-4659-895b-b5296e7559d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:41.007846 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db05a9-1a35-4659-895b-b5296e7559d3 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:41.021652 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1424/2856] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 05:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:03:41.022787 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c87db1-7bf6-4c6c-b8f7-2c555a04f338 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:41.033012 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c87db1-7bf6-4c6c-b8f7-2c555a04f338 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:41.037764 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f745248-9f71-48c3-974d-00278949870f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:41.038431 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f745248-9f71-48c3-974d-00278949870f admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:41.038688 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f745248-9f71-48c3-974d-00278949870f admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:41.038958 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f745248-9f71-48c3-974d-00278949870f admin admin] PATH_INFO: `/v3/projects/1056f97621d2405dac9e3447a8476d62/users/881916d735734736b8a9395b9a4d9dd3/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:41.054394 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f745248-9f71-48c3-974d-00278949870f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1056f97621d2405dac9e3447a8476d62, user_id=881916d735734736b8a9395b9a4d9dd3, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:41.057260 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f745248-9f71-48c3-974d-00278949870f admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:41.071666 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1433/2857] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 05:03:41 2022] PUT /identity/v3/projects/1056f97621d2405dac9e3447a8476d62/users/881916d735734736b8a9395b9a4d9dd3/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:03:41.082162 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344b89f-7d6e-4b89-9ced-2735e7167f71 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:41.082474 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344b89f-7d6e-4b89-9ced-2735e7167f71 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:41.082774 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344b89f-7d6e-4b89-9ced-2735e7167f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:41.111560 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-3344b89f-7d6e-4b89-9ced-2735e7167f71 None None] MFA Rules not processed for user `881916d735734736b8a9395b9a4d9dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:03:41.112776 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-3344b89f-7d6e-4b89-9ced-2735e7167f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:41.143161 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:41.181128 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1425/2858] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 05:03:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:03:41.185758 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f745248-9f71-48c3-974d-00278949870f admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:41.198961 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:41.248565 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f745248-9f71-48c3-974d-00278949870f admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:41.253557 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da7b75-9e73-4379-8573-94156274a298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:41.254161 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da7b75-9e73-4379-8573-94156274a298 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:41.254481 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da7b75-9e73-4379-8573-94156274a298 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:41.254755 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da7b75-9e73-4379-8573-94156274a298 admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:41.255372 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30da7b75-9e73-4379-8573-94156274a298 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:41.257321 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30da7b75-9e73-4379-8573-94156274a298 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:41.284946 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1434/2859] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 05:03:41 2022] POST /identity/v3/projects => generated 391 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:03:41.289231 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344b89f-7d6e-4b89-9ced-2735e7167f71 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:41.302485 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344b89f-7d6e-4b89-9ced-2735e7167f71 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:41.368647 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f8ee1-a098-429d-8c45-54bd806a16d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:41.369261 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f8ee1-a098-429d-8c45-54bd806a16d8 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:41.369575 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f8ee1-a098-429d-8c45-54bd806a16d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:41.369849 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f8ee1-a098-429d-8c45-54bd806a16d8 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:41.370547 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f8ee1-a098-429d-8c45-54bd806a16d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:41.372487 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f8ee1-a098-429d-8c45-54bd806a16d8 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:41.393946 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1426/2860] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 05:03:41 2022] POST /identity/v3/users => generated 302 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:03:41.398110 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da7b75-9e73-4379-8573-94156274a298 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:41.408906 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da7b75-9e73-4379-8573-94156274a298 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:41.414499 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eedd2d0-7725-4e5f-9a2e-c4c05c7dc391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:41.415119 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedd2d0-7725-4e5f-9a2e-c4c05c7dc391 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:41.415365 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedd2d0-7725-4e5f-9a2e-c4c05c7dc391 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:41.415629 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eedd2d0-7725-4e5f-9a2e-c4c05c7dc391 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:41.416267 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eedd2d0-7725-4e5f-9a2e-c4c05c7dc391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:41.417898 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eedd2d0-7725-4e5f-9a2e-c4c05c7dc391 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:41.429191 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1435/2861] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 05:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:03:41.433573 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f8ee1-a098-429d-8c45-54bd806a16d8 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:41.444470 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f8ee1-a098-429d-8c45-54bd806a16d8 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:41.450456 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc03fe9-0a1b-4908-95cb-6d15ff17eafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:41.451104 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc03fe9-0a1b-4908-95cb-6d15ff17eafe admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:41.451385 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc03fe9-0a1b-4908-95cb-6d15ff17eafe admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:41.451659 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc03fe9-0a1b-4908-95cb-6d15ff17eafe admin admin] PATH_INFO: `/v3/projects/40ed656e169b42329cb15781ada3a238/users/3467a2b81190458690ab6fd5b5df6cfa/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:41.467718 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc03fe9-0a1b-4908-95cb-6d15ff17eafe admin admin] RBAC: Authorizing `identity:create_grant(project_id=40ed656e169b42329cb15781ada3a238, user_id=3467a2b81190458690ab6fd5b5df6cfa, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:41.470499 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc03fe9-0a1b-4908-95cb-6d15ff17eafe admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:41.489221 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1427/2862] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 05:03:41 2022] PUT /identity/v3/projects/40ed656e169b42329cb15781ada3a238/users/3467a2b81190458690ab6fd5b5df6cfa/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:03:41.493259 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eedd2d0-7725-4e5f-9a2e-c4c05c7dc391 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:41.503660 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eedd2d0-7725-4e5f-9a2e-c4c05c7dc391 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:41.568206 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f00946-b17f-4835-b3de-79d580e8b6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:41.568723 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f00946-b17f-4835-b3de-79d580e8b6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:41.568998 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f00946-b17f-4835-b3de-79d580e8b6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:41.569270 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f00946-b17f-4835-b3de-79d580e8b6e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:41.569978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f00946-b17f-4835-b3de-79d580e8b6e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:41.571568 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f00946-b17f-4835-b3de-79d580e8b6e2 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:41.581771 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1436/2863] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 05:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:03:41.586256 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc03fe9-0a1b-4908-95cb-6d15ff17eafe admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:41.597491 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc03fe9-0a1b-4908-95cb-6d15ff17eafe admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:41.602518 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81d96d-f453-4c54-bf69-42174dcea24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:41.603163 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81d96d-f453-4c54-bf69-42174dcea24f admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:41.603441 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81d96d-f453-4c54-bf69-42174dcea24f admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:41.603713 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81d96d-f453-4c54-bf69-42174dcea24f admin admin] PATH_INFO: `/v3/projects/40ed656e169b42329cb15781ada3a238/users/3467a2b81190458690ab6fd5b5df6cfa/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:41.605717 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81d96d-f453-4c54-bf69-42174dcea24f admin admin] RBAC: Authorizing `identity:create_grant(project_id=40ed656e169b42329cb15781ada3a238, user_id=3467a2b81190458690ab6fd5b5df6cfa, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:41.608324 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81d96d-f453-4c54-bf69-42174dcea24f admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:41.618994 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1428/2864] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 05:03:41 2022] PUT /identity/v3/projects/40ed656e169b42329cb15781ada3a238/users/3467a2b81190458690ab6fd5b5df6cfa/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:03:41.630425 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf0d9c-3529-4a5e-a64c-bd3e5bc78bda None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:41.630708 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf0d9c-3529-4a5e-a64c-bd3e5bc78bda None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:41.630986 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf0d9c-3529-4a5e-a64c-bd3e5bc78bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:41.659911 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-ecaf0d9c-3529-4a5e-a64c-bd3e5bc78bda None None] MFA Rules not processed for user `3467a2b81190458690ab6fd5b5df6cfa`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:03:41.661138 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-ecaf0d9c-3529-4a5e-a64c-bd3e5bc78bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:41.735418 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1437/2865] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 05:03:41 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:03:41.746951 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81d96d-f453-4c54-bf69-42174dcea24f admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:41.749055 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-3b81d96d-f453-4c54-bf69-42174dcea24f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:41.811558 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81d96d-f453-4c54-bf69-42174dcea24f admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:41.816549 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd05797-4732-44dc-acc5-cb1d6bf36841 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:41.817197 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd05797-4732-44dc-acc5-cb1d6bf36841 service cinder] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:41.817503 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd05797-4732-44dc-acc5-cb1d6bf36841 service cinder] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:41.817757 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd05797-4732-44dc-acc5-cb1d6bf36841 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:41.826983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd05797-4732-44dc-acc5-cb1d6bf36841 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:41.828362 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd05797-4732-44dc-acc5-cb1d6bf36841 service cinder] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:41.837890 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1429/2866] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 05:03:41 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:03:41.888170 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf0d9c-3529-4a5e-a64c-bd3e5bc78bda None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:41.889945 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-ecaf0d9c-3529-4a5e-a64c-bd3e5bc78bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:41.902750 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf0d9c-3529-4a5e-a64c-bd3e5bc78bda None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:41.906576 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1c2a7-f29e-4f7b-842d-1009771d72dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:41.907179 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1c2a7-f29e-4f7b-842d-1009771d72dd service cinder] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:41.907458 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1c2a7-f29e-4f7b-842d-1009771d72dd service cinder] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:41.907727 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1c2a7-f29e-4f7b-842d-1009771d72dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:41.913064 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:41.969981 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1c2a7-f29e-4f7b-842d-1009771d72dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:41.971464 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1c2a7-f29e-4f7b-842d-1009771d72dd service cinder] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:41.981066 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1438/2867] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 05:03:41 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:03:45.364693 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd05797-4732-44dc-acc5-cb1d6bf36841 service cinder] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:45.392953 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:45.430350 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd05797-4732-44dc-acc5-cb1d6bf36841 service cinder] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:45.436209 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9dcba5-45ba-4b8b-9c00-9505be18cdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:45.436832 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9dcba5-45ba-4b8b-9c00-9505be18cdc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:45.437110 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9dcba5-45ba-4b8b-9c00-9505be18cdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:45.437394 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9dcba5-45ba-4b8b-9c00-9505be18cdc4 admin admin] PATH_INFO: `/v3/users/881916d735734736b8a9395b9a4d9dd3` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:45.438654 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9dcba5-45ba-4b8b-9c00-9505be18cdc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=881916d735734736b8a9395b9a4d9dd3)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:45.440600 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9dcba5-45ba-4b8b-9c00-9505be18cdc4 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:45.492285 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-8b9dcba5-45ba-4b8b-9c00-9505be18cdc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '881916d735734736b8a9395b9a4d9dd3'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:45.492938 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-8b9dcba5-45ba-4b8b-9c00-9505be18cdc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '881916d735734736b8a9395b9a4d9dd3'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:45.493569 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-8b9dcba5-45ba-4b8b-9c00-9505be18cdc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '881916d735734736b8a9395b9a4d9dd3'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:45.505342 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-8b9dcba5-45ba-4b8b-9c00-9505be18cdc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '881916d735734736b8a9395b9a4d9dd3'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:45.515042 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-8b9dcba5-45ba-4b8b-9c00-9505be18cdc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '881916d735734736b8a9395b9a4d9dd3'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:45.527704 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1430/2868] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 05:03:45 2022] DELETE /identity/v3/users/881916d735734736b8a9395b9a4d9dd3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:03:45.532252 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b0e6a-0bd8-4f9a-8fc4-8a9c391be75d None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:45.532768 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b0e6a-0bd8-4f9a-8fc4-8a9c391be75d None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:45.532768 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b0e6a-0bd8-4f9a-8fc4-8a9c391be75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:45.552710 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-c89b0e6a-0bd8-4f9a-8fc4-8a9c391be75d None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:03:45.553966 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-c89b0e6a-0bd8-4f9a-8fc4-8a9c391be75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:45.640333 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1439/2869] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 05:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:03:45.650583 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9dcba5-45ba-4b8b-9c00-9505be18cdc4 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:45.652117 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-8b9dcba5-45ba-4b8b-9c00-9505be18cdc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:45.711729 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9dcba5-45ba-4b8b-9c00-9505be18cdc4 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:45.715509 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdd5d4-2d1f-4cb2-b6a2-42a93a79eeda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:45.716113 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdd5d4-2d1f-4cb2-b6a2-42a93a79eeda service neutron] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:45.716385 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdd5d4-2d1f-4cb2-b6a2-42a93a79eeda service neutron] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:45.716674 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdd5d4-2d1f-4cb2-b6a2-42a93a79eeda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:45.726452 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fdd5d4-2d1f-4cb2-b6a2-42a93a79eeda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:45.727883 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fdd5d4-2d1f-4cb2-b6a2-42a93a79eeda service neutron] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:45.738025 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1431/2870] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 05:03:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:03:46.005859 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b0e6a-0bd8-4f9a-8fc4-8a9c391be75d None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:46.007343 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-c89b0e6a-0bd8-4f9a-8fc4-8a9c391be75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:46.021306 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b0e6a-0bd8-4f9a-8fc4-8a9c391be75d None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:46.026387 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989fcf0-17d1-4415-b1a7-688d0f975070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:46.027041 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989fcf0-17d1-4415-b1a7-688d0f975070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:46.027315 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989fcf0-17d1-4415-b1a7-688d0f975070 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:46.027580 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989fcf0-17d1-4415-b1a7-688d0f975070 admin admin] PATH_INFO: `/v3/projects/1056f97621d2405dac9e3447a8476d62` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:46.028854 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b989fcf0-17d1-4415-b1a7-688d0f975070 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1056f97621d2405dac9e3447a8476d62)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:46.030800 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b989fcf0-17d1-4415-b1a7-688d0f975070 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:46.080368 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b989fcf0-17d1-4415-b1a7-688d0f975070 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1056f97621d2405dac9e3447a8476d62', 'request_id': 'req-b989fcf0-17d1-4415-b1a7-688d0f975070'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:46.086559 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b989fcf0-17d1-4415-b1a7-688d0f975070 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1056f97621d2405dac9e3447a8476d62', 'request_id': 'req-b989fcf0-17d1-4415-b1a7-688d0f975070'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:46.095492 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b989fcf0-17d1-4415-b1a7-688d0f975070 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1056f97621d2405dac9e3447a8476d62', 'request_id': 'req-b989fcf0-17d1-4415-b1a7-688d0f975070'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:46.107407 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b989fcf0-17d1-4415-b1a7-688d0f975070 admin admin] The token cache is being invalidate because project 1056f97621d2405dac9e3447a8476d62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:03:46.107706 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b989fcf0-17d1-4415-b1a7-688d0f975070 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:46.108330 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-b989fcf0-17d1-4415-b1a7-688d0f975070 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:46.109863 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1440/2871] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 05:03:46 2022] DELETE /identity/v3/projects/1056f97621d2405dac9e3447a8476d62 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:03:46.114229 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdd5d4-2d1f-4cb2-b6a2-42a93a79eeda service neutron] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:46.124112 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdd5d4-2d1f-4cb2-b6a2-42a93a79eeda service neutron] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:46.178379 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:46.194069 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5dfad-eac0-4003-b3bc-cb3decacb4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:46.194706 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5dfad-eac0-4003-b3bc-cb3decacb4ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:46.194987 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5dfad-eac0-4003-b3bc-cb3decacb4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:46.195263 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5dfad-eac0-4003-b3bc-cb3decacb4ab admin admin] PATH_INFO: `/v3/users/3467a2b81190458690ab6fd5b5df6cfa` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:46.196416 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5dfad-eac0-4003-b3bc-cb3decacb4ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=3467a2b81190458690ab6fd5b5df6cfa)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:46.198492 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5dfad-eac0-4003-b3bc-cb3decacb4ab admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:46.250249 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-76c5dfad-eac0-4003-b3bc-cb3decacb4ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3467a2b81190458690ab6fd5b5df6cfa'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:46.250838 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-76c5dfad-eac0-4003-b3bc-cb3decacb4ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3467a2b81190458690ab6fd5b5df6cfa'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:46.251471 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-76c5dfad-eac0-4003-b3bc-cb3decacb4ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3467a2b81190458690ab6fd5b5df6cfa'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:46.265120 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-76c5dfad-eac0-4003-b3bc-cb3decacb4ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3467a2b81190458690ab6fd5b5df6cfa'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:46.275012 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-76c5dfad-eac0-4003-b3bc-cb3decacb4ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3467a2b81190458690ab6fd5b5df6cfa'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:46.291193 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1432/2872] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 05:03:46 2022] DELETE /identity/v3/users/3467a2b81190458690ab6fd5b5df6cfa => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:03:46.579243 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989fcf0-17d1-4415-b1a7-688d0f975070 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:46.580660 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-b989fcf0-17d1-4415-b1a7-688d0f975070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:46.598169 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989fcf0-17d1-4415-b1a7-688d0f975070 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:46.629098 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:46.659136 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d366baa-dc75-4810-9fcf-1e390b2e1b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:46.659846 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d366baa-dc75-4810-9fcf-1e390b2e1b64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:46.660121 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d366baa-dc75-4810-9fcf-1e390b2e1b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:46.660387 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d366baa-dc75-4810-9fcf-1e390b2e1b64 admin admin] PATH_INFO: `/v3/projects/40ed656e169b42329cb15781ada3a238` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:46.661540 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d366baa-dc75-4810-9fcf-1e390b2e1b64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40ed656e169b42329cb15781ada3a238)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:46.663447 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d366baa-dc75-4810-9fcf-1e390b2e1b64 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:46.710762 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-6d366baa-dc75-4810-9fcf-1e390b2e1b64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40ed656e169b42329cb15781ada3a238', 'request_id': 'req-6d366baa-dc75-4810-9fcf-1e390b2e1b64'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:46.717263 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-6d366baa-dc75-4810-9fcf-1e390b2e1b64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40ed656e169b42329cb15781ada3a238', 'request_id': 'req-6d366baa-dc75-4810-9fcf-1e390b2e1b64'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:46.726711 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-6d366baa-dc75-4810-9fcf-1e390b2e1b64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40ed656e169b42329cb15781ada3a238', 'request_id': 'req-6d366baa-dc75-4810-9fcf-1e390b2e1b64'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:46.739724 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-6d366baa-dc75-4810-9fcf-1e390b2e1b64 admin admin] The token cache is being invalidate because project 40ed656e169b42329cb15781ada3a238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93148) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:03:46.740137 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-6d366baa-dc75-4810-9fcf-1e390b2e1b64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:46.740808 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-6d366baa-dc75-4810-9fcf-1e390b2e1b64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:46.742396 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1441/2873] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 05:03:46 2022] DELETE /identity/v3/projects/40ed656e169b42329cb15781ada3a238 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:03:46.748189 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc84fb-5c1f-4fa9-9f5b-903ed878a684 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:46.748678 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc84fb-5c1f-4fa9-9f5b-903ed878a684 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:46.748791 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc84fb-5c1f-4fa9-9f5b-903ed878a684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:46.769257 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-1acc84fb-5c1f-4fa9-9f5b-903ed878a684 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:03:46.770650 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-1acc84fb-5c1f-4fa9-9f5b-903ed878a684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:46.830971 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1433/2874] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 05:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:03:46.838927 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054ccf9-1c83-4baa-83ed-27a5448aadcb None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:46.839217 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054ccf9-1c83-4baa-83ed-27a5448aadcb None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:46.839492 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b054ccf9-1c83-4baa-83ed-27a5448aadcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:46.861517 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-b054ccf9-1c83-4baa-83ed-27a5448aadcb None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:03:46.862746 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-b054ccf9-1c83-4baa-83ed-27a5448aadcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:46.872495 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1442/2875] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 05:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:03:46.878552 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc84fb-5c1f-4fa9-9f5b-903ed878a684 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:46.889444 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc84fb-5c1f-4fa9-9f5b-903ed878a684 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:46.894798 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfddc6ee-c395-41a0-bc75-85bb7a44da25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:46.895416 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddc6ee-c395-41a0-bc75-85bb7a44da25 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:46.895696 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddc6ee-c395-41a0-bc75-85bb7a44da25 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:46.895968 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfddc6ee-c395-41a0-bc75-85bb7a44da25 admin admin] PATH_INFO: `/v3/domains` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:46.896615 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfddc6ee-c395-41a0-bc75-85bb7a44da25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93147) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:03:46.896920 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfddc6ee-c395-41a0-bc75-85bb7a44da25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:46.898589 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfddc6ee-c395-41a0-bc75-85bb7a44da25 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:46.910980 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1434/2876] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 05:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:03:46.915444 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054ccf9-1c83-4baa-83ed-27a5448aadcb None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:46.925074 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b054ccf9-1c83-4baa-83ed-27a5448aadcb None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:46.930718 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949e4e0-a3fb-4bfc-90dc-b61425e1209f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:46.931313 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949e4e0-a3fb-4bfc-90dc-b61425e1209f admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:46.931591 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949e4e0-a3fb-4bfc-90dc-b61425e1209f admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:46.931862 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949e4e0-a3fb-4bfc-90dc-b61425e1209f admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:46.932482 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949e4e0-a3fb-4bfc-90dc-b61425e1209f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:46.934449 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949e4e0-a3fb-4bfc-90dc-b61425e1209f admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:46.964330 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1443/2877] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 05:03:46 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:03:46.968318 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfddc6ee-c395-41a0-bc75-85bb7a44da25 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:46.979149 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfddc6ee-c395-41a0-bc75-85bb7a44da25 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:47.029837 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:47.042216 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c9289-8b06-4006-be84-d778cfb0d3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:47.042830 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c9289-8b06-4006-be84-d778cfb0d3c5 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:47.043118 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c9289-8b06-4006-be84-d778cfb0d3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:47.043400 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c9289-8b06-4006-be84-d778cfb0d3c5 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:47.044057 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c9289-8b06-4006-be84-d778cfb0d3c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:47.046255 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794c9289-8b06-4006-be84-d778cfb0d3c5 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:47.068700 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1435/2878] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 05:03:46 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:03:47.072861 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949e4e0-a3fb-4bfc-90dc-b61425e1209f admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:47.083189 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949e4e0-a3fb-4bfc-90dc-b61425e1209f admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:47.087808 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4c550-05ad-4724-af7f-b9b0dbd54d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:47.088396 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4c550-05ad-4724-af7f-b9b0dbd54d93 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:47.088670 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4c550-05ad-4724-af7f-b9b0dbd54d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:47.088936 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4c550-05ad-4724-af7f-b9b0dbd54d93 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:47.089668 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4c550-05ad-4724-af7f-b9b0dbd54d93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:47.091273 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4c550-05ad-4724-af7f-b9b0dbd54d93 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:47.101914 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1444/2879] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 05:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:03:47.105863 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c9289-8b06-4006-be84-d778cfb0d3c5 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:47.116714 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c9289-8b06-4006-be84-d778cfb0d3c5 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:47.121934 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06508f05-7799-4337-b810-047894a3bf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:47.122556 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06508f05-7799-4337-b810-047894a3bf8a admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:47.122843 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06508f05-7799-4337-b810-047894a3bf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:47.123113 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06508f05-7799-4337-b810-047894a3bf8a admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:47.123811 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06508f05-7799-4337-b810-047894a3bf8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:47.125496 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06508f05-7799-4337-b810-047894a3bf8a admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:47.136949 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1436/2880] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 05:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:03:47.141401 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4c550-05ad-4724-af7f-b9b0dbd54d93 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:47.151544 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4c550-05ad-4724-af7f-b9b0dbd54d93 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:47.156825 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f320acf-7043-4459-8d1d-73c63f5bf817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:47.157516 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f320acf-7043-4459-8d1d-73c63f5bf817 admin admin] REQUEST_METHOD: `PUT` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:47.157795 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f320acf-7043-4459-8d1d-73c63f5bf817 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:47.158069 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f320acf-7043-4459-8d1d-73c63f5bf817 admin admin] PATH_INFO: `/v3/projects/c45de69a80ba48fab8b395a725df6d82/users/50c2e16f7d264da2804c1ee8f88f122e/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:47.173930 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f320acf-7043-4459-8d1d-73c63f5bf817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c45de69a80ba48fab8b395a725df6d82, user_id=50c2e16f7d264da2804c1ee8f88f122e, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:47.176725 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f320acf-7043-4459-8d1d-73c63f5bf817 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:47.191259 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1445/2881] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 05:03:47 2022] PUT /identity/v3/projects/c45de69a80ba48fab8b395a725df6d82/users/50c2e16f7d264da2804c1ee8f88f122e/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:03:47.201697 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08673f9d-3828-430e-9a05-a23b02333394 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:47.201983 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08673f9d-3828-430e-9a05-a23b02333394 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:47.202252 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08673f9d-3828-430e-9a05-a23b02333394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:47.230773 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-08673f9d-3828-430e-9a05-a23b02333394 None None] MFA Rules not processed for user `50c2e16f7d264da2804c1ee8f88f122e`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:03:47.231997 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-08673f9d-3828-430e-9a05-a23b02333394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:47.299105 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1437/2882] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 05:03:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:03:47.303697 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f320acf-7043-4459-8d1d-73c63f5bf817 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:47.366590 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:47.370762 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f320acf-7043-4459-8d1d-73c63f5bf817 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:47.377672 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dece10-3e26-4232-a47a-65af28ed0406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:47.378277 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dece10-3e26-4232-a47a-65af28ed0406 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:47.378560 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dece10-3e26-4232-a47a-65af28ed0406 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:47.378837 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dece10-3e26-4232-a47a-65af28ed0406 admin admin] PATH_INFO: `/v3/projects` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:47.379482 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dece10-3e26-4232-a47a-65af28ed0406 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:47.381806 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dece10-3e26-4232-a47a-65af28ed0406 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:47.410144 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1446/2883] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 05:03:47 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:03:47.414269 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08673f9d-3828-430e-9a05-a23b02333394 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:47.425058 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08673f9d-3828-430e-9a05-a23b02333394 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:47.481006 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5618ff-9528-4d0f-b779-5249c557ba91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:47.481640 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5618ff-9528-4d0f-b779-5249c557ba91 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:47.481920 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5618ff-9528-4d0f-b779-5249c557ba91 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:47.482192 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5618ff-9528-4d0f-b779-5249c557ba91 admin admin] PATH_INFO: `/v3/users` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:47.482812 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5618ff-9528-4d0f-b779-5249c557ba91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:47.484721 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5618ff-9528-4d0f-b779-5249c557ba91 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:47.506727 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1438/2884] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 05:03:47 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:03:47.510657 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dece10-3e26-4232-a47a-65af28ed0406 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:47.521199 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dece10-3e26-4232-a47a-65af28ed0406 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:47.526355 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bbc719-0171-463a-9356-979c997aa228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:47.526950 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbc719-0171-463a-9356-979c997aa228 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:47.527222 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbc719-0171-463a-9356-979c997aa228 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:47.527486 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bbc719-0171-463a-9356-979c997aa228 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:47.528123 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bbc719-0171-463a-9356-979c997aa228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:47.529761 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bbc719-0171-463a-9356-979c997aa228 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:47.540849 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1447/2885] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 05:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:03:47.545229 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5618ff-9528-4d0f-b779-5249c557ba91 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:47.555749 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5618ff-9528-4d0f-b779-5249c557ba91 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:47.560884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe02857-e8e1-491b-9403-e0d6d3f24c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:47.561565 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe02857-e8e1-491b-9403-e0d6d3f24c38 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:47.561853 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe02857-e8e1-491b-9403-e0d6d3f24c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:47.562184 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe02857-e8e1-491b-9403-e0d6d3f24c38 admin admin] PATH_INFO: `/v3/projects/a03a96cec9e2409e9109fd18d7ec73fe/users/4a153aab98a8408db42c062c7a4db70e/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:47.578339 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe02857-e8e1-491b-9403-e0d6d3f24c38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a03a96cec9e2409e9109fd18d7ec73fe, user_id=4a153aab98a8408db42c062c7a4db70e, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:47.581022 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe02857-e8e1-491b-9403-e0d6d3f24c38 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:47.596298 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1439/2886] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 05:03:47 2022] PUT /identity/v3/projects/a03a96cec9e2409e9109fd18d7ec73fe/users/4a153aab98a8408db42c062c7a4db70e/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:03:47.602772 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bbc719-0171-463a-9356-979c997aa228 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:47.615383 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bbc719-0171-463a-9356-979c997aa228 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:47.680732 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c222ddf-8ebf-4643-9c41-231f3fa56aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:47.681359 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c222ddf-8ebf-4643-9c41-231f3fa56aec admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:47.681657 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c222ddf-8ebf-4643-9c41-231f3fa56aec admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:47.681933 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c222ddf-8ebf-4643-9c41-231f3fa56aec admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:47.682577 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c222ddf-8ebf-4643-9c41-231f3fa56aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:47.684194 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c222ddf-8ebf-4643-9c41-231f3fa56aec admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:47.694582 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1448/2887] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 05:03:47 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:03:47.698870 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe02857-e8e1-491b-9403-e0d6d3f24c38 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:47.709514 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe02857-e8e1-491b-9403-e0d6d3f24c38 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:47.714356 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517edfa-fdb5-46cc-9e64-97bb15e236bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:47.715005 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517edfa-fdb5-46cc-9e64-97bb15e236bd admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:47.715283 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517edfa-fdb5-46cc-9e64-97bb15e236bd admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:47.715558 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517edfa-fdb5-46cc-9e64-97bb15e236bd admin admin] PATH_INFO: `/v3/projects/a03a96cec9e2409e9109fd18d7ec73fe/users/4a153aab98a8408db42c062c7a4db70e/roles/74ce7b72bcc94a8a8ad65c3db928e6ac` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:47.717581 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517edfa-fdb5-46cc-9e64-97bb15e236bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a03a96cec9e2409e9109fd18d7ec73fe, user_id=4a153aab98a8408db42c062c7a4db70e, role_id=74ce7b72bcc94a8a8ad65c3db928e6ac)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:47.720276 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517edfa-fdb5-46cc-9e64-97bb15e236bd admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:47.730951 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1440/2888] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 05:03:47 2022] PUT /identity/v3/projects/a03a96cec9e2409e9109fd18d7ec73fe/users/4a153aab98a8408db42c062c7a4db70e/roles/74ce7b72bcc94a8a8ad65c3db928e6ac => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:03:47.742976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7642e4-4b12-417a-a2d4-146ffe8e1086 None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:47.743505 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7642e4-4b12-417a-a2d4-146ffe8e1086 None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:47.744045 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7642e4-4b12-417a-a2d4-146ffe8e1086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:47.777078 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-ca7642e4-4b12-417a-a2d4-146ffe8e1086 None None] MFA Rules not processed for user `4a153aab98a8408db42c062c7a4db70e`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:03:47.778320 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-ca7642e4-4b12-417a-a2d4-146ffe8e1086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:47.858863 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1449/2889] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 05:03:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:03:47.869932 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517edfa-fdb5-46cc-9e64-97bb15e236bd admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:47.871941 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-d517edfa-fdb5-46cc-9e64-97bb15e236bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:47.888668 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:47.939038 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517edfa-fdb5-46cc-9e64-97bb15e236bd admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:47.944598 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258350f-e7f3-4859-8ce0-54df39405880 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:47.945216 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258350f-e7f3-4859-8ce0-54df39405880 service cinder] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:47.945533 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258350f-e7f3-4859-8ce0-54df39405880 service cinder] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:47.945806 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258350f-e7f3-4859-8ce0-54df39405880 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:48.009510 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258350f-e7f3-4859-8ce0-54df39405880 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:48.010972 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258350f-e7f3-4859-8ce0-54df39405880 service cinder] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:48.020556 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1441/2890] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 05:03:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:03:50.571234 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7642e4-4b12-417a-a2d4-146ffe8e1086 None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:50.630788 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:50.643115 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7642e4-4b12-417a-a2d4-146ffe8e1086 None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:50.647976 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b1ff0-e614-477e-96a6-4836bd603e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:50.648604 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b1ff0-e614-477e-96a6-4836bd603e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:50.648881 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b1ff0-e614-477e-96a6-4836bd603e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:50.649151 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b1ff0-e614-477e-96a6-4836bd603e29 admin admin] PATH_INFO: `/v3/users/50c2e16f7d264da2804c1ee8f88f122e` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:50.650307 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b1ff0-e614-477e-96a6-4836bd603e29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50c2e16f7d264da2804c1ee8f88f122e)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:50.652232 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b1ff0-e614-477e-96a6-4836bd603e29 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:50.702978 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-966b1ff0-e614-477e-96a6-4836bd603e29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50c2e16f7d264da2804c1ee8f88f122e'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:50.703641 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-966b1ff0-e614-477e-96a6-4836bd603e29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50c2e16f7d264da2804c1ee8f88f122e'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:50.704244 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-966b1ff0-e614-477e-96a6-4836bd603e29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50c2e16f7d264da2804c1ee8f88f122e'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:50.715909 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-966b1ff0-e614-477e-96a6-4836bd603e29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50c2e16f7d264da2804c1ee8f88f122e'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:50.724719 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-966b1ff0-e614-477e-96a6-4836bd603e29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50c2e16f7d264da2804c1ee8f88f122e'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:50.738942 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1450/2891] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 05:03:50 2022] DELETE /identity/v3/users/50c2e16f7d264da2804c1ee8f88f122e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:03:50.743666 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc4b49-f308-46d9-9069-4648ecd4aaeb None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:50.744173 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc4b49-f308-46d9-9069-4648ecd4aaeb None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:50.744274 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc4b49-f308-46d9-9069-4648ecd4aaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:50.763968 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-50cc4b49-f308-46d9-9069-4648ecd4aaeb None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:03:50.765209 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-50cc4b49-f308-46d9-9069-4648ecd4aaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:50.829645 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1442/2892] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 05:03:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:03:50.839382 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b1ff0-e614-477e-96a6-4836bd603e29 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:50.840914 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-966b1ff0-e614-477e-96a6-4836bd603e29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:50.908601 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b1ff0-e614-477e-96a6-4836bd603e29 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:50.913014 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27cbcfa-d9b8-49b7-a2aa-48ce014e1927 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:50.913677 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27cbcfa-d9b8-49b7-a2aa-48ce014e1927 service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:50.913957 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27cbcfa-d9b8-49b7-a2aa-48ce014e1927 service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:50.914223 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27cbcfa-d9b8-49b7-a2aa-48ce014e1927 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:50.924235 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27cbcfa-d9b8-49b7-a2aa-48ce014e1927 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:50.925745 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27cbcfa-d9b8-49b7-a2aa-48ce014e1927 service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:50.935680 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1451/2893] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 05:03:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:03:51.211770 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc4b49-f308-46d9-9069-4648ecd4aaeb None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:51.213245 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-50cc4b49-f308-46d9-9069-4648ecd4aaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:51.227662 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc4b49-f308-46d9-9069-4648ecd4aaeb None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:51.233530 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3735e-27ac-4bbd-bbe5-e69f947f2b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:51.234178 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3735e-27ac-4bbd-bbe5-e69f947f2b05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:51.234482 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3735e-27ac-4bbd-bbe5-e69f947f2b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:51.234760 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3735e-27ac-4bbd-bbe5-e69f947f2b05 admin admin] PATH_INFO: `/v3/projects/c45de69a80ba48fab8b395a725df6d82` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:51.236043 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3735e-27ac-4bbd-bbe5-e69f947f2b05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c45de69a80ba48fab8b395a725df6d82)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:51.238044 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3735e-27ac-4bbd-bbe5-e69f947f2b05 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:51.286166 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-73a3735e-27ac-4bbd-bbe5-e69f947f2b05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c45de69a80ba48fab8b395a725df6d82', 'request_id': 'req-73a3735e-27ac-4bbd-bbe5-e69f947f2b05'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:51.294542 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-73a3735e-27ac-4bbd-bbe5-e69f947f2b05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c45de69a80ba48fab8b395a725df6d82', 'request_id': 'req-73a3735e-27ac-4bbd-bbe5-e69f947f2b05'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:51.301134 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-73a3735e-27ac-4bbd-bbe5-e69f947f2b05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c45de69a80ba48fab8b395a725df6d82', 'request_id': 'req-73a3735e-27ac-4bbd-bbe5-e69f947f2b05'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:51.303171 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:51.313972 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-73a3735e-27ac-4bbd-bbe5-e69f947f2b05 admin admin] The token cache is being invalidate because project c45de69a80ba48fab8b395a725df6d82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:03:51.314268 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-73a3735e-27ac-4bbd-bbe5-e69f947f2b05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:51.315063 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-73a3735e-27ac-4bbd-bbe5-e69f947f2b05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:51.316591 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1443/2894] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 05:03:51 2022] DELETE /identity/v3/projects/c45de69a80ba48fab8b395a725df6d82 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:03:51.320697 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27cbcfa-d9b8-49b7-a2aa-48ce014e1927 service neutron] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:51.330781 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27cbcfa-d9b8-49b7-a2aa-48ce014e1927 service neutron] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:51.398067 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358dc5ab-6f7f-4b7a-b61f-2cd17a9e674e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:51.398688 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358dc5ab-6f7f-4b7a-b61f-2cd17a9e674e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:51.398959 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358dc5ab-6f7f-4b7a-b61f-2cd17a9e674e admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:51.399224 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358dc5ab-6f7f-4b7a-b61f-2cd17a9e674e admin admin] PATH_INFO: `/v3/users/4a153aab98a8408db42c062c7a4db70e` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:51.400445 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358dc5ab-6f7f-4b7a-b61f-2cd17a9e674e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a153aab98a8408db42c062c7a4db70e)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:51.402412 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358dc5ab-6f7f-4b7a-b61f-2cd17a9e674e admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:51.419031 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:51.451715 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-358dc5ab-6f7f-4b7a-b61f-2cd17a9e674e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a153aab98a8408db42c062c7a4db70e'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:51.452377 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-358dc5ab-6f7f-4b7a-b61f-2cd17a9e674e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a153aab98a8408db42c062c7a4db70e'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:51.453035 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-358dc5ab-6f7f-4b7a-b61f-2cd17a9e674e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a153aab98a8408db42c062c7a4db70e'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:51.465904 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-358dc5ab-6f7f-4b7a-b61f-2cd17a9e674e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a153aab98a8408db42c062c7a4db70e'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:51.475965 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-358dc5ab-6f7f-4b7a-b61f-2cd17a9e674e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a153aab98a8408db42c062c7a4db70e'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:51.493223 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1452/2895] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 05:03:51 2022] DELETE /identity/v3/users/4a153aab98a8408db42c062c7a4db70e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:03:51.771681 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3735e-27ac-4bbd-bbe5-e69f947f2b05 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:51.773395 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-73a3735e-27ac-4bbd-bbe5-e69f947f2b05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:51.787163 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3735e-27ac-4bbd-bbe5-e69f947f2b05 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:51.850473 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bdf66-ec58-4c05-97a3-130f9b7761cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:51.851114 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bdf66-ec58-4c05-97a3-130f9b7761cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:51.851393 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bdf66-ec58-4c05-97a3-130f9b7761cc admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:51.851661 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bdf66-ec58-4c05-97a3-130f9b7761cc admin admin] PATH_INFO: `/v3/projects/a03a96cec9e2409e9109fd18d7ec73fe` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:51.852807 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340bdf66-ec58-4c05-97a3-130f9b7761cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a03a96cec9e2409e9109fd18d7ec73fe)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:51.854753 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340bdf66-ec58-4c05-97a3-130f9b7761cc admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:51.907267 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-340bdf66-ec58-4c05-97a3-130f9b7761cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a03a96cec9e2409e9109fd18d7ec73fe', 'request_id': 'req-340bdf66-ec58-4c05-97a3-130f9b7761cc'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:51.915592 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-340bdf66-ec58-4c05-97a3-130f9b7761cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a03a96cec9e2409e9109fd18d7ec73fe', 'request_id': 'req-340bdf66-ec58-4c05-97a3-130f9b7761cc'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:51.922434 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-340bdf66-ec58-4c05-97a3-130f9b7761cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a03a96cec9e2409e9109fd18d7ec73fe', 'request_id': 'req-340bdf66-ec58-4c05-97a3-130f9b7761cc'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:51.933557 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-340bdf66-ec58-4c05-97a3-130f9b7761cc admin admin] The token cache is being invalidate because project a03a96cec9e2409e9109fd18d7ec73fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:03:51.933802 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-340bdf66-ec58-4c05-97a3-130f9b7761cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:51.934631 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-340bdf66-ec58-4c05-97a3-130f9b7761cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:51.936312 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1444/2896] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 05:03:51 2022] DELETE /identity/v3/projects/a03a96cec9e2409e9109fd18d7ec73fe => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:03:51.941671 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9408c-c9b2-4a79-8b85-128b6c3d947f None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:51.942161 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9408c-c9b2-4a79-8b85-128b6c3d947f None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:51.942294 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9408c-c9b2-4a79-8b85-128b6c3d947f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:51.963990 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-03d9408c-c9b2-4a79-8b85-128b6c3d947f None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:03:51.965228 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-03d9408c-c9b2-4a79-8b85-128b6c3d947f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:52.036940 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1453/2897] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 05:03:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:03:52.044884 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1892900-42ee-44d3-a42d-d0f371f193dd None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:52.045163 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1892900-42ee-44d3-a42d-d0f371f193dd None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:52.045437 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1892900-42ee-44d3-a42d-d0f371f193dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:52.066168 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-e1892900-42ee-44d3-a42d-d0f371f193dd None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:03:52.067404 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-e1892900-42ee-44d3-a42d-d0f371f193dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:52.076996 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1445/2898] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 05:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:03:52.081395 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9408c-c9b2-4a79-8b85-128b6c3d947f None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:52.091858 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9408c-c9b2-4a79-8b85-128b6c3d947f None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:52.098066 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc24e5-6b1d-448b-9c77-95005e936886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:52.098670 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc24e5-6b1d-448b-9c77-95005e936886 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:52.098949 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc24e5-6b1d-448b-9c77-95005e936886 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:52.099223 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc24e5-6b1d-448b-9c77-95005e936886 admin admin] PATH_INFO: `/v3/domains` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:52.099910 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc24e5-6b1d-448b-9c77-95005e936886 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93148) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:03:52.100214 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc24e5-6b1d-448b-9c77-95005e936886 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:52.101952 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc24e5-6b1d-448b-9c77-95005e936886 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:52.114157 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1454/2899] 10.222.0.49 () {58 vars in 1153 bytes} [Wed Aug 24 05:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:03:52.118590 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1892900-42ee-44d3-a42d-d0f371f193dd None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:52.128315 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1892900-42ee-44d3-a42d-d0f371f193dd None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:52.133536 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4041d21-070d-4360-8d73-f834cb8ffa43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:52.134241 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4041d21-070d-4360-8d73-f834cb8ffa43 admin admin] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:52.134540 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4041d21-070d-4360-8d73-f834cb8ffa43 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:52.134810 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4041d21-070d-4360-8d73-f834cb8ffa43 admin admin] PATH_INFO: `/v3/projects` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:52.135433 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4041d21-070d-4360-8d73-f834cb8ffa43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:52.137368 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4041d21-070d-4360-8d73-f834cb8ffa43 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:52.167681 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1446/2900] 10.222.0.49 () {60 vars in 1153 bytes} [Wed Aug 24 05:03:52 2022] POST /identity/v3/projects => generated 399 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:03:52.172340 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc24e5-6b1d-448b-9c77-95005e936886 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:52.182602 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc24e5-6b1d-448b-9c77-95005e936886 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:52.240462 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7378d8-24a9-4ceb-96fb-1389efabeeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:52.241066 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7378d8-24a9-4ceb-96fb-1389efabeeb6 admin admin] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:52.241381 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7378d8-24a9-4ceb-96fb-1389efabeeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:52.241648 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7378d8-24a9-4ceb-96fb-1389efabeeb6 admin admin] PATH_INFO: `/v3/users` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:52.242266 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7378d8-24a9-4ceb-96fb-1389efabeeb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:52.244194 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7378d8-24a9-4ceb-96fb-1389efabeeb6 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:52.270622 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1455/2901] 10.222.0.49 () {60 vars in 1144 bytes} [Wed Aug 24 05:03:52 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:03:52.271848 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4041d21-070d-4360-8d73-f834cb8ffa43 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:52.282843 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4041d21-070d-4360-8d73-f834cb8ffa43 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:52.287838 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbed07-dd34-4601-9dcc-c28e995ea831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:52.288450 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbed07-dd34-4601-9dcc-c28e995ea831 admin admin] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:52.288780 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbed07-dd34-4601-9dcc-c28e995ea831 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:52.289052 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbed07-dd34-4601-9dcc-c28e995ea831 admin admin] PATH_INFO: `/v3/roles` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:52.289722 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acbed07-dd34-4601-9dcc-c28e995ea831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:52.291316 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acbed07-dd34-4601-9dcc-c28e995ea831 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:52.301271 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1447/2902] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 05:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:03:52.305442 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7378d8-24a9-4ceb-96fb-1389efabeeb6 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:52.315696 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7378d8-24a9-4ceb-96fb-1389efabeeb6 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:52.320742 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72041049-6c31-469c-94ee-d9172e7df671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:52.321392 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72041049-6c31-469c-94ee-d9172e7df671 admin admin] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:52.321676 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72041049-6c31-469c-94ee-d9172e7df671 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:52.321946 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72041049-6c31-469c-94ee-d9172e7df671 admin admin] PATH_INFO: `/v3/roles` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:52.322592 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72041049-6c31-469c-94ee-d9172e7df671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:52.324191 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72041049-6c31-469c-94ee-d9172e7df671 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:52.329609 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:52.336034 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1456/2903] 10.222.0.49 () {58 vars in 1122 bytes} [Wed Aug 24 05:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:03:52.340257 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbed07-dd34-4601-9dcc-c28e995ea831 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:52.350993 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbed07-dd34-4601-9dcc-c28e995ea831 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:52.356901 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4aac6-c5e2-43fa-99db-8c691477bff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:52.357527 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4aac6-c5e2-43fa-99db-8c691477bff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:52.357805 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4aac6-c5e2-43fa-99db-8c691477bff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:52.358071 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4aac6-c5e2-43fa-99db-8c691477bff3 admin admin] PATH_INFO: `/v3/projects/4f6d7392484d4734beccb385428cec5e/users/efe2a06316774e8fb69dcae4cf4ec698/roles/e2eda359ee274ff1914db224f7f9b383` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:52.373406 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4aac6-c5e2-43fa-99db-8c691477bff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f6d7392484d4734beccb385428cec5e, user_id=efe2a06316774e8fb69dcae4cf4ec698, role_id=e2eda359ee274ff1914db224f7f9b383)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:52.376140 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4aac6-c5e2-43fa-99db-8c691477bff3 admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:52.390497 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1448/2904] 10.222.0.49 () {60 vars in 1483 bytes} [Wed Aug 24 05:03:52 2022] PUT /identity/v3/projects/4f6d7392484d4734beccb385428cec5e/users/efe2a06316774e8fb69dcae4cf4ec698/roles/e2eda359ee274ff1914db224f7f9b383 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:03:52.400892 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1fc60-4d75-40ee-9839-852d60fe3a5d None None] REQUEST_METHOD: `POST` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:52.401176 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1fc60-4d75-40ee-9839-852d60fe3a5d None None] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:52.401504 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1fc60-4d75-40ee-9839-852d60fe3a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:52.429595 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.auth.core [None req-87c1fc60-4d75-40ee-9839-852d60fe3a5d None None] MFA Rules not processed for user `efe2a06316774e8fb69dcae4cf4ec698`. Rule list: `[]` (Enabled: `True`). {{(pid=93148) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:03:52.430809 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-87c1fc60-4d75-40ee-9839-852d60fe3a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:52.498074 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1457/2905] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 05:03:52 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:03:52.510171 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4aac6-c5e2-43fa-99db-8c691477bff3 admin admin] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:52.511955 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-75e4aac6-c5e2-43fa-99db-8c691477bff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:52.541392 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:52.582991 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4aac6-c5e2-43fa-99db-8c691477bff3 admin admin] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:52.587458 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e47481-ee47-4a0d-9c7f-989c7044ad51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a957fc61ff14c35aac0b577c3c1baf5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:52.588058 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e47481-ee47-4a0d-9c7f-989c7044ad51 service cinder] REQUEST_METHOD: `GET` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:52.588331 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e47481-ee47-4a0d-9c7f-989c7044ad51 service cinder] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:52.588651 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e47481-ee47-4a0d-9c7f-989c7044ad51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:52.598020 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e47481-ee47-4a0d-9c7f-989c7044ad51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:52.599452 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e47481-ee47-4a0d-9c7f-989c7044ad51 service cinder] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:52.608946 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1449/2906] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 05:03:52 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:03:57.660755 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1fc60-4d75-40ee-9839-852d60fe3a5d None None] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:57.727981 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1fc60-4d75-40ee-9839-852d60fe3a5d None None] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:57.734173 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a98409-bc43-4f2e-907c-962de22ca518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:57.734786 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a98409-bc43-4f2e-907c-962de22ca518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:57.735138 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a98409-bc43-4f2e-907c-962de22ca518 admin admin] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:57.735343 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a98409-bc43-4f2e-907c-962de22ca518 admin admin] PATH_INFO: `/v3/users/efe2a06316774e8fb69dcae4cf4ec698` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:57.736680 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a98409-bc43-4f2e-907c-962de22ca518 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efe2a06316774e8fb69dcae4cf4ec698)` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:57.738565 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a98409-bc43-4f2e-907c-962de22ca518 admin admin] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:57.789309 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-24a98409-bc43-4f2e-907c-962de22ca518 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efe2a06316774e8fb69dcae4cf4ec698'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:57.790000 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-24a98409-bc43-4f2e-907c-962de22ca518 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efe2a06316774e8fb69dcae4cf4ec698'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:57.790605 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-24a98409-bc43-4f2e-907c-962de22ca518 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efe2a06316774e8fb69dcae4cf4ec698'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:57.802399 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-24a98409-bc43-4f2e-907c-962de22ca518 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efe2a06316774e8fb69dcae4cf4ec698'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:57.810565 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.notifications [None req-24a98409-bc43-4f2e-907c-962de22ca518 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efe2a06316774e8fb69dcae4cf4ec698'} {{(pid=93148) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:57.822464 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1458/2907] 10.222.0.49 () {58 vars in 1224 bytes} [Wed Aug 24 05:03:57 2022] DELETE /identity/v3/users/efe2a06316774e8fb69dcae4cf4ec698 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:03:57.827006 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe417d9-6d05-4117-b607-891782775020 None None] REQUEST_METHOD: `POST` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:57.827473 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe417d9-6d05-4117-b607-891782775020 None None] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:57.827593 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe417d9-6d05-4117-b607-891782775020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:57.847374 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.auth.core [None req-efe417d9-6d05-4117-b607-891782775020 None None] MFA Rules not processed for user `e55eed92c6aa44dcbffd3cac5e4faad7`. Rule list: `[]` (Enabled: `True`). {{(pid=93147) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:03:57.848695 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-efe417d9-6d05-4117-b607-891782775020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:57.915091 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1450/2908] 10.222.0.49 () {58 vars in 958 bytes} [Wed Aug 24 05:03:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:03:57.924917 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a98409-bc43-4f2e-907c-962de22ca518 admin admin] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:57.926524 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-24a98409-bc43-4f2e-907c-962de22ca518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:57.938698 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:57.987793 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a98409-bc43-4f2e-907c-962de22ca518 admin admin] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:57.991920 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b29e0-5e29-4273-a775-3ef96df26e5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '087c0311906a4987b294729706a08810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:57.992523 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b29e0-5e29-4273-a775-3ef96df26e5e service neutron] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:57.992804 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b29e0-5e29-4273-a775-3ef96df26e5e service neutron] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:57.993076 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b29e0-5e29-4273-a775-3ef96df26e5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:58.002700 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b29e0-5e29-4273-a775-3ef96df26e5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:58.004139 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b29e0-5e29-4273-a775-3ef96df26e5e service neutron] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:58.015536 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1459/2909] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 05:03:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:03:58.288214 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe417d9-6d05-4117-b607-891782775020 None None] Authenticating user token {{(pid=93147) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:58.289823 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.fernet_utils [None req-efe417d9-6d05-4117-b607-891782775020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93147) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:58.304109 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe417d9-6d05-4117-b607-891782775020 None None] Validating token access rules against request {{(pid=93147) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:58.310348 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dffe06-9a73-4e32-94b2-cb4ee50d95fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e55eed92c6aa44dcbffd3cac5e4faad7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68ea81c5f7c24dfdae5a0b686d31ba39', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93147) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:58.311161 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dffe06-9a73-4e32-94b2-cb4ee50d95fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:58.311443 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dffe06-9a73-4e32-94b2-cb4ee50d95fa admin admin] SCRIPT_NAME: `/identity` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:58.311689 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dffe06-9a73-4e32-94b2-cb4ee50d95fa admin admin] PATH_INFO: `/v3/projects/4f6d7392484d4734beccb385428cec5e` {{(pid=93147) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:58.312871 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dffe06-9a73-4e32-94b2-cb4ee50d95fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f6d7392484d4734beccb385428cec5e)` {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:58.314868 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dffe06-9a73-4e32-94b2-cb4ee50d95fa admin admin] RBAC: Authorization granted {{(pid=93147) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:58.364671 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-b3dffe06-9a73-4e32-94b2-cb4ee50d95fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f6d7392484d4734beccb385428cec5e', 'request_id': 'req-b3dffe06-9a73-4e32-94b2-cb4ee50d95fa'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:58.375472 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-b3dffe06-9a73-4e32-94b2-cb4ee50d95fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f6d7392484d4734beccb385428cec5e', 'request_id': 'req-b3dffe06-9a73-4e32-94b2-cb4ee50d95fa'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:58.383018 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-b3dffe06-9a73-4e32-94b2-cb4ee50d95fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f6d7392484d4734beccb385428cec5e', 'request_id': 'req-b3dffe06-9a73-4e32-94b2-cb4ee50d95fa'} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:58.394391 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-b3dffe06-9a73-4e32-94b2-cb4ee50d95fa admin admin] The token cache is being invalidate because project 4f6d7392484d4734beccb385428cec5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93147) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:03:58.394679 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-b3dffe06-9a73-4e32-94b2-cb4ee50d95fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:58.395350 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG keystone.notifications [None req-b3dffe06-9a73-4e32-94b2-cb4ee50d95fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93147) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:58.396859 dv-cinder-854265-1-smb devstack@keystone.service[93147]: [pid: 93147|app: 0|req: 1451/2910] 10.222.0.49 () {58 vars in 1233 bytes} [Wed Aug 24 05:03:58 2022] DELETE /identity/v3/projects/4f6d7392484d4734beccb385428cec5e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:04:08.011511 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=22 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:08.391344 dv-cinder-854265-1-smb devstack@keystone.service[93147]: DEBUG dbcounter [-] [93147] Writing DB stats keystone:SELECT=72,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:43.804559 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b29e0-5e29-4273-a775-3ef96df26e5e service neutron] Authenticating user token {{(pid=93148) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:43.806146 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-9d7b29e0-5e29-4273-a775-3ef96df26e5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:43.953211 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b29e0-5e29-4273-a775-3ef96df26e5e service neutron] Validating token access rules against request {{(pid=93148) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:44.013838 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7cb65-ad5a-44c4-984a-e7eaad0912c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'edf1b960a2eb4e5e9ada736b5f3f5810', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '08755f450e6c47dcaaaa754a6aa2ec62', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93148) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:44.014439 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7cb65-ad5a-44c4-984a-e7eaad0912c0 service placement] REQUEST_METHOD: `GET` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:44.014720 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7cb65-ad5a-44c4-984a-e7eaad0912c0 service placement] SCRIPT_NAME: `/identity` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:44.014994 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7cb65-ad5a-44c4-984a-e7eaad0912c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93148) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:44.016969 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.fernet_utils [None req-e7e7cb65-ad5a-44c4-984a-e7eaad0912c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93148) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:44.029728 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7cb65-ad5a-44c4-984a-e7eaad0912c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:44.032109 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7cb65-ad5a-44c4-984a-e7eaad0912c0 service placement] RBAC: Authorization granted {{(pid=93148) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:44.044399 dv-cinder-854265-1-smb devstack@keystone.service[93148]: [pid: 93148|app: 0|req: 1460/2911] 10.222.0.49 () {60 vars in 1365 bytes} [Wed Aug 24 05:08:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:08:54.040111 dv-cinder-854265-1-smb devstack@keystone.service[93148]: DEBUG dbcounter [-] [93148] Writing DB stats keystone:SELECT=89 {{(pid=93148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}